DynamicEarthNet Weakly-Supervised Multi-Class Change Detection Challenge Forum

Go back to competition Back to thread list Post in this thread

> Ranking strategy of the leaderboard

Dear organizer,
I have a suggestion on whether the ranking strategy of the leaderboard can be modified to show only the highest historical scores, not the latest results. This will help us understand the gap with other participants.

Posted by: fdasgdsag @ May 8, 2021, 3:45 p.m.

makes sense! now it is changed :) if new submission beats old score, it will be on leaderboard.

Posted by: aysim @ May 10, 2021, 5:17 p.m.

Are you sure? I can still see the “submit to leaderboard” button and “remove to leaderboard” on the submit page. This means we can still adjust the scores we want to show on the leaderboard.

Posted by: fdasgdsag @ May 11, 2021, 3:08 a.m.

yes now, by default, your new score will be on leaderboard only if it beats your old score. However if you want to show lower score, you can do this (even though I am not sure why). I won't disallow participants to modify the leaderboard.

Posted by: aysim @ May 11, 2021, 7:55 a.m.
Post in this thread