Dear HaHackathon participants,
We hope that everything is running smoothly for you in the test phase. We wanted to make you aware of a slightly less than ideal functionality of Codalab, which you may have noticed in the development phase.
Users have the option to hide submissions they have made, in order to show your best submissions. However, we would like to point out that by if the submission that you hide contains entries to more than one subtask, the results will be hidden for all subtasks. For example, a user in the dev period elected to to "show" the submission with their best score for task 1a, and that action "hid" the submission that had their best score for task 1c. As a result, the leaderboard does not show that their score was in fact the highest score on task 1c.
We therefore advise you to use caution if you choose to use this function. If you do decide to use it, please remember to send one final submission (probably near the deadline) with the best results for each subtask. You should know the result you have for each subtask in each submission, you only have to create a new submission copying the columns that got the best results in each subtask.
Best of luck!
HaHackathon Organizers
Posted by: jam @ Jan. 21, 2021, 5:10 p.m.