Hi, I noticed there are new datasets called 'Validation Data' on 'Participate -> Get Data' page.
However, on 'Learn the Details -> Evaluation' page, it says:
Phase 2: Final phase. You do not need to do anything. Your last submission of phase 1 will be automatically forwarded. Your performance on the test set will appear on the leaderboard when the organizers finish checking the submissions.
And on 'Phases -> Final' page:
Start: May 2, 2018, 11 p.m.
Description: The last submission from the previous phase is automatically cloned and used to compute the final score. The results on the test set will be revealed when the organizers make them available.
So I'm a little confused with the competition rules. Do we need to submit the solutions on the new 'Validation Data'? Or just wait for the final score on 'Test Data'?
Many thanks!
By the way, can we improve our method to make prediction on the new Validation Data in this phase? Or we can only use our previous method described in the paper?
Posted by: liweijia @ May 3, 2018, 10:52 a.m.Hello,
Yes, I'm sorry there is an error in the Wording of the Competition. For the final phase please use the validation data.
To your second question, You are allowed to improve your algorithm and then explain the improvements in the camera ready version. However please note you only have 5 submissions overall for this stage.
Thank you,
Dave
What submission will be used for the final evaluation? The best or the last?
Posted by: AutonomousSatelliteDrivers @ May 9, 2018, 10:14 p.m.Highest
Posted by: ilkedemir @ May 11, 2018, 8:44 p.m.