Learning By Doing NeurIPS 2021 Competition – ROBO
Reward $6,000
Previous
Final LeaderboardCurrent
Final LeaderboardEnd
Competition EndsDebug Phase (always open)
Start: July 15, 2021, 5 p.m.
Description: You can submit controllers for fake evaluation, that is, the controller interface is tested and output not hidden, but the state / targets that your code provided are not actually system observations and the inputs are not applied to the systems but replaced by control inputs of the same shape - use this to help debug your submission. This phase never ends and you can submit 15 times per day for debugging throughout the competition.
Trial Phase
Start: July 15, 2021, 5 p.m.
Description: During this phase you can familiarize yourself with the competition setup. You can retrieve training data, train controllers offline, and submit your controller code. In this phase only a subset of systems and trajectories is evaluated. (You can always use the Debug Phase for debugging.)
Validation Phase
Start: Aug. 4, 2021, 4 p.m.
Description: This is the main phase of the competition. You can make up to 3 submission per day (and a total of 200 overall). During this phase your best submission – on the validation systems – is shown on the public leaderboard. Use this phase to try out different approaches. (You can always use the Debug Phase for debugging.)
Selection Phase
Start: Sept. 12, 2021, 4 p.m.
Description: During this phase you can select a submission for the final leaderboard. You only have 60 submissions during this phase. Your last uploaded and complete submission, i.e., the one marked with a green check mark before the end of this phase, is used for the final ranking. The loss shown during this phase is the same as in the validation phase, the final leaderboard is based on the loss on the held-out systems. Your controller submission is evaluated on all systems and trajectories so that an error is thrown if your controller does not correctly run on the final evaluation systems and trajectories; if this is the case, use the debug phase to debug your controller. (You can always use the Debug Phase for debugging.)
Final Leaderboard
Start: Sept. 26, 2021, 4 p.m.
Description: The competition is over and you cannot make any submissions anymore. Your last complete submission from the selection phase is forwarded and evaluated on the held-out systems and trajectories. The leaderboard remains hidden until the organizers publish the results.
Competition Ends
Sept. 26, 2021, 6 p.m.
You must be logged in to participate in competitions.
Sign In| # | Username | Score |
|---|---|---|
| 1 | Ajoo | 0.918 |
| 2 | TeamQ | 16.121 |
| 3 | jmunozb | 29.539 |