Learning By Doing NeurIPS 2021 Competition – CHEM

Organized by LearningByDoing - Current server time: July 27, 2021, 5:51 p.m. UTC
Reward $6,000

Previous

Trial Phase
July 6, 2021, 10 a.m. UTC

Current

Validation Phase
July 10, 2021, 4 p.m. UTC

Next

Selection Phase
Sept. 20, 2021, 4 p.m. UTC

Trial Phase

Start: July 6, 2021, 10 a.m.

Description: During this phase you can try out the competition setup. You can retrieve the training data, train models offline, and submit control inputs. Use this phase to familiarize yourself with the competition. In this phase the loss is only a proxy.

Validation Phase

Start: July 10, 2021, 4 p.m.

Description: This is the main phase of the competition. You can make up to 20 submission per day (and a total of 1000 overall). During this phase your best submission – on the validation systems – is shown on the public leaderboard. Use this phase to try out different approaches. Make sure to (re-)download and use the latest CHEM_starter_kit.zip and CHEM_trainingdata.zip, which contain the file VALIDATION_PHASE.TAG and got updated with a new set of systems (different from the ones in the trial phase).

Selection Phase

Start: Sept. 20, 2021, 4 p.m.

Description: During this phase you can select a submission for the final leaderboard. You only have 30 submissions during this phase. Your last uploaded and completed submission, i.e., the one marked with a green check mark before the end of this phase, is used for the final ranking. The loss shown during this phase is the same as in the validation phase, the final leaderboard is based on the loss on the held-out systems.

Final Leaderboard

Start: Sept. 26, 2021, 4 p.m.

Description: The competition is over and you cannot make any submissions anymore. Your last complete submission from the selection phase is forwarded and evaluated on the held-out systems. The leaderboard remains hidden until the organizers publish the results.

Competition Ends

Sept. 26, 2021, 6 p.m.

You must be logged in to participate in competitions.

Sign In
# Username Score
1 TeamQ 0.3457
2 KC988 0.3674
3 GuineaPig 0.3698