Forums

Diagnostic Questions - The NeurIPS 2020 Education Challenge Forum

Go back to competition Back to thread list Post in this thread

> Why do failed entries count as submissions?

Not sure why failed entries are counted as valid submissions. My total submission count should not increase because of invalid submission!

Posted by: nirmalpatel @ Aug. 2, 2020, 7:03 p.m.

I agree

Posted by: xtalclr @ Aug. 3, 2020, 11:32 a.m.

Hi Nirmal,

Thanks for raising this issue, the organizers will discuss this and get back to you shortly.

Thanks,
Angus

Posted by: anlam @ Aug. 12, 2020, 8:33 a.m.

Hi there, sorry for getting back late! I contacted codalab admin and just got a response. It seems the one way to circumvent this is for us to remove failed entries that are not your fault but the codalab system's fault. Let me chat with the other organizers and figure out how to best implement this. I'll get back to you in a few days. Thanks!

Posted by: moonlightlane @ Aug. 29, 2020, 2:58 a.m.
Post in this thread