Sentence-level Direct Assessment QE shared task 2021 Forum

Go back to competition Back to thread list Post in this thread

> max submission total for multilingual systems is 5

Dear organizers,

max submission total for multilingual systems is 5, but i remember it being 30 few days ago. Is this a bug?

best,
Shaun

Posted by: shaunlim @ July 20, 2021, 2:03 a.m.

Dear shaunlim,
the maximum number of submission to the multilingual track was set to 30 by default, which was a mistake.
It should have been set to 5, similarly to last year.

Since few participants have already submitted more than 5 times, I exceptionally increased the limit and set it to 10, so that it is fair to
everyone. You should therefore be able to submit again to this track.
Please note that this limit of 10 submission is final.

Best,
Fred.

Posted by: fblain @ July 20, 2021, 9:34 a.m.

Dear Fred,

Thanks for your reply. Does the max number submissions include "failed" submissions (i.e. the total number of submissions showing in the results page) or only valid/succeeded submissions?

Best,
Shaun

Posted by: shaun.lim @ July 21, 2021, 3:11 a.m.

Dear shaun.lim,
failed submissions should not count towards the max amount of allowed submissions.

Best,
Fred.

Posted by: fblain @ July 21, 2021, 6:46 a.m.
Post in this thread