SemEval 2020 Task 4 - Commonsense Validation and Explanation (ComVE) Forum

Go back to competition Back to thread list Post in this thread

> Number of submission per subtask

Hello Dears,

How many submissions are allowed on the test set for each subtask?
For example, if I submitted 3 submissions, you will consider the best one or the last one?

Best,
Ali

Posted by: aliosm @ Feb. 22, 2020, 3:03 p.m.

Hi!
Do I understand correctly that last submission will be taken for score?

Posted by: TMLab @ Feb. 23, 2020, 2:57 p.m.

I have the same question. If I have submitted multiple times, but the format of the last submission is wrong, will I have the previous score? Whether I can think of the last successful submission as the basis for scoring.

Posted by: im0qianqian @ Feb. 24, 2020, 1:34 p.m.

Hi,

According to SemEval 2020 Official Website http://alt.qcri.org/semeval2020/index.php?id=codalab, "only their final valid submission on CodaLab will be taken as the official submission to the competition". So for now we will use your last valid submission as your final result.

If you have the wrong format for the last submission, do not worry. You last valid submission will be considered.

If there's any updates we will let you know.

Posted by: Shuailong @ Feb. 25, 2020, 9:34 a.m.
Post in this thread