Does the failed submission counted in total 5 times submissions?
Posted by: UoB_UK @ Jan. 26, 2021, 11:16 a.m.By the way, Could you give me more detail about this error: Len mismatch between /tmp/codalab/tmpHE0reB/run/input/res/test.en-en and the corresponding gold file.
I have not found differences in the number of ID of test.en-en and test.en-en.data.
Thank you.
Posted by: UoB_UK @ Jan. 26, 2021, 1:09 p.m.Hi,
I think that only successful submissions count. Len mismatch means that the len of your file is not the same as the len of the gold file.
Best regards,
The MCL-WiC team
Can we see the result of submission? I have submitted the submission.zip and then it shows 'finished' but there are no results like Acc or F1 scores in it.
Thank you.
Posted by: UoB_UK @ Jan. 27, 2021, 11:58 a.m.Hi,
In this competition the leaderboard is kept private during the evaluation period, so it's normal that you don't see the scores.
Best regards,
The MCL-WiC
Hi,
What is the difference between the status finished and submitted?
Thank you!
Posted by: UoB_UK @ Jan. 28, 2021, 2:36 p.m.I think that submitted means that the file was submitted to CodaLab to be processed, whereas finished means that no errors were detected and that the submission was successful.
Best regards,
The MCL-WiC team