Sentence-level Direct Assessment QE shared task 2021 Forum

Go back to competition Back to thread list Post in this thread

> Multilingual Task Submission Format

May I know what is the submission format for the multilingual task? Specifically, what should I put in <LANGUAGE PAIR> and <SEGMENT NUMBER> in the submission file?

Thank you.

Posted by: joanne.wjy @ July 20, 2021, 9:44 a.m.

Dear joanne.wjy,
the multilingual track computes the average performance of your model across of the language pairs.
Therefore simply concatenate all your predictions for all the language pairs in to a single file.

Your submission should be a 10992 line file:
10990 predictions + (memory print & number of parameters of your model).

Best,
Fred.

Posted by: fblain @ July 20, 2021, 10:01 a.m.
Post in this thread