SemEval-2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation (MCL-WiC) Forum

Go back to competition Back to thread list Post in this thread

> Submission Langauge Coverage

Hello!

Does the submitted system have to be able to classify all multilingual and cross-lingual datasets? Or can it be specific to a particular language/language pair?

Also, from looking at the trial data provided, it seems that cross-lingual datasets are only between English and the other four languages. Is that the case?

Thank you!

Posted by: amroa @ Oct. 21, 2020, 5:39 p.m.

Hello!

Participants will be asked to submit data not code. In the test phase, we will provide the .data files and participants will be asked to produce and submit the .gold files.

Yes, the cross-lingual data is always between English and one of the other four languages.

All the best,
The MCL-WiC team

Posted by: Federico_Martelli @ Oct. 22, 2020, 7:18 a.m.

I see. Thank you.

For a submission to be accepted, should there a .gold file for every .data file? Or can a submission for a single lanauge/language pair be accepted?

Posted by: amroa @ Oct. 22, 2020, 9:05 a.m.

Hi!

A submission for a single language pair will be accepted as well.

Best regards,
The MCL-WiC team

Posted by: Federico_Martelli @ Oct. 27, 2020, 9:35 a.m.

Great! Thanks.

Regards,
Amro

Posted by: amroa @ Oct. 27, 2020, 10:05 a.m.
Post in this thread