Hi,
Would you please explain the format of submissions? For example, should we submit the "test.en-en.gold" file?
I submitted a file like that and got the error " invalid input type()".
Thank you
sorry the error was "invalid file type()"
Posted by: nranjbar @ Jan. 14, 2021, 8:59 a.m.Hello,
As far as the format is concerned, when submitting please make sure that you satisfy the following requirements:
1. Your answers (e.g. test.-ru-ru, test.ar-ar, test.en.ru, test.en-ar) must be exactly in the same format as our dev .gold files available at https://github.com/SapienzaNLP/mcl-wic
2. The name of the files you would like to submit must be "test.{language}-{language}" (language combinations are provided on our CodaLab page and in previous posts), do NOT add .gold at the end of your file names
3. The file format is JSON
4. Zip all your test.{language}-{language} files into a "submission.zip" file, do NOT add extra folders, just zip the files together and submit.
5. Use the same ids that we used (e.g. test.ru-ru.0, test.ru-ru.1, ..test.ru-ru.999)
6. Use T/F as tags, Y/N or other tags will not be accepted.
Cheers,
The MCL-WiC team