> ValueError: Unexpected label: NOT

Dear,
When I try to submit the submission file, i got the following error:

WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
Traceback (most recent call last):
File "/tmp/codalab/tmp4axUtM/run/program/evaluate.py", line 88, in
fscore = f1_macro(gold, predicted)
File "/tmp/codalab/tmp4axUtM/run/program/evaluate.py", line 15, in f1_macro
raise ValueError("Unexpected label: " + p)
ValueError: Unexpected label: NOT

The lines are in the right format: comma-separated with the first field as the id (starting from 8001) and the second as the prediction (OFF or NOT).

is there any solution for this ?

Posted by: hhaddad @ Feb. 24, 2020, 2:18 p.m.

If you go to "Participate/Files" then press "Stating Kit", you will download a zipped file contains the majority baseline file " offenseval-ar-test-taskA-baseline-v1.zip" which contains pairs of: id,NOT (2000 lines).
Compare the format of this file with your submission file. Also, you can change some rows in the baseline file and submit to have a successful submission.
If this doesn't solve the problem, send your submission file to the organizer to debug.
Good luck!
Competition Organizer

Posted by: hmubarak @ Feb. 24, 2020, 5:52 p.m.
Post in this thread