> Task2 submission error

Hello,

I see the following error when I submit the file for task 2. I'm not sure what exactly is the problem.

WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
INFO | * Loading reference data
WARNING| get_tokens_sequence "ndicating" discarded
WARNING| get_tokens_sequence "." discarded
WARNING| get_tokens_sequence "statement" discarded
WARNING| get_tokens_sequence "." discarded
WARNING| get_tokens_sequence "A" discarded
WARNING| get_tokens_sequence "dea" discarded
WARNING| get_tokens_sequence "BellaNaija" discarded
WARNING| get_tokens_sequence "." discarded
INFO | * Loading prediction data
Traceback (most recent call last):
File "/tmp/codalab/tmp6gT9da/run/program/task2_evaluate.py", line 377, in
main()
File "/tmp/codalab/tmp6gT9da/run/program/task2_evaluate.py", line 370, in main
exit(args.func(args))
File "/tmp/codalab/tmp6gT9da/run/program/task2_evaluate.py", line 341, in from_folder
evaluate_files(g_file, s_file, o_file)
File "/tmp/codalab/tmp6gT9da/run/program/task2_evaluate.py", line 296, in evaluate_files
y_pred = get_data(sub_csv[1:])
File "/tmp/codalab/tmp6gT9da/run/program/task2_evaluate.py", line 270, in get_data
_, labels = zip(*encode_causal_tokens(text, cause, effect))
File "/tmp/codalab/tmp6gT9da/run/program/task2_evaluate.py", line 183, in encode_causal_tokens
assert labels[position] == '-'
AssertionError

Posted by: surupendu @ April 10, 2020, 10:39 a.m.

Hello,
It might be a docker issue, we're on it.
Does this message appears every time you submit or occasionally ?

Posted by: YseopLab @ April 14, 2020, 8:18 a.m.

Ok, I can see you submitted multiple time.
We are looking into it and will revert back once fixed.

Posted by: YseopLab @ April 14, 2020, 8:27 a.m.

We removed an assert from the scoring program that was too restrictive and caused it to fail.
We also re-run Task 2 submissions that were impacted by this issue.

Regards,

Posted by: YseopLab @ April 14, 2020, 12:22 p.m.
Post in this thread