SemEval 2020 Task 4 - Commonsense Validation and Explanation (ComVE) Forum

Go back to competition Back to thread list Post in this thread

> Fails to submit

I am trying to submit the trail dataset, but it fails and gives me this "WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
ERROR:root:Found 1021 extra predictions, for example: 1, 3, 4"

can someone tell how to fix even though I am submitting right?

Posted by: Roweida_Mohammed @ Feb. 20, 2020, 12:26 a.m.

It is probably because you ignore the sample id and just use the row number as a new id maybe? Please note that the original sample id is essential for the evaluation to match a correct reference.

Posted by: Shuailong @ Feb. 20, 2020, 9:33 a.m.
Post in this thread