SemEval-2018 Task 12 - The Argument Reasoning Comprehension Task Forum

Go back to competition Back to thread list Post in this thread

> About Post-Competition(evaluation on test data)

Dear participants , I met some question when I submit my answer.txt.zip , The error as following:
Exception in thread "main" java.lang.IllegalArgumentException: Parameter 'gold' is an empty map
at de.tudarmstadt.ukp.argumentation.semeval2018.Scorer.computeAccuracy(Scorer.java:114)
at de.tudarmstadt.ukp.argumentation.semeval2018.Scorer.main(Scorer.java:179)

Posted by: Joker @ Jan. 30, 2018, 2:03 a.m.

Hello, thanks for reporting, I have no idea at the moment (one cannot easily test the different phases online). But post-evaluation will run forever so I'll have a look and try to fix it. Ivan

Posted by: ivan.habernal @ Jan. 30, 2018, 10:30 a.m.
Post in this thread