SemEval-2021 Task 4: Reading Comprehension of Abstract Meaning Forum

Go back to competition Back to thread list Post in this thread

> Regarding the post-evaluation period

Since the labelled test set will be released after the deadline of the paper submission, is it possible to have a post-evaluation period (before the deadline) so that teams can make unofficial submissions (which will obviously not contribute to the leaderboard)? We want to be able to perform an effective ablation study in the paper.

Posted by: lrg.recam @ Feb. 11, 2021, 4:17 a.m.

We have already release labels of both subtask-1 and subtask-2 in this link:
https://drive.google.com/drive/folders/1-jhHCArej4fjYJuw2AI9fmf2B6YVAcr_?usp=sharing
You could perform additional experiements using these data.

Posted by: BoyuanZheng @ Feb. 22, 2021, 1:02 p.m.
Post in this thread