SemEval-2022 Task 09: R2VQ - Competence-based Multimodal Question Answering Forum

Go back to competition Back to thread list Post in this thread

> Need for fine-grained results on the board

The downloadable CSV file with results has "Exception parsing scores!" inside; the "correct" column on the results page is empty.
We are entering the competition phase where tiny fractions of the result can decide the winner; can we have this information provided?

Regards,
Tomasz

Posted by: t.dryjanski @ Jan. 28, 2022, 10:10 a.m.

Yes, right. Two teams can have very similar results and nobody knows which result is leading, where round information from the plot is not fully detailed.

Posted by: PawelBujnowski @ Jan. 28, 2022, 11:08 a.m.

Hi,

Sorry the codalab leaderboard is not working as we expected. We will add a section on the codalab page to show the fine-grained scores and ranks soon.

- Jingxuan

Posted by: r2vq @ Jan. 31, 2022, 3:18 p.m.
Post in this thread