SemEval-2022 Task 09: R2VQ - Competence-based Multimodal Question Answering Forum

Go back to competition Back to thread list Post in this thread

> URGENT - the evaluation phase has ended prematurely

We expected this phase to last until 01/31/2022 23:59:59 UT (i.e. end of Jan)
The phase has switched to Post-evaluation, and we have just made an attempt to upload our final results. This ended with

Traceback (most recent call last):
File "/worker/", line 361, in run
raise Exception("Program command is not specified.")
Exception: Program command is not specified.

We expect our solution to have much better result, above 92% Exact Match, so we kindly ask for the urgent assistance

Posted by: t.dryjanski @ Jan. 31, 2022, 8:13 a.m.

The American Heritage Dictionary of the English Language states "By convention, 12 AM denotes midnight

Posted by: weihezhai @ Jan. 31, 2022, 8:48 a.m.


We just made it possible to make submissions possible on the post-evaluation phase. All the submissions before 23:59 UTC-12, Jan. 31st, 2022 will be accepted.

- Jingxuan

Posted by: r2vq @ Jan. 31, 2022, 3:13 p.m.
Post in this thread