SemEval-2022 Task 09: R2VQ - Competence-based Multimodal Question Answering Forum

Go back to competition Back to thread list Post in this thread

> question ID?

Hello,

The questions/answers in the Conll-U file do not have question IDs as requested in the expected output. We currently are programmatically mapping questions to recipes.

Posted by: tweston @ Nov. 8, 2021, 7:47 p.m.

Hi,
We made an update to the dataset in 10/28/2021. Question ID for each QA pair is added to the dataset during that update, so please make sure you are working on the latest version.

In the latest dataset, take the first QA pair from the first recipe as an example (line1-3):
"""
# newdoc id = f-6VWP66LZ
# question 0-1 = How many actions does it take to process the minced meat?
# answer 0-1 = 1
"""
The Recipe_ID will be "f-6VWP66LZ" and Question_ID for that QA pair will be "0-1".

I hope it's helpful and let us know if you have further questions.
- Jingxuan

Posted by: r2vq @ Nov. 10, 2021, 7:59 p.m.
Post in this thread