SemEval-2022 Task 09: R2VQ - Competence-based Multimodal Question Answering Forum

Go back to competition Back to thread list Post in this thread

> "How do you" questions ambiguity!

Can the language of "how do you" questions be clarified? For example in the following recipe id (r-1015), the same type of question has different answers. Both have the same phrasing and tool (mixer) associated with it. How can a model learn to differentiate between the two? For question: 14-0, a human would answer it as "using a mixer".

# newdoc id = r-1015
# question 14-0 = How do you beat butter and curd cheese?
# answer 14-0 = beat butter and curd cheese into a cream
# question 2-1 = How do you mash the quargel in the bowl?
# answer 2-1 = by using a mixer

# sent_id = r-1015::step01::sent01
# text = Beat butter and curd cheese into a cream.
1 Beat beat VERB B-EVENT _ _ Tool=mixer.1.1.1|Habitat=bowl.1.1.1 _ MOVE-SOMETHING B-V _ _ _ _ _ _ _ _ _
2 butter butter NOUN B-EXPLICITINGREDIENT 1 _ _ butter.1.1.2 _ B-Patient _ _ _ _ _ _ _ _ _
3 and and CCONJ O _ _ _ _ _ I-Patient _ _ _ _ _ _ _ _ _
4 curd curd NOUN B-EXPLICITINGREDIENT 1 _ _ curd_cheese.1.1.4 _ I-Patient _ _ _ _ _ _ _ _ _
5 cheese cheese NOUN I-EXPLICITINGREDIENT _ _ _ _ _ I-Patient _ _ _ _ _ _ _ _ _
6 into into ADP O _ _ _ _ _ B-Goal _ _ _ _ _ _ _ _ _
7 a a DET O _ _ _ _ _ I-Goal _ _ _ _ _ _ _ _ _
8 cream cream NOUN B-IMPLICITINGREDIENT _ _ _ cream.1.1.8 _ I-Goal _ _ _ _ _ _ _ _ _
9 . . PUNCT O _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

# newpar id = r-1015::step02
# sent_id = r-1015::step02::sent01
# text = Mash quargel and mix it together with the well chopped onion and chives into cream.
1 Mash mash VERB B-EVENT _ _ Tool=mixer.2.1.1|Habitat=bowl.2.1.1 _ PRESS_PUSH_FOLD B-V _ _ _ _ _ _ _ _ _
2 quargel quargel ADV B-EXPLICITINGREDIENT 1 _ _ quargel.2.1.2 _ B-Patient _ _ _ _ _ _ _ _ _
3 and and CCONJ O _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
4 mix mix VERB B-EVENT _ _ Result=mixture.2.1.4|Tool=spoon.2.1.4|Habitat=bowl.1.1.1 _ COMBINE_MIX_UNITE _ B-V _ _ _ _ _ _ _ _
5 it it PRON O _ _ _ _ _ _ B-Patient _ _ _ _ _ _ _ _
6 together together ADV O _ _ _ _ _ _ B-Attribute _ _ _ _ _ _ _ _
7 with with ADP O _ _ _ _ _ _ B-Co-Patient _ _ _ _ _ _ _ _
8 the the DET O _ _ _ _ _ _ I-Co-Patient _ _ _ _ _ _ _ _
9 well well ADV B-IMPLICITINGREDIENT 4 _ _ well_chopped_onion.2.1.9 _ _ I-Co-Patient _ _ _ _ _ _ _ _
10 chopped chop VERB I-IMPLICITINGREDIENT _ _ _ _ _ _ I-Co-Patient _ _ _ _ _ _ _ _
11 onion onion NOUN I-IMPLICITINGREDIENT _ _ _ _ _ _ I-Co-Patient _ _ _ _ _ _ _ _
12 and and CCONJ O _ _ _ _ _ _ I-Co-Patient _ _ _ _ _ _ _ _
13 chives chive NOUN B-EXPLICITINGREDIENT 4 _ _ chives.2.1.13 _ _ I-Co-Patient _ _ _ _ _ _ _ _
14 into into ADP O _ _ _ _ _ _ B-Location _ _ _ _ _ _ _ _
15 cream cream NOUN B-IMPLICITINGREDIENT 4 _ _ cream.1.1.8 _ _ I-Location _ _ _ _ _ _ _ _
16 . . PUNCT O _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

Posted by: kartikaggarwal98 @ Nov. 28, 2021, 1:04 a.m.

The problem can be solved based on question category before. But with the important notice updated lately, I think even human can barely tell what kind of answer is expected from a "How do you" question (HIDDEN TOOL or GOAL or whatever) without exploring question category. Hope the organizer can share some information about it. Thanks.

Posted by: Quadcore @ Dec. 24, 2021, 12:50 a.m.
Post in this thread