Dear participants,
Today, we release the gold data. They can be found on the Codalab website
in the "Participate" tab. In addition to gold answer labels, the gold
standard contains (1) annotations about the question reasoning type (can be
answered from text/from common sense) as annotated by crowdsourcing
workers, and (2) information about the scenario of each text.
We strongly encourage you to download the gold data and make use of the
additional annotations for evaluating your systems. Remember that in the
system description paper, you can also report experiments you did with
other system configurations. If you want to submit a system description
paper but have not filled out the participant survey yet, please do so
*today*.