Question-answering has become a popular task, with many practical applications (e.g. dialogue systems). It's appealingly easy to interpret and quantitatively evaluate, and with a simple setup, it's relatively easy to generate the very large datasets that work well for deep learning. Advancements in visual QA (with images and natural language questions) with large-scale datasets have pushed this field forward rapidly, and with this challenge dataset we hope to extend this progress to video. This dataset is a fill-in-the-blank version of the LSMDC2016 dataset - for more information about the datasets, please see here.
In this challenge, given a video clip and a sentence with a blank in it, the task is to fill in the blank with the correct word.
To participate, you should first create an account on CodaLab. In order to submit your test set results, please, perform these steps:
Note that we allow up to 10 submissions per day / 100 in total
The challenge is evaluated on accuracy of filled-in blanks.
Winners will be selected based on the highest score (accuracy) on the public test set.
Start: Aug. 31, 2016, midnight
You must be logged in to participate in competitions.Sign In