VQA Real Image Challenge (Multiple-Choice)

Organized by vqateam - Current server time: May 30, 2026, 11 a.m. UTC

Previous

Real Challenge test2015 (mc)
Oct. 21, 2015, midnight UTC

Current

Real test2015 (mc)
Oct. 21, 2015, midnight UTC

End

Competition Ends
June 5, 2016, 11:59 p.m. UTC

Real test-dev2015 (mc)

Start: Oct. 6, 2015, midnight

Description: This phase evaluates algorithms on the VQA Multiple-Choice task for the dataset built on top of MSCOCO test-dev2015 real images for algorithm experimentation (see website for guidelines). Please do not try to make your results public; doing so will just fill the table with 0s. Evaluation (i.e., 'Running' status) takes about 2 minutes. ***REMINDER*** Your full test set submissions will be entered in our challenge if you either submit to the phase marked with 'Challenge' (Please do not try to make these results public; doing so will just fill the table with 0s.) OR you make your submission to the non-challenge phase public (i.e., on the leaderboard) before the challenge ends.

Real test2015 (mc)

Start: Oct. 21, 2015, midnight

Description: This phase evaluates algorithms on the VQA Multiple-Choice task for the dataset built on top of MSCOCO test2015 real images. Evaluation (i.e., 'Running' status) takes about 10 minutes. ***REMINDER*** Your full test set submissions will be entered in our challenge if you either submit to the phase marked with 'Challenge' (Please do not try to make these results public; doing so will just fill the table with 0s.) OR you make your submission to the non-challenge phase public (i.e., on the leaderboard) before the challenge ends.

Real Challenge test2015 (mc)

Start: Oct. 21, 2015, midnight

Description: This phase evaluates algorithms on the VQA Multiple-Choice task for the dataset built on top of MSCOCO test2015 real images for the explicit challenge. Evaluation (i.e., 'Running' status) takes about 10 minutes. ***REMINDER*** Your full test set submissions will be entered in our challenge if you either submit to the phase marked with 'Challenge' (Please do not try to make these results public; doing so will just fill the table with 0s.) OR you make your submission to the non-challenge phase public (i.e., on the leaderboard) before the challenge ends.

Competition Ends

June 5, 2016, 11:59 p.m.

You must be logged in to participate in competitions.

Sign In