VQA Real Image Challenge (Multiple-Choice)

Organized by vqateam - Current server time: May 9, 2021, 8:07 a.m. UTC

Previous

Real Challenge test2015 (mc)
Oct. 21, 2015, midnight UTC

Current

Real test2015 (mc)
Oct. 21, 2015, midnight UTC

End

Competition Ends
June 5, 2016, 11:59 p.m. UTC

Real test-dev2015 (mc)

Start: Oct. 6, 2015, midnight

Description: This phase evaluates algorithms on the VQA Multiple-Choice task for the dataset built on top of MSCOCO test-dev2015 real images for algorithm experimentation (see website for guidelines). Please do not try to make your results public; doing so will just fill the table with 0s. Evaluation (i.e., 'Running' status) takes about 2 minutes. ***REMINDER*** Your full test set submissions will be entered in our challenge if you either submit to the phase marked with 'Challenge' (Please do not try to make these results public; doing so will just fill the table with 0s.) OR you make your submission to the non-challenge phase public (i.e., on the leaderboard) before the challenge ends.

Real test2015 (mc)

Start: Oct. 21, 2015, midnight

Description: This phase evaluates algorithms on the VQA Multiple-Choice task for the dataset built on top of MSCOCO test2015 real images. Evaluation (i.e., 'Running' status) takes about 10 minutes. ***REMINDER*** Your full test set submissions will be entered in our challenge if you either submit to the phase marked with 'Challenge' (Please do not try to make these results public; doing so will just fill the table with 0s.) OR you make your submission to the non-challenge phase public (i.e., on the leaderboard) before the challenge ends.

Real Challenge test2015 (mc)

Start: Oct. 21, 2015, midnight

Description: This phase evaluates algorithms on the VQA Multiple-Choice task for the dataset built on top of MSCOCO test2015 real images for the explicit challenge. Evaluation (i.e., 'Running' status) takes about 10 minutes. ***REMINDER*** Your full test set submissions will be entered in our challenge if you either submit to the phase marked with 'Challenge' (Please do not try to make these results public; doing so will just fill the table with 0s.) OR you make your submission to the non-challenge phase public (i.e., on the leaderboard) before the challenge ends.

Competition Ends

June 5, 2016, 11:59 p.m.

You must be logged in to participate in competitions.

Sign In