YouCook2-BoundingBoxes Video Object Grounding Task

Organized by youcook2 - Current server time: Dec. 5, 2019, 6:12 p.m. UTC

Previous

Validation
June 24, 2019, midnight UTC

Current

Testing
June 24, 2019, midnight UTC

End

Competition Ends
Never

Overview

This is the official evaluation server for the YouCook2-BoundingBoxes Video Object Ground Task. YouCook2-BB provides bounding box annotations for the validation and testing splits from the YouCook2 dataset.

Please reference the repo and the paper for more code and details.

Evaluation Criteria

We compute validation and testing accuracy using Box Accuracy (box localization accuracy). For the predicted boxes, the output is positive if it has IoU greater than or equal to 0.5 with a ground-truth bounding box, otherwise the score is negative. We compute the Box Accuracy for each object and average across the object classes. We do not penalize for predictions on grounded objects that are occluded or out-of-view.

Please reference the paper for any additional details. Our evaluation script for computing the box accuracy. Our repo and CodaLab should produce the same accuracy on the validation split.

IMPORTANT! All submission files must be named exactly submission_yc2_bb.json.

Terms and Conditions

This page enumerated the terms and conditions of the competition.

Validation

Start: June 24, 2019, midnight

Description: Ensure submission file is name yc2_bb_submission.json

Testing

Start: June 24, 2019, midnight

Description: Ensure submission file is name yc2_bb_submission.json

Competition Ends

Never

You must be logged in to participate in competitions.

Sign In
# Username Score
1 youcook2 0.3199