Hi, I submitted a result but your system prompted it failed. My json format is [{'video_id': ..., 'category_id': ..., 'segmentation': [{'size': ..., 'counts': ...}, {}, ...], 'score': [...]}, {...}...]
I would like to know what's wrong with my result?
Thank you.
The json format should be:
[
{
"video_id" : int,
"category_id" : int,
"segmentations" : [RLE or [polygon] or None],
"score" : float,
},
...
]
Please refer to "https://competitions.codalab.org/competitions/32377#participate-get_starting_kit" and "https://github.com/youtubevos/MaskTrackRCNN/blob/10e5d7ded62e0b7c5bf79075d9ee0cc37dc15321/mmdet/core/evaluation/coco_utils.py#L165" to generate the json file.
Posted by: qjy @ July 13, 2021, 2:38 p.m.I modified my results.json as your format but still failed. It prompted that 'AssertionError: Results do not correspond to current coco set'. I checked the result.json and it contained all video id in your annotations_test.json.
What is my problem? Many thanks.
There are 154 videos in your submitted json while our validation set only contains 140 videos.
154 is the number of videos in our test set. Please make sure that you are evaluating on the validation set but not the test set. Evaluation on the test set will be available on July 26th. Good luck!