Dear challenge participants,
We just fixed a bug in the evaluation code. Previously the evaluation code
gives wrong metrics when the image resolution in the uploaded result
is inconsistent with the original image resolution. Now it will give
mAP 0 if the image resolution of the result is different from the
original image resolution. Please check your uploaded result and make
sure you use the original image resolution for generating the result.
We have also released the evaluation code at https://github.com/youtubevos/cocoapi
Welcome to help us review and improve it.
Sorry for the inconveniences. Thanks for your attention.
Best,
YouTubeVOS Team
Best,
Posted by: linjie @ July 21, 2019, 5:48 a.m.Dear challenge participants,
We further added the logging to help you locate the submitted results in wrong resolution.
The "scoring output log" will contain "Mask sizes in video 1 and category 1 may not match!" for this scenario.
Best,
YouTubeVOS Team