UIoU Dark Zurich at Vision for All Seasons Workshop, CVPR 2020 Forum

Go back to competition Back to thread list Post in this thread

> Error in evaluation

The detailed results for my submission state that an error occurred while trying to evaluate IoU and average UIoU, however no further information is given. Is there a way to find out why the evaluation fails?

Posted by: petra.bevandic @ March 4, 2020, 2:15 p.m.

I had a look at your submission files. The problem is that in your `labelTrainIds` directory, there is at least one image (GOPR0356_frame_000321.png) where the Cityscapes trainID format is violated. I.e., there are some pixels in the image which assume the value 19, which is outside the expected set {0, 1, ..., 18}. See also the page with submission instructions for the relevant specification: https://competitions.codalab.org/competitions/23553#learn_the_details-evaluation .

I hope this helps.

Christos Sakaridis

Posted by: sakaridis @ March 4, 2020, 5:12 p.m.
Post in this thread