Image 581918 is in our json but the evaluation script does seem to find it, any ideas? Thanks
Traceback (most recent call last):
File "/tmp/codalab/tmpRfqjPw/run/program/run.py", line 111, in
res = cut_res(res, maxDet=100)
File "/tmp/codalab/tmpRfqjPw/run/program/run.py", line 75, in cut_res
r_img = res[start_end[image_id][0]:start_end[image_id][1]]
KeyError: 581918
Hi,
Can you double check and try again? If you believe your submission format is correct but failed to evaluation. Please let us know the submission id and we will do offline evaluation.
Posted by: richardaecn @ Oct. 3, 2019, 5:15 p.m.Hi, we double checked, locally we can load the results file and it contains the key 581918. The image is actually processed and the entry looks fine to us.
We will keep looking into it but if you have any suggestions they are welcomed, thanks.
I don't know where I can find the submission ID, our team name is masked_vikings and we submitted at 10/03/2019 19:36:21. It is our third submission.
Thanks.
Posted by: morris11 @ Oct. 3, 2019, 7:51 p.m.Hi,
I took a look into your results and seemed your result is on the full test set, not on the test-dev set (with 20288 images).
Posted by: richardaecn @ Oct. 3, 2019, 10:55 p.m.Thanks a lot, we weren't aware of that. Cheers
Posted by: morris11 @ Oct. 4, 2019, 9:54 p.m.