I am confused about the evaluation metric for the final ranking. The homepage of the competition said that overall accuracies would be taken into consideration. Does it mean that the mean of all accuracies listed in this system will be used for ranking? Look forward to your reply. Thanks!
Thanks for your question!
The mean of all accuracies might be reasonable, so we will not use it.
We will consider both the mAP and CMC metrics. More specifically, Rank-1 and mAP will have more weights.
Regards!Posted by: weijian @ July 10, 2020, 3:44 a.m.
Thanks! It makes sense that Rank-1 and mAP have more weights.Posted by: yxge @ July 10, 2020, 4:02 a.m.
Hi, can we know the precise weights for the mAP and CMC metrics?Posted by: vimar @ July 22, 2020, 2:19 a.m.