Forums

VisDA 2020: Domain Adaptive Pedestrian Re-identification Forum

Go back to competition Back to thread list Post in this thread

> Evaluation metric for final ranking

Hi,
I am confused about the evaluation metric for the final ranking. The homepage of the competition said that overall accuracies would be taken into consideration. Does it mean that the mean of all accuracies listed in this system will be used for ranking? Look forward to your reply. Thanks!

Posted by: yxge @ July 9, 2020, 3:17 p.m.

Thanks for your question!

The mean of all accuracies might be reasonable, so we will not use it.

We will consider both the mAP and CMC metrics. More specifically, Rank-1 and mAP will have more weights.

Regards!

Posted by: weijian @ July 10, 2020, 3:44 a.m.

Thanks! It makes sense that Rank-1 and mAP have more weights.

Posted by: yxge @ July 10, 2020, 4:02 a.m.

Hi, can we know the precise weights for the mAP and CMC metrics?

Posted by: vimar @ July 22, 2020, 2:19 a.m.
Post in this thread