We're having trouble finding reference codes for competition metrics. It would be really helpful if we can get reference materials for competition metrics.
Posted by: proletarians2021 @ July 20, 2021, 4:31 a.m.Scoring code:
There is inherent split information included in the scoring program to indicate if the data is collected from a same setting.
However, we would like to see if the check the model's generalization capability in a new environment without knowing this. (When in apply them in field test).
So we does not release the scoring code publicly at the moment.
For metric:
We employ the extensively used PCKh metric (http://human-pose.mpi-inf.mpg.de/).
After plot the PCKh curve from 0 to 0.5.
PCKh-AUC score is simply integral area under the curve.