We're having trouble finding reference codes for competition metrics. It would be really helpful if we can get reference materials for competition metrics.Posted by: proletarians2021 @ July 20, 2021, 4:31 a.m.
There is inherent split information included in the scoring program to indicate if the data is collected from a same setting.
However, we would like to see if the check the model's generalization capability in a new environment without knowing this. (When in apply them in field test).
So we does not release the scoring code publicly at the moment.
We employ the extensively used PCKh metric (http://human-pose.mpi-inf.mpg.de/).
After plot the PCKh curve from 0 to 0.5.
PCKh-AUC score is simply integral area under the curve.