Forums

The VoxCeleb Speaker Recognition Challenge 2020 - Track 4 (Diarisation, open) Forum

Go back to competition Back to thread list Post in this thread

> Which system stays in leaderboard?

Dear organizers,
We were wondering which system stays in the leaderboard for the "Challenge workshop", if the last submitted system or the best submitted system. Could you clarify? My apologies if it was stated somewhere, we could not find it.
Thank you,
Federico

Posted by: landini @ Oct. 13, 2020, 9:23 a.m.

Hi,

It should be the best submission that stays on the leaderboard. If you think your best submission based on DER is not on the leaderboard, please contact us immediately.

Posted by: anagrani @ Oct. 13, 2020, 10:04 a.m.

The leaderboard considered the best JER as criterion for selecting the best submission. Given that the primary metric is DER, I guess that should be changed.
Thank you,
Federico

Posted by: landini @ Oct. 14, 2020, 5:47 p.m.

Hi,

It should be fixed now. Note - any of these cases will be properly checked before the final results are announced. This is just an issue with how codalab works, but we are aware of this and will make sure the final results on the leaderboard will be ranked by the primary metric in all tracks.

Posted by: anagrani @ Oct. 14, 2020, 6:12 p.m.
Post in this thread