Is there something wrong with the submission sorting system?
From the scoring output log, it can be found that the minDCF is 0.1005 for our penultimate submission to track 2 on 1/24/2022
In our latest submission to track 2 on 1/25/2022, the minDCF is 0.1020
Theoretically, the best number should be 0.1005 instead of 0.1020, right?
The same thing also happened to EER.
The EER for our penultimate submission is：1.727%
The EER for our latest submission is：1.761%
Thanks for your help.
Yours,
Strasbourg-Spk Team
Hi,
Codalab has a bug in its sorting algorithm, so we occasionally need to manually select the highest scoring submission. This is unrelated to your previous issues. It looks fixed now.
We are looking to move away from Codalab for the next competitions due to these issues
Posted by: YASA @ Jan. 26, 2022, 10:33 a.m.Hi YASA,
We fully understand this. It fixed my issue.
Once again, I want to thank you on behalf of my team and the whole community for your great contribution to this series of events.
It means so much to us.
Thank you for making everything possible.
All the best to the coming VoxSRC2022 event.
Yours,
Strasbourg-Spk Team
Thanks for participating :)
Posted by: YASA @ Jan. 26, 2022, 11:51 a.m.