Dear organizers,
I have a submission which has lower DER but higher JER, but the leaderboard doesn’t display this submission. Will this submission be scored as the final result?
Since the leaderboard is ranked using the DER only, it is odd that the submission page only display the JER and the leaderboard doesn’t update even DER is lower.
Thanks!
Posted by: strato @ Aug. 27, 2021, 2:02 p.m.It seems this bug shows again, after fixing the web problem.
Posted by: qyhong @ Sept. 1, 2021, 6:44 a.m.This bug shows again.
Posted by: chen2101 @ Sept. 2, 2021, 1:47 a.m.Hi,
We have been experiencing some problems with CodaLab this year, and will move to a more reliable option next year.
We can see the JER of each of the participant's submissions, and will make sure that the official leaderboard at the VoxSRC workshop reflects the correct rankings.
Posted by: YASA @ Sept. 2, 2021, 9:44 a.m.Thanks.
When the final rankings will be updated to the leaderboard on codalab?
Posted by: chen2101 @ Sept. 2, 2021, 10:24 a.m.The leaderboards will be updated over the coming day or so. These will still be anonymised, and the winners will be revealed at the workshop
VoxSRC organisers
Posted by: YASA @ Sept. 2, 2021, 1:22 p.m.As an update, the track 4 leaderboard is correctly sorted now.
VoxSRC organisers
Hi, I'm also facing the same issue
Posted by: oopsbbada @ Sept. 2, 2021, 4:02 p.m.Hi oopsbbada,
Your score has been updated to reflect your best submission. Let me know if something still looks wrong to you.
The VoxSRC Organisers
Posted by: YASA @ Sept. 2, 2021, 4:08 p.m.