All my submissions are failing with the error below. As far as I can see my score file is in the correct format and has the correct filename. I even tried truncating the scores to 3 digits as in the example file. I tried zip, gzip with and without compression, but cannot see anything wrong. Could the organizers please check whether the submission system is working correctly?
WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
Traceback (most recent call last):
File "/tmp/codalab/tmpO332Ke/run/program/evaluate.py", line 56, in
raise e
ValueError: could not convert string to float:
Executing DCF: ['python', '/tmp/codalab/tmpO332Ke/run/program/compute_min_dcf.py', '--p-target', '0.05', '--c-miss', '1', '--c-fa', '1', '/tmp/codalab/tmpO332Ke/run/input/res/scores.txt', '/tmp/codalab/tmpO332Ke/run/input/ref/trials.txt']
Output:
Err: /tmp/codalab/tmpO332Ke/run/program/compute_min_dcf.py --p-target 0.05 --c-miss 1 --c-fa 1 /tmp/codalab/tmpO332Ke/run/input/res/scores.txt /tmp/codalab/tmpO332Ke/run/input/ref/trials.txt
Traceback (most recent call last):
File "/tmp/codalab/tmpO332Ke/run/program/compute_min_dcf.py", line 136, in <module>
main()
File "/tmp/codalab/tmpO332Ke/run/program/compute_min_dcf.py", line 126, in main
+ " " + args.scores_filename)
Exception: Missing entry for id10912/H5qe-mHhOyQ/00007.wav and id10912/nDpaVYtKQUo/00004.wav /tmp/codalab/tmpO332Ke/run/input/res/scores.txt
Dear participant "phonexia",
Thank you for your participation on this workshop.
We've checked your submission and it seems that you submitted the scores of validation pairs, not the test pairs.
Please submit the scores of workshop test pairs (Download "Test pairs" in https://www.robots.ox.ac.uk/~vgg/data/voxceleb/competition2021.html#data).
The VoxSRC organisers
Posted by: vgg_oxford @ Aug. 20, 2021, 5:07 p.m.