Are the labels for the dev dataset going to be released?
Posted by: fdabek @ Jan. 11, 2021, 3 p.m.Hi,
The dev labels will be released ASAP, I'm having an issue with hosting, but they should be posted in the next day, and I'll message all participants then. Thanks for your patience!
Posted by: jam @ Jan. 11, 2021, 10:31 p.m.The labels are now available here: http://homepages.inf.ed.ac.uk/s1573290/dev.csv
Posted by: jam @ Jan. 11, 2021, 11:06 p.m.I posted this question to the wrong thread! So this is a repeat...but can the scoring program be made available? Having the dev labels is great although we don't have a way to score results relative to those.
Posted by: tpederse @ Jan. 12, 2021, 1:08 a.m.I'm afraid we won't be releasing the scoring program, and this is not standard. You get your score by submitting your system to the codalab page.
All the best
Posted by: jam @ Jan. 12, 2021, 9:40 a.m.