> Problem submitting output to the leaderboard

Hi all,

is there any trick involved in submitting the output of the classifier to the leaderboard?
I've just zipped and uploaded the file which has the same format as "roc_answer_test.txt", i.e.

InputStoryid,AnswerRightEnding
b929f263-1dcd-4a0b-b267-5d5ff2fe65bb,1
7cbbc0af-bcce-4f56-871d-963f9bb6a99d,1
....

However, it does not seem to show up in the results list...

Thanks!

N

Posted by: Niko @ Dec. 21, 2016, 9:40 a.m.

I am facing exactly the same problem - my format matches the sample submission's one, and yet is not being scored. What could I be missing here?
Please help. Thanks!

Posted by: Pranav_Goel @ Dec. 27, 2016, 4:18 p.m.

Ok, it turns out for the file to be properly submitted,
- Windows line feeds should be used
- the file should end in an empty line (so 1873 lines in total for val and test, respectively)
- using the same file names (answer.txt -> zip -> dssm.zip) won't hurt. (but is probably not necessary).

Posted by: Niko @ Dec. 29, 2016, 8:55 p.m.

Thank you.

Posted by: Pranav_Goel @ Dec. 30, 2016, 3:53 a.m.

Thanks for the tips. I still can't get it to work after numerous attempts. I added the extra line at the end, and tried using \n, \r, and \r\n as line breaks. Also tried renaming the files to answers.txt and dssm.zip. Can someone using MacOS/Linux tell me what specific steps they used to prepare the file? Thanks!

Posted by: roemmele @ Jan. 25, 2017, 11:02 p.m.

The filename answer.txt DOES matter after all.

Posted by: roemmele @ Jan. 26, 2017, 12:26 a.m.
Post in this thread