For the final submission, I want to know how to evaluate the result from the final three submissions, i.e., choose the best ndcg result of the three submissions or the average?
Posted by: minerva @ Sept. 25, 2016, 11:43 a.m.We will use the last submitted result (the one on the leaderboard). For example, if you try 2 different attempts in Phase 2 --- A and B, and A is better than B, then you should resubmit A as the third attempt. Otherwise, B will be used to pick the winner.
Posted by: spirinus @ Oct. 3, 2016, 1:55 a.m.