We notice the validation server automatically re-evaluates our prior submissions.
The issue raised here is that these automatic re submissions are also counted in our current submission time.
We can see in leaderboard, the user FayezLahoud has submitted 35 entries in total for evaluation, which surpasses the max submission time of validation server (i.e. 20).
Any one has at least 10 (but less than 20) prior entries in current state, cannot submit any results even it was feasible before re-evaluation.
So I was wondering whether we can make the submission time backtracking to the state before re-evaluation such that we have equal max submit time of validation server for each competitor.
Hi there,
Since I updated MRAE is the scoring program (substituting 1e-3 with 1), I reran all submissions instead.
I will soon make available the updated the scoring program.
I will increase the number of allowable submission.
Posted by: mehrdad.shoeiby @ Aug. 2, 2018, 11:32 p.m.