> Doubt on Evaluation

1. Can we submit more than one evaluation? , and will the latest one be considered.
2. This is just a request, Can the evaluation score of one who makes a submission be made visible for him alone?

Posted by: hariharanrl @ May 29, 2020, 2:51 p.m.

Hello,

The evaluation board is full blind, you cannot see your scores while submitting,
Still you can make multiple submissions if you have many systems to predict from, we will keep your highest scores amongst all submissions.
Your rank on the evaluation leaderboard will be your highest scores, depending on the following priority rule (for tasks 1 and 2):
F1 score, precision, recall, exact match.
We advise you add a Description to each submission in order to keep track of your best system when results are made public on 1rst of July,

I hope this helps,

Best

Posted by: YseopLab @ May 29, 2020, 6:52 p.m.

Thanks a lot for the info !!

Posted by: hariharanrl @ May 30, 2020, 3:35 a.m.
Post in this thread