1. "the maximum number of submissions per participant at the test stage will be set to 3." It means only 3 times every day or totally 3 times during test phase?
2. During the test phase, can the validation data participate in the training of models?
Dear participant,
thanks for your question.
1) We decided to set the maximum number of submissions at the test phase to 3 to prevent participants to improve their results on the final phase by try and error. They can make the 3 submissions during the whole test period or using them all in one single day, as they prefer. In practice, participants should be able to take their best model and make 1 single submission on the test set.
2) yes, when the test phase starts, validation labels will be released so that you can increase your train data and fine tune your model.
Best
> yes, when the test phase starts, validation labels will be released so that you can increase your train data and fine tune your model.
With "increase your train data", do you mean that we are then allowed to train on the validation set, or that we can increase our training set to include our custom development set? Just to be sure.
Posted by: m-decoster @ Jan. 26, 2021, 9:07 a.m.Dear participant,
when validation labels are released, you can do whatever you want with them. For example, you can add 50% of validation set as training and keep other 50% as validation. Or you can add 100% as training and have no validation set. Just take into account that everything should be somehow documented so that the organizers are able to reproduce the results at the code verification stage. I hope this answers your question.
Best