We want to point out that MAFAT Radar Challenge competition has two stages:
In Stage 1 participants are asked to train their models on the training set and submit their results, predicting the labels of the public test set. At the end of stage 1 we will release the labels of the public test set and we will release a new, unseen and unlabeled, private test set.
In Stage 2 participants are allowed to re-train their models on the combined training set (including the original training set from stage 1 and the labeled public test set). During stage 2, participants are required to submit up to 2 submissions for final judging, giving the prediction of the segments in the private test set.
Moving from stage 1 to stage 2, participants will not be required to upload their models.
Please feel free to raise any issues regarding the two stage format of the competition in this thread.Posted by: Mafat_Challenge @ July 13, 2020, 4:29 p.m.
Hi, am I accurately understanding, in the second stage we are not given any feedback on the Public leaderboard - Or rather, the feedback we receive is based on the Stage 1 test set?Posted by: maxim @ Aug. 24, 2020, 9:16 a.m.
You will have the labeled public set for your use. There is no leaderboard in the second stage. In the second stage, you will have 2 final submissions - the private leaderboard will be available only after the competition ends.
(MAFAT Challenge Team)