For fair comparison, the masks of validation data might be fixed. If the masks are generated randomly, the development leaderboard cannot show the meaningful information.
Posted by: zheng222 @ May 19, 2020, 3:44 a.m.You are right. Along with the validation set, specific fixed masks for each image are provided.
Posted by: vglsd @ May 21, 2020, 4:41 p.m.