In the development phase, we submitted only the frames whose prefix can be mod by 10.
It's also wrote in "learn the details-evaluation".
But I noticed that in the e-mail it said that we should submit all the frames.
Would the final metric be different of testing phase from development phase? Mean PSNR of all frames or mean PSNR of mod10 frames?
The target of the challenge is to establish the enhancement benchmark, so the developed methods are expected to enhance all video frames, not only optimize/over-fit the mod 10 frames. Using every 10th frame in Codalab is just because of the memory limitation. Therefore, try to enhance all frames as well as possible.
Posted by: RenYang @ March 15, 2021, 9:11 a.m.