NTIRE 2020 Real Image Denoising Challenge - Track 1 - rawRGB Forum

Go back to competition Back to thread list Post in this thread

> How is the ordering of participant resolved on a leaderboard?

Hi,

We have noticed that the participants ordering differs significantly from the reported PSNR and SSIM scores, e.g. - as for now - the first team is on the 6th and 7th place respectively w.r.t. to PSNR and SSIM, whereas there are teams which are better both in PSNR and SSIM measures. Our question is - how the actual leader-board position is computed?

Best,
TCL-TEAM

Posted by: tcl-research-team @ Feb. 17, 2020, 11:47 a.m.

Hi,

Unfortunately, the default order on the validation leaderboard is messed up, and by no means the official ranking of the solutions.

In this challenge the ranking of the solutions is according to the PSNR scores.
Therefore, please check the PSNR scores and rank according to that PSNR column.

Success!

Posted by: Radu @ Feb. 17, 2020, 11:59 a.m.
Post in this thread