AIM 2020 Real Image Super-Resolution Challenge - Track 3 Upscaling x4 Forum

Go back to competition Back to thread list Post in this thread

> evaluation/ranking

Hi, I find use this equation (detail->evaluation) to evaluation: 0.5*PSNR_avg/50+0.5*(SSIM_avg-0.4)/0.6;
But current development results, the #1's PSNR and SSIM not highest, Dose it need consider other rule?
Thanks.

Posted by: egg126 @ June 4, 2020, 6:29 a.m.

The validation server is providing feedback on your submitted results.
The default ranking on the validation leaderboard has nothing to do with the ranking in this challenge.
If you want to get the ranking according to PSNR then check the PSNR column of results and sort.
If you want to get the ranking according to SSIM then check the SSIM column of results and sort.

Unfortunately, we did not report the PSNR and SSIM combined score, but it is a simple linear combination you can do yourself.

Note that the final ranking on the test data will employ the criteria described in the "Learn the details -> Evaluation" tab of the competition:
0.5*PSNR_avg/50+0.5*(SSIM_avg-0.4)/0.6

Posted by: Radu @ June 4, 2020, 7:56 a.m.

Is it possible to display SSIM with 4 decimal points for better reference? Thanks

Posted by: zhihongp @ June 7, 2020, 9:54 p.m.
Post in this thread