NTIRE 2021 Perceptual Image Quality Assessment Challenge Forum

Go back to competition Back to thread list Post in this thread

> Hi, organizers!

Hi, organizers.
I have a question.
You asked us to give information about whether the model is full-reference or not in "readme.txt".
But, where can I find that information. In the result tab, there is no field for that.
Are you planning to inform us of that (full-reference)?
thank you

Posted by: yoon28 @ Jan. 25, 2021, 8:54 a.m.

Hi,

At the first time, the readme file does not include the Full-Reference field. Later, we recognize that this may be valuable information, so we add this to the submission requirements.

However, the codalab leaderboard is a little bit difficult to change (the label).

As you can see, the ``Runtime per image [s]'' is actually ``FR[1] /NR[0]''. The name of this column is not successfully changed yet.

Hope my answer can help~

Jinjin Gu

Posted by: JinjinGu @ Jan. 25, 2021, 9:50 a.m.

Thank you for replying to me.
Then what does -1 mean for the runtime column?

Posted by: yoon28 @ Jan. 27, 2021, 6:40 a.m.

Hi,

``-1'' means can not parse this field correctly form the submission. Maybe the wrong keys or not fill this field.

Posted by: JinjinGu @ Jan. 28, 2021, 9:23 a.m.

Thank you!

Posted by: yoon28 @ Jan. 28, 2021, 2 p.m.
Post in this thread