NTIRE 2021 Perceptual Image Quality Assessment Challenge Forum

Go back to competition Back to thread list Post in this thread

> Error when submitting test score

When I submit a score in validation phase, it does not show any error.
However, when I tried to submit a score for the test data, it shows an error like below

WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
Traceback (most recent call last):
File "/tmp/codalab/tmpxKuKFH/run/program/evaluate.py", line 71, in
raise NotImplementedError("Check Alignment")
NotImplementedError: Check Alignment

By the FAQ, It seems that the order of distorted images in the "output.txt" is inaccurate.
For example, my "output.txt" is saved as below. Is the order of my file right?
(the file starts from A0000_10_00.bmp)
A0000_10_00.bmp,0.xxxxxxx
A0000_10_01.bmp,0.xxxxxxx
A0000_10_02.bmp,0.xxxxxxx
A0000_10_04.bmp,0.xxxxxxx
A0000_10_05.bmp,0.xxxxxxx
A0000_10_06.bmp,0.xxxxxxx
...

Posted by: SIA @ March 16, 2021, 1:42 a.m.

Hi,

I had the same problem with me. Can you fix this problem?

Posted by: rmc @ March 16, 2021, 6:15 a.m.

We have fixed the issue with the server. You would submit the file successfully if your format is correct.
Before this post, for those submissions with "Check Alignment" error, we have re-run them. You can find your file shown "Finished" in your console if your submission file has the right format.

Posted by: haomingcai @ March 16, 2021, 6:52 a.m.
Post in this thread