This thread posts frequently asked questions about this challenge and will keep updating.
Posted by: JinjinGu @ Jan. 11, 2021, 7:50 a.m.Q1. Common Error Messages
1. The Order of your distorted images in the output.txt is inaccurate. You can use the sorted() function to obtain correct order, or check the provided demo output.txt.
```
Traceback (most recent call last):
File "/tmp/codalab/tmpgWo8dy/run/program/evaluate.py", line 70, in
raise NotImplementedError("Check Alignment")
NotImplementedError: Check Alignment
```
2. The submitted file lacks images.
```
Traceback (most recent call last):
File "/tmp/codalab/tmpt_Ob16/run/program/evaluate.py", line 64, in
IQA_img, IQA_score = IQA_line.split(',')[0], float(IQA_line.split(',')[1][:-1])
IndexError: list index out of range
```
20 submissions in total are not enough to test many algorithms, can we change this limit?
Posted by: musicbeer @ Jan. 29, 2021, 1:48 a.m.We've changed to 40 the limit.
This should be more than enough for each participant to validate his solution.