I kept the validation image names unchanged.
However, I meet the errors below:
WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
Traceback (most recent call last):
File "/tmp/codalab/tmpUGFRZN/run/program/evaluation.py", line 95, in
raise Exception('Expected %d .png images'%len(ref_pngs))
Exception: Expected 96 .png images
Please note that the submitted zip archive should not use folder or subfolders, just place directly in the root of the zip archive the files. Besides, make sure the file only contains .png frames without any other files like readme.txt.
P.S. On the online server we cannot use all the image results due to the submission file size constraints. Therefore, for online Codalab system we are inviting the participants to submit your results on our released sample validation data which is with uniform sampling each 20th frame.