Dear organizers,
I have tried to adapt the script you provided for train/val data for the test data and I have encountered a few problems.
After this call: zip -FF TEST.zip --out TEST1.zip, I get the following errors:
Fix archive (-FF) - salvage what can
Found end record (EOCDR) - says expect single disk archive
Scanning for entries...
copying: TEST/023596.jpg (70763 bytes)
copying: TEST/023603.jpg (73271 bytes)
copying: TEST/023607.jpg (33126 bytes)
copying: TEST/023611.jpg (59561 bytes)
copying: TEST/023612.jpg (68820 bytes)
(...)
copying: TEST/028702.jpg (62315 bytes)
copying: TEST/028703.jpg (45611 bytes)
copying: TEST/028705.jpg (46785 bytes)
Central Directory found...
EOCDR found ( 1 93392307)...
copying: TEST/000004.jpg (34994 bytes)
Entry after central directory found ( 1 93392329)...
copying: TEST/000012.jpg (55288 bytes)
copying: TEST/000013.jpg (67019 bytes)
copying: TEST/000014.jpg (52908 bytes)
copying: TEST/000015.jpg (45245 bytes)
(...)
copying: TEST/011636.jpg (54237 bytes)
copying: TEST/011639.jpg (38288 bytes)
copying: TEST/011643.jpg (67286 bytes)
Central Directory found...
EOCDR found ( 1 303172298)...
copying: TEST/011645.jpg (45551 bytes)
Entry after central directory found ( 1 303172320)...
copying: TEST/011649.jpg (47100 bytes)
copying: TEST/011650.jpg (42853 bytes)
copying: TEST/011651.jpg (78017 bytes)
copying: TEST/011655.jpg (57752 bytes)
(...)
copying: TEST/021220.jpg (62771 bytes)
copying: TEST/021222.jpg (44782 bytes)
copying: TEST/021223.jpg (51428 bytes)
copying: TEST/021224.jpg fcopy: write error
zip warning: no end of stream entry found: TEST/021224.jpg
zip warning: rewinding and scanning for later entries
zip warning: unexpected signature 50 4b 07 08 on disk 0 at 473535020
zip warning: skipping this signature...
copying: TEST/021225.jpg
zip warning: no end of stream entry found: TEST/021225.jpg
zip warning: rewinding and scanning for later entries
Archive: ../dataset/TEST.zip
warning [../dataset/TEST.zip]: 303065440 extra bytes at beginning or within zipfile
(attempting to process anyway)
file #1: bad zipfile offset (local header sig): 303065440
(attempting to re-compensate)
TEST/011645.jpg: mismatching "local" filename (TEST/023596.jpg),
continuing with "central" filename version
My hypothesis is that when I ran the cat ../dataset/TEST/*.zip, the first file to concatenate is TEST3, then TEST1 and finally TEST2.
Later, in the last instruction: unzip ../dataset/TEST.zip -d ../dataset/, I get many errors:
[../dataset/TEST.zip] TEST/011645.jpg password:
inflating: ../dataset/TEST/011645.jpg
error: invalid compressed data to inflate
file #2: bad zipfile offset (local header sig): 45640
(attempting to re-compensate)
file #2: bad zipfile offset (local header sig): 45640
file #3: bad zipfile offset (local header sig): 303158269
file #4: bad zipfile offset (local header sig): 303201211
file #5: bad zipfile offset (local header sig): 303279317
file #6: bad zipfile offset (local header sig): 303337158
file #7: bad zipfile offset (local header sig): 303411463
(...)
file #2902: bad zipfile offset (local header sig): 474028796
file #2903: bad zipfile offset (local header sig): 474117262
file #2904: bad zipfile offset (local header sig): 474163923
file #2905: bad zipfile offset (local header sig): 474196654
inflating: ../dataset/TEST/021267.jpg
inflating: ../dataset/TEST/021269.jpg
inflating: ../dataset/TEST/021272.jpg
inflating: ../dataset/TEST/021277.jpg
inflating: ../dataset/TEST/021278.jpg
inflating: ../dataset/TEST/021282.jpg
inflating: ../dataset/TEST/023592.jpg
inflating: ../dataset/TEST/023593.jpg
inflating: ../dataset/TEST/023595.jpg
So as I result I only get the following data in TEST:
xgiro@nx1:/projects/retrieval/chalearn15-iccv>> ls -lsa dataset/TEST | wc -l
651
Could you please double check the files and provide an appropriate script ?
Thanks,
Xavi
Posted by: xavigiro @ Sept. 9, 2015, 7:49 a.m.Dear Xavi,
Now is available a script to unzip and join the test set.
You can download the script here: https://www.codalab.org/my/datasets/download/ca9021d5-84ea-4ffa-942b-9b53706f131c
Best regards,
Junior,
Posted by: jfabianarteaga @ Sept. 9, 2015, 2:28 p.m.