Dear participants,
We'd like to inform you that we recently updated the video list of Kinetics-GEBD. As a summary:
1. The new version removes 943 Test Set videos that we found to be overlapped/duplicated with our Train Set. Note this is just a small portion of our Test Set (5.5%)
2. For some videos like ‘NQcK4qPOqtg’ - its total duration is 207s long but the trimmed clip position provided by the original Kinetics dataset is from 232s to 242s. We remove all such problematic Kinetics videos (4 in Train, 2 in Val, 2 in Test)
Finally note that it is all right if you include the detection results of these videos in your submission file since we will ignore them for evaluation. But you may want to remove these videos too in order to save computation.
Thank you.
Posted by: leiwx52 @ April 29, 2021, 6:52 a.m.There are still some videos that are not available ("K21Qbx47rG4") or cannot be found in the original Kinetics400 dataset ("GYBTyanF0Do"), making it impossible to obtain the start/end time for trimming.
What do we do with those?
Thank you!
Posted by: grodriguez @ April 30, 2021, 12:08 p.m.These should be in the Train/Val split. Note that this is a small portion in the whole Train/Val set, thus it's fine to ignore such videos. For the Test Set, we've verified that all the videos are available as of March, 2021.
Posted by: leiwx52 @ April 30, 2021, 12:50 p.m.>For the Test Set, we've verified that all the videos are available as of March, 2021.
The videos that I mentioned before are taken from the GEBD Test Set (the version 2 you uploaded recently). Unfortunately, some seem to be unavailable (K21Qbx47rG4, NICOETObwKk, 1YJtARymcnI ...) and others cannot be found in the original Kinetics400 in order to obtain the timestamps (GYBTyanF0Do, o1LoBnrbb04, ZhxYxkLfFRc ...). Could you please take a look at this? Sorry for the inconvenience.
For the unavailable videos, this happens for other competitions too, we will keep these videos for evaluation since the small percentage will not affect the result significantly; we will do a sanity check after the due date to test all teams' results w/ and w/o these newly unavailable videos to ensure there is no major difference, otherwise we will rely on the results only on the available videos. Please go on with those available currently.
For those cannot be found in the original Kinetics400, I've checked the kinetics400_train.csv(note that Kinetics-GEBD Test is from original Kinetics400 Train split) released before, the videos you mentioned (GYBTyanF0Do, o1LoBnrbb04, ZhxYxkLfFRc) actually exist. Could you pls confirm this again? Otherwise you can email me (leiwx52@gmail.com) for the original kinetics400 train annotation.
Thanks
Posted by: leiwx52 @ May 1, 2021, 2:42 a.m.