Dear DFGC participants,
The third phase has begun. You can now submit your Deepfake creation results to the competition website. Please note that the valid submission slot of the third phase is from now to Mar. 27, 24:00. When you click the “Submit” button, you may need to wait for seconds or minutes before the submission is fully uploaded, depending on your network speed and submission size. After submission, the status “submitted” indicate that your submission is completed and waiting for evaluation, and the status “running” indicates that your submission is being evaluated on our server. If everything goes fine, your best result will be shown on the Leaderboard (if not, please manually submit you best score to LB). Also note that the “detailed results” in the LB is not working for now due to some bug of Codalab platform. However, you can still view your own detailed results by “Download output from scoring step” in your submission transaction and see the “scores.txt”. Also, please team up if you work as a team.
Please follow our requirements for submission file structure detailed in the starterkit.
We post the detailed results from the last detection phase for your reference.
Your creation submissions in this phase will be evaluated against the 12 detection methods in the above table (where we have merged some identical methods) to obtain the average anti-detection score. Note that beginning at this phase, we added another “Noise_score” term in the evaluation metric of creation results. It penalizes noisy deepfake images. This is to encourage submissions of results using new deepfake methods, and we put more weight on the image quality. Participants are encouraged consider more diverse new deepfake methods instead of simply post-processing existing images.
Two creation submissions from the 1st phase have the following detailed results in this phase: