##Competition organizers have chosen to keep the leaderboard private. Please check back later.##
Q：When will the testing leaderboard to be open? It`s important that everything in the competition be fair and open.
Posted by: flyDeeper @ Sept. 1, 2021, 6 a.m.Until the end of the testing competition.
Only competition organizers can see the leaderboard during the testing competition.
""Questions and Suggestions on Keeping the Leaderboard Private""
Dear Sir or Madam
I have some questions and suggestions about keeping the leaderboard private.
Question 1: Keeping the leaderboard private will leave the participants without supervision, how can we ensure the fairness of the competition? Also, what is the point of keeping the leaderboard private and why?
Question 2: How can I ensure that the results file submitted is in the correct format? The test results we submit cannot even be seen by ourselves. How can we ensure that the series of optimizations are performance-enhancing for the Challenege?Isn't this contrary to mining the map cap of the Fineaction dataset?
Suggestion: keep the leaderboard open, and you can make the team names anonymous. The second most important thing is to show the scores of the results you submitted.
“”关于保持排行榜隐私的问题和建议“”
亲爱的先生或女士
我有一些关于保持排行榜隐私的问题，并给出一些建议。
问题1：保持排行榜的私密性，会使参与者缺乏监督，如何保证比赛的公平性？还有，保持排行榜的私密性有什么意义，为什么？
问题2：如何确保提交的结果文件是正确的格式？我们提交的测试结果连自己都无法看见。怎么保证一系列优化措施是对challenge的性能是有提升的？这和挖掘Fineaction数据集的map上限不是相悖的吗？
建议：保持排行榜的开放性，可以将团队名称匿名。最其次也应该显示自己提交结果的得分吧。
Dear flyDeeper and all,
First thanks for participating this challenge. We have to clarify this some points:
1. We have divide the challenge phase into validation and testing phase. Validation phase is for your method development and model tuning. You can get feedback from our leaderboard to improve your method and parameter tuning. After validation phase, testing phase is mainly for testing your method on the whole testing dataset and report the final performance based on your best models discovered in validation phase. This is the difference between validation and testing phase.
2. Dividing the chalenge into validation phase and testing phase and hidding the testing result aims to prevent the participants from over-fitting the testing set. This is a common practice in many challenges such as ImageNet, WebVision, and ActivityNet.
3. Finally, please be noted the process is open and automatcially handled by the codalab platform. Keep the leaderboard hidden will not affect your performance.
Organizer of DeeperAction challenge
Posted by: 07wanglimin @ Sept. 3, 2021, 5:14 a.m.Sincerely suggest the organizers to clarify the operation of different phase in next year's Challenge-Overview.
I'm a TAL direction fresh with no experience in ImageNet & Anet participation. It's heartbreaking and regrettable to spend so much effort to devote to FineAction research...