Go here for more details (an archive of the original website):
|This challenge mimics the NIPS 2003 Feature Selection Challenge: it allows you to make post-challenge submissions on test data to benchmark new methods. The challenge ended on December 12, 2003.
The aim of the challenge in feature selection is to find feature selection algorithms that significantly outperform methods using all features, on ALL five benchmark datasets. To facilitate entering results for all five datasets, all tasks are two-class classification problems. You can download the datasets in the Participate section.
The score is an average of AUC scores of each of the datasets.
Submission in a format of the original contest should consist of 3 x 5 files in a zip archive:
The AUC scores are on the leaderboard, you can view the BER scores and feature statistics of your submission by clicking: 'View scoring output log'
You can also submit just one file .predict instead of .resu and .conf.
Each .predict file should contain in each line the respective confidence that the label is positive.
The BER metric will be also calculated, tresholding at 0.
- General Terms: This challenge is governed by the General ChaLearn Contest Rule Terms, the Codalab Terms and Conditions, and the specific rules set forth.
- Announcements: To receive announcements and be informed of any change in rules, the participants must provide a valid email.
- Conditions of participation: Participation requires complying with the rules of the challenge. Prize eligibility is restricted by US government export regulations, see the General ChaLearn Contest Rule Terms. The organizers, sponsors, their students, close family members (parents, sibling, spouse or children) and household members, as well as any person having had access to the truth values or to any information about the data or the challenge design giving him (or her) an unfair advantage, are excluded from participation. A disqualified person may submit one or several entries in the challenge and request to have them evaluated, provided that they notify the organizers of their conflict of interest. If a disqualified person submits an entry, this entry will not be part of the final ranking and does not qualify for prizes. The participants should be aware that ChaLearn and the organizers reserve the right to evaluate for scientific purposes any entry made in the challenge, whether or not it qualifies for prizes.
This challenge is brought to you by ChaLearn. Contact the organizers.