AutoML3 :: AutoML for Lifelong Machine Learning Forum

Go back to competition Back to thread list Post in this thread

> If you perform training verification locally, there is no input_data\(AA/B/C/D/E)\test_(5/6/7/8/9).solution file locally, so how does there AUC result get?


Posted by: lhg1992 @ Aug. 11, 2018, 5:57 a.m.


You can download the input data from the files section. There you have data an labels for 1 training batch and 4 test batches. To run the code locally with this data you just have to copy the whole input data into the AutoML3_sample_data folder, and some other files into the AutoML_sample_ref folder (look at what info. is there for ada and rl for guidance).


Posted by: hugo.jair @ Aug. 11, 2018, 1:03 p.m.

That is to say, if you run it locally, test5/6/7/8/9 is not used. Why is there no test5/6/7/8/9.solution file in the sample file? Is the test result running locally only 1/2/3/4?

Posted by: lhg1992 @ Aug. 16, 2018, 12:04 p.m.


Yes, you can locally evaluate the performance of your models on the first 4 test batches, for the rest, the feedback will be given by the leaderboard. Please note that for the final phase you will only have access to the training batch.


Posted by: hugo.jair @ Aug. 16, 2018, 12:43 p.m.

Hi Hugo,

What do you mean by "for the final phase you will only have access to the training batch."? My understanding is the final phase is a complete blackbox that we won't get *any* data?


Posted by: xiayunsun @ Aug. 16, 2018, 1:36 p.m.
Post in this thread