thanksPosted by: lhg1992 @ Aug. 11, 2018, 5:57 a.m.
You can download the input data from the files section. There you have data an labels for 1 training batch and 4 test batches. To run the code locally with this data you just have to copy the whole input data into the AutoML3_sample_data folder, and some other files into the AutoML_sample_ref folder (look at what info. is there for ada and rl for guidance).
bestPosted by: hugo.jair @ Aug. 11, 2018, 1:03 p.m.
That is to say, if you run it locally, test5/6/7/8/9 is not used. Why is there no test5/6/7/8/9.solution file in the sample file? Is the test result running locally only 1/2/3/4?Posted by: lhg1992 @ Aug. 16, 2018, 12:04 p.m.
Yes, you can locally evaluate the performance of your models on the first 4 test batches, for the rest, the feedback will be given by the leaderboard. Please note that for the final phase you will only have access to the training batch.
BestPosted by: hugo.jair @ Aug. 16, 2018, 12:43 p.m.
What do you mean by "for the final phase you will only have access to the training batch."? My understanding is the final phase is a complete blackbox that we won't get *any* data?
Thanks.Posted by: xiayunsun @ Aug. 16, 2018, 1:36 p.m.