Forums

> When the algorighm evaluation pipeline will work?

We worry about that no success submission until the ddl.

Posted by: dingzixiang @ May 22, 2021, 5:07 a.m.

---

Hi dingzixiang,

The evaluation pipeline is working. Your submissions are failing due to a shape incompatibility on dataset 2. Please check the ingestion error logs of your submissions for more information. Specifically, ensure that your submissions work on data of the following shapes:

Dataset 0: 64x3x28x28, 10 class classification
Dataset 1: 64x3x64x64, 4 class classification
Dataset 2: 64x1x27x18, 6 class classification

Thanks,
Rob

Posted by: robgeada @ May 22, 2021, 6:40 a.m.

---

Once you have made sure your submission works for these data shapes, you can replace one of your existing submissions in the queue https://docs.google.com/spreadsheets/d/17uKFjlQqJfgk92Prz3qqU2TKKfse3CSNfwRrfF6TWU4/edit#gid=0 with the fixed one. Email me at rob@geada.net to make that request if you'd like.

Thanks,
Rob

Posted by: robgeada @ May 22, 2021, 6:43 a.m.

---

Thanks, we have replaced a submission that works for the dataset2 with size 27x18.

Posted by: dingzixiang @ May 22, 2021, 9:10 a.m.

---

Excellent, I'll run 3_1_5_16_03.zip the next time it's your turn in the queue.

Thanks!
Rob

Posted by: robgeada @ May 22, 2021, 9:49 a.m.

---

Thanks!

Posted by: dingzixiang @ May 22, 2021, 12:54 p.m.

---

Hi, Rob:
I am very sorry that a fatal bug was found in the submission named 3_1_5_16_03.zip. A new submission named 3-1-5-16-03.zip has been resubmitted.
Thansk,
Ding

Posted by: dingzixiang @ May 22, 2021, 1:24 p.m.

---

Hi, Rob:
I am very sorry that a fatal bug was found in the submission named 3_1_5_16_03.zip. A new submission named 3-1-5-16-03.zip has been resubmitted.
Thansk,
Ding

Posted by: dingzixiang @ May 22, 2021, 1:24 p.m.

---

Replace it please, thanks!

Posted by: dingzixiang @ May 22, 2021, 1:25 p.m.

---

Okay, will do.

Posted by: robgeada @ May 22, 2021, 1:25 p.m.