ChaLearn Looking at People - Job Candidate Screening Coopetition Forum

Go back to competition Back to thread list Post in this thread

> More explanation for explanability challenge?

The second stage (qualitative) is the first of its kind and I still do not understand i) what to do ii) and what to submit.
The provided bundle for the second stage has some binary information in addition to some textual explanations. What does it encode?Could you please give more explanation to clarify what is asked from competitors for this stage?

Best,

Posted by: heysky @ Feb. 14, 2017, 6:56 p.m.

Dear heysky,

first, we decided to open the qualitative phase tonight (23:59) as we need to fix some problems related to the quantitative competition. My apologies about that. Regarding the qualitative phase, we provide a submission template (http://158.109.8.102/FirstImpressionsV2/submission_bundle.zip) you can use as reference. You will be asked to submit, as described here (http://chalearnlap.cvc.uab.es/challenge/23/track/22/description/), 4 files: metadata.txt (mandatory), prediction.pkl (mandatory), description.pkl (mandatory) and video.mp4 (optional). In the same link you can find information about each file. Please, let us know if you have any doubt.

Best

Posted by: juliojj @ Feb. 16, 2017, 9:16 a.m.

Dear heysky,

What binary information do you mean, where did you see it?

As mentioned by Julio, all the instructions about submission format is at http://chalearnlap.cvc.uab.es/challenge/23/track/22/description/.

For each clip, in addition to the text description, you can optionally submit an image that illustrates and help for interpretability of the model. Thus, it is not a binary information, but a ndarray corresponding to an image.

Best

Posted by: Stephane @ Feb. 16, 2017, 10:56 a.m.

Dear Stephane,

Yes, I mean the encoded image as binary. Now, I understand that it is an optional image (preferred as 355x200 pixels in RGB format). So we can provide "None" as an option.
Could be great if a lightweight description.pkl sample without these images can be provided. So as to see whether our format is fine with textual descriptions.

Best regards,
Heysem

Posted by: heysky @ Feb. 16, 2017, 11:01 a.m.

Hi,

The image should not be necessary encoded as binary, but yes it is an optional requirement, so you can put None.

Please see a sample code to generate a valid submission here: http://158.109.8.102/FirstImpressionsV2/make_sample_description.py

Best

Posted by: Stephane @ Feb. 16, 2017, 1:34 p.m.
Post in this thread