Multimodal (Audio, Facial and Gesture) based Emotion Recognition Challenge

Organized by dam - Current server time: Aug. 25, 2019, 3:36 p.m. UTC

Previous

Learning
Feb. 16, 2019, midnight UTC

Current

Final Evaluation
July 30, 2019, midnight UTC

End

Competition Ends
Aug. 30, 2019, 11 p.m. UTC

People express emotions through different modalities. Integration of verbal and non-verbal communication channels creates a system in which the message is easier to understand. Expanding the focus to several expression forms can facilitate research one motion recognition as well as human-machine interaction. In this competition, the authors present a Polish emotional database composed of three modalities: facial expressions, body movement and gestures, and speech. The corpora contains recordings registered in studio conditions, acted out by 16 professional actors (8 male and 8 female). The data is labeled with six basic emotions categories, according to Ekman’s emotion categories.

The participants will have to analyze all 3 modalities and, based on all 3 modalities, perform the emotion recognition. The participants must submit the code and all dependencies via codalab and the organizer will run the codes. The evaluation would be based on the average correct emotion recognition using each modalities as well as all 3 modalities together. In case of equal performance, the processing time will be used in order to indicate the ranking. The Training data will be provided followed by the validation dataset. The test data will be finally launched with no label and it will be used for the evaluation of participants.

The participants have to analyze all the three modalities and based on all 3 modalities perform the emotion recognition. The participants must submit the code and all dependencies via CODLAB and the organizer will run the codes.

The evaluation would be based on the average correct emotion recognition using each modalities as well as all 3 modalities together. 

In case of equal performance, the processing time will be used in order to indicate the ranking. The Training data will be provided followed by the validation dataset. The test data will be finally launched with no label and it will be used for the evaluation of participants. 

In addition the participants will be provided by a FactSheet template that they should fill and submit it along with their codes, and it will be also used for evaluation.

Evaluation Criteria

The percentage of correctly classified samples will be calculated for each emotion class and the average of calculated percentages will be taken as final performance rate.

Submission format

In this track, the participants should submit a ZIP file containing only one pkl file. 

Participants should submit a ZIP file containing only one pkl file named exactly as required below (without any subfolders in the ZIP file). 

The predictions for validation and test sets should be submitted in pkl dictionary with following format:

{DESCTIPTOR_FILE_NAME.txt : PREDICTED_EMOTION_CLASS, ... }, where:

DESCTIPTOR_FILE_NAME - should be the same, as the desctiptor file name containing the predcted emotional state
The name of the prediction text file should be valid_prediction.pkl for the validtaion set (phase 2), test_prediction.pkl for the test set (phase 3)

PREDICTED_EMOTION_CLASS - should have only the following values: An, Di, Fe, Ha, Ne, Sa, Su

Examples:

- for phase 2: {frames_F2_An3 : Sa, ...} 
- for phase 3: {frames_TEST1 : An, ...}

About PKL 

A PKL file is a file created by pickle, a Python module that enables objects to be serialized to files on disk and deserialized back into the program at runtime. It contains a byte stream that represents the objects.

Please, keep in mind, that Codalab uses Python 2.7 by default. In case you serialized dictionary with predictions in Python3, add 'protocol=2' to the arguments.

Start

Start: Feb. 15, 2019, 11:47 p.m.

Learning

Start: Feb. 16, 2019, midnight

Description: Learning

Final Evaluation

Start: July 30, 2019, midnight

Description: Final Evaluation

Competition Ends

Aug. 30, 2019, 11 p.m.

You must be logged in to participate in competitions.

Sign In