Fighting the COVID-19 Infodemic (English)

Organized by hmubarak - Current server time: Oct. 23, 2020, 10:24 p.m. UTC

First phase

Development phase
Sept. 20, 2020, midnight UTC

End

Competition Ends
Oct. 15, 2020, 8:26 p.m. UTC
Fighting the COVID-19 Infodemic:
Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Society.
 
The purpose of this task is to classify tweets that are posted on Twitter about Covid19 all over the world.
 
Detailed annotation instructions with example tweets can be found here: https://micromappers.qcri.org/project/covid19-tweet-labelling/tutorial

Paper: https://arxiv.org/abs/2005.00033 

Training and development data sets can be downloaded from: http://alt.qcri.org/resources/tanbih/covid19/hackathon/hackathon_clarin_data.zip

Note: developement data set has no labels.

More detail about the dataset and baseline scorer are available in https://github.com/sshaar/CLARIN-Hackathon-2020-Fighting-the-COVID19-Infodemic 

There is also a similar task for Arabic, please check here: https://competitions.codalab.org/competitions/26467

 

Data Preparation

The training file consist of 9 columns as follows:

  • tweet no: an index mapping tweet id

  • tweet_text: corresponds to the original text of a given tweet as downloaded from Twitter

  • Q1_label to Q7_label: corresponds to the label for question 1 to 7

 For some questions there will be a label with “nan”. For the experiment with a particular question, entries with the label “nan” have to be removed.

 

Classification Experiments:

The class labels consist of “yes” and “no”, therefore, the model will be trained with binary labels, which will also predict binary labels for each question.

Evaluation Criteria

Classification systems will be evaluated using the average of macro-averaged F1-scores for Questions 1 to 7.

Terms and Conditions

Terms of Use are available at: https://crisisnlp.qcri.org/terms-of-use.html

Development phase

Start: Sept. 20, 2020, midnight

Test phase

Start: Oct. 14, 2020, midnight

Competition Ends

Oct. 15, 2020, 8:26 p.m.

You must be logged in to participate in competitions.

Sign In