Constraint@AAAI2021 - COVID19 Fake News Detection in English

Organized by parthpatwa - Current server time: Oct. 23, 2020, 10:26 p.m. UTC

Current

Validation Phase
Oct. 1, 2020, midnight UTC

Next

Test Phase
Dec. 1, 2020, midnight UTC

End

Competition Ends
Never

COSTRAINT- First Workshop on ​Combating On​line Ho​st​ile Posts in ​Regional L​anguages dur​ing Emerge​ncy Si​tuation

Collocated with AAAI 2021

website https://constraint-shared-task-2021.github.io/

 

Overview

COVID19 Fake News Detection in English - This subtask focuses on the detection of COVID19-related fake news in English. The sources of data are various social-media platforms such as Twitter, Facebook, Instagram, etc. Given a social media post, the objective of the shared task is to classify it into either fake or real news. For example, the following two posts belong to fake and real categories, respectively. 

If you take Crocin thrice a day you are safe. Fake
Wearing mask can protect you from the virus. Real

 

For the Hindi task: https://competitions.codalab.org/competitions/26654

Evaluation

Official Competition Metric: We will use F1 averaged across the classes (fake , real). The final ranking would be based on the weighted average F1 score.
However will release recall, precision, accuracy also.

Each participating team will initially have access to the training data and validation data only. Later, the unlabeled test data will be released.

Terms & Conditions

By submitting results to this competition, you consent to the public release of your scores at the constraint workshop and in the associated proceedings, at the task organizers' discretion. Scores may include but are not limited to, automatic and manual quantitative judgments, qualitative judgments, and such other metrics as the task organizers see fit. You accept that the ultimate decision of metric choice and score value is that of the task organizers.

You further agree that the task organizers are under no obligation to release scores and that scores may be withheld if it is the task organizers' judgment that the submission was incomplete, erroneous, deceptive, or violated the letter or spirit of the competition's rules. Inclusion of a submission's scores is not an endorsement of a team or individual's submission, system, or science.

You further agree that your system may be named according to the team name provided at the time of submission, or to a suitable shorthand as determined by the task organizers.

By downloading the data or by accessing it any manner, You agree not to redistribute the data except for the purpose of non-commercial and academic-research. The data must not be used for providing surveillance, analyses or research that isolates a group of individuals or any single individual for any unlawful or discriminatory purpose.

For any queries contact us on:

 tanmoy@iiitd.ac.in 

parthprasad.p17@iiits.in

Important Dates:

  • October 1, 2020: Release of the training set
  • December 1, 2020: Release of the test set
  • December 10, 2020: Deadline for submitting the final results
  • December 12, 2020: Announcement of the results
  • December 30, 2020: System paper submission deadline (All teams are invited to submit a paper)
Dr. Tanmoy Chakraborty
Indraprastha Institute of Information Technology Delhi, India

Md. Shad Akhtar
Indraprastha Institute of Information Technology Delhi, India

Dr. Asif Ekbal
IIT Patna, India

Dr. Amitava Das
Wipro Research, Bangalore, India

Parth Patwa
Indian Institute of Information Technology Sri City, India

Mohit Bhardwaj
Indraprastha Institute of Information Technology Delhi, India

Srinivas PYKL
Indian Institute of Information Technology Sri City, India

Shivam Sharma
Wipro Research, Bangalore, India

Vineeth Gupta
Wipro Research, Bangalore, India

Gitanjali Kumari
IIT Patna, India

Submit the data in a .zip file. The zip file should have a single file named 'answer.txt'. The 'answer.txt' The file should have 2 columns named id and label, where ud is the unique id of the tweet. Ensure that there is no empty blank line at the end of the file. 

example:

id,label

1,fake

2,real

 

Important Details:

1. User can see the precision, recall and F-score in output score file.

2. F-score is leaderboard parameter.

3. The text file you are submitting should be named as "answer.txt"

4. The submission file should be .zip file

Validation Phase

Start: Oct. 1, 2020, midnight

Test Phase

Start: Dec. 1, 2020, midnight

Post Test Phase

Start: Dec. 11, 2020, midnight

Competition Ends

Never

You must be logged in to participate in competitions.

Sign In
# Username Score
1 Shifath472533 1.00
2 brianmcdermott 1.00
3 parthpatwa 0.98