MultiCoNER: SemEval-2022 Task 11 (Post Evaluation Phase)

Organized by multiconer_codalab_2022

SemEval-2022 task to develop NER systems for complex entities across 11 languages.

Jan 24, 2022- No end date
256 participants


CODWOE - Comparing Dictionaries and Word Embeddings

Organized by tmickus

SemEval 2022 Task 1 - Are dictionary glosses and word embedding representations semantically equivalent? Can we generate one from the other?

Jan 10, 2022- No end date
201 participants


MultiCoNER: SemEval-2022 Task 11 (Practice Phase)

Organized by multiconer_codalab_2022

SemEval-2022 task to develop NER systems for complex entities across 11 languages.

Oct 27, 2021- No end date
404 participants


SemEval 2022 Task 2

Organized by Harish

Competition Website for SemEval 2022 Task 2 - Multilingual Idiomaticity Detection and Sentence Embedding

Sep 03, 2021- No end date
109 participants


SemEval-2022 Task 7 Identifying Plausible Clarifications of Implicit and Underspecified Phrases

Organized by mistims

SemEval-2022 Shared task on identifying plausible clarifications in WikiHow instructions.

Sep 03, 2021-Jan 31, 2022
72 participants


SemEval-2022 Task 09: R2VQ - Competence-based Multimodal Question Answering

Organized by r2vq

The Recipe Reading and Video Question Answering (R2VQ) task is structured as question answering pairs, querying how well a system ...

Aug 06, 2021- No end date
183 participants


SemEval 2022 Task 8: Multilingual News Article Similarity

Organized by davidjurgens

Consider the following question: Given a pair of news articles, are they covering the same news story? Answering this question ...

Aug 05, 2021- No end date
258 participants


SemEval 2022 Task 4: Patronizing and Condescending Language Detection

Organized by lea

Somebody is patronizing or condescending when their language denotes a superior attitude towards others, talks down to them, or describes ...

Jul 31, 2021- No end date
442 participants


Multimedia Automatic Misogyny Identification (MAMI)

Organized by sorenj

SemEval 2022 Task 5 - identification of misogyny in internet memes.

Jul 30, 2021- No end date
438 participants


SemEval-2022 Task 10: Structured Sentiment competition

Organized by akutuzov

SemEval-2022 Task 10: Structured Sentiment competition

Jul 01, 2021- No end date
290 participants


SemEval Task 9: Statement Verification and Evidence Finding with Tables (SEM-TAB-FACT)

Organized by semtabfacts

Tables are ubiquitous in documents and presentations for conveying important information in a concise manner. This is true in many ...

Nov 01, 2020-Jan 29, 2021
63 participants


SemEval 2021 Task 1 - Lexical Complexity Prediction (LCP)

Organized by ghpaetzold

This is the competition web page of the LCP shared task of SemEval 2021.

Oct 29, 2020- No end date
196 participants


SemEval2021 Task 8 - MeasEval - Counts and Measurements

Organized by chrpr

Extracting Quantities and their Contexts from Scientific Texts.

Oct 01, 2020- No end date
260 participants


SemEval-2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation (MCL-WiC)

Organized by Federico_Martelli

The task aims at determining whether two occurrences of the same word/translation are used with same meaning in two ...

Oct 01, 2020- No end date
192 participants


SemEval-2021 Task 4: Reading Comprehension of Abstract Meaning

Organized by BoyuanZheng

Oct 01, 2020-Jan 31, 2021
260 participants


SemEval 2021 Task 11: NLPContributionGraph

Organized by jdsouza

Structuring the "contributions" information from scholarly articles to facilitate contributions-centered scientific knowledge graph building.

Aug 16, 2020- No end date
139 participants


SemEval-2021 Task 12 - Learning with Disagreements

Organized by alexandraG

A SemEval-2021 shared task on learning to classify with datasets containing disagreements.

Jul 31, 2020- No end date
151 participants


SemEval 2021 Task 5: Toxic Spans Detection

Organized by ipavlopoulos

This task concerns the evaluation of systems that detect the spans that make a text toxic, when detecting such spans ...

Jul 31, 2020-Jan 31, 2021
463 participants


SemEval 2021 Task 10 - Source-Free Domain Adaptation for Semantic Processing

Organized by Egoitz

Given a trained model, distill and transfer the knowledge to a new domain.

Jun 09, 2020- No end date
90 participants


OffensEval 2020 - English - Evaluation Phase

Organized by georgi.karadzhov

This is the competition site for the TEST set of the second edition of OffensEval organized at SemEval 2020 (Task ...

Feb 27, 2020-Mar 30, 2020
210 participants


OffensEval 2020 - English

Organized by georgi.karadzhov

This is the competition site for the development set of the second edition of OffensEval organized at SemEval 2020 (Task ...

Jan 28, 2020- No end date
149 participants


SentiMix Hindi-English

Organized by suraj1ly

Sentiment analysis of code-mixed tweets. SemEval 2020 task 9. Hindi sub task.

Sep 04, 2019- No end date
946 participants


Sentimix Spanglish

Organized by suraj1ly

Sentiment analysis of code-mixed tweets. SemEval 2020 task 9. Spanish sub task.

Sep 04, 2019-Mar 12, 2020
195 participants


SemEval-2020 Task 5: Modelling Causal Reasoning in Language: Detecting Counterfactuals

Organized by Ariel_yang

Sep 01, 2019- No end date
163 participants


SemEval-2020 Task5: Modelling Causal Reasoning in Language: Detecting Counterfactuals

Organized by Ariel_yang

Sep 01, 2019-Sep 14, 2050
229 participants


[OLD] DeftEval 2020 (SemEval 2020 - Task 6)

Organized by sspala

Identify and extract term and definition pairs in free text.

Aug 15, 2019- No end date
359 participants


SemEval 2020 Task 4 - Commonsense Validation and Explanation (ComVE)

Organized by Shuailong

Does the statement Make Sense? And Why?

Aug 15, 2019- No end date
652 participants


DeftEval 2020 (SemEval 2020 - Task 6)

Organized by sspala

Identify and extract term and definition pairs in free text.

Aug 15, 2019- No end date
155 participants


SemEval 2020 Task 2: Predicting Multilingual and Cross-Lingual (Graded) Lexical Entailment

Organized by gg42554

This is a competition set for the Shared Task 2 of the SemEval 2020. The competition includes tasks for predicting ...

Aug 13, 2019- No end date
164 participants


SemEval 2020 Task 3 - Predicting the (Graded) Effect of Context in Word Similarity

Organized by csantosarmendariz

We ask participants to try to predict the effect that context has in human perception of similarity of words.

Aug 10, 2019- No end date
218 participants


Task 10 - SemEval-2020

Organized by shallowLearner

Emphasis Selection for Written Text in Visual Media

Jul 30, 2019- No end date
225 participants


SemEval 2020 Task 1: Unsupervised Lexical Semantic Change Detection

Organized by dschlechtweg

Shared task addressing the unsupervised detection of lexical semantic change, i.e., word sense changes over time, in text corpora ...

Jul 01, 2019- No end date
442 participants


Assessing the Funniness of Edited News Headlines (SemEval-2020)

Organized by nabilhossain

This is a humor competition that requires participants to estimate the funniness of edited news headlines.

May 28, 2019- No end date
607 participants


OffensEval (SemEval Task)

Organized by Shervin

OffensEval: Identifying and Categorizing Offensive Language in Social Media

Sep 10, 2018- No end date
793 participants


SemEval19 Task 3 : EmoContext

Organized by emocontext_organizers

In this task, you are given a textual dialogue, you have to classify the emotion of last user utterance.

Aug 21, 2018- No end date
306 participants


SemEval 2019 Task 8: Fact Checking in Community Question Answering Forums

Organized by tsvm

Competition website for SemEval 2019 Task 8: Fact Checking in Community Question Answering Forums https://github.com/tsvm/factcheck-cqa

Aug 20, 2018- No end date
78 participants


SemEval 2019 Task 1: Cross-lingual Semantic Parsing with UCCA

Organized by borgr

Shared task on UCCA parsing in English, German and French.

Aug 20, 2018- No end date
60 participants


SemEval 2019 Task 5 - Shared Task on Multilingual Detection of Hate

Organized by msang

Given a tweet and a target (Woman or Immigrant), determine the presence of hate speech and whether it is against ...

Aug 20, 2018- No end date
573 participants


SemEval 2019 Task 9 - SubTask A - Suggestion Mining from Online Reviews and Forums

Organized by TDaudert

Suggestion Mining from Text

Aug 18, 2018-Jan 31, 2019
19 participants


SemEval 2019 Task 9 - SubTask B - Suggestion Mining from Online Reviews and Forums

Organized by TDaudert

Suggestion Mining from Text

Aug 12, 2018-Jan 31, 2019
11 participants


SemEval 2019 Task 2

Organized by alfredo

Unsupervised Lexical Semantic Frame Induction

Jun 30, 2018- No end date
15 participants


SemEval 2019, Task 10 -- Math Question Answering

Organized by se19-task10-organizers

Evaluates question answering systems on their ability to solve Math SAT questions.

Jun 26, 2018- No end date
54 participants


SemEval 2019 Task 11 Normalization of Medical Concepts in Clinical Narrative

Organized by SemEval.2019.Task.11

Natural Language Processing for Normalization of Medical Concepts.

Jun 01, 2018- No end date
8 participants


SemEval-2018 Task 9: Hypernym Discovery

Organized by CamachoCollados

This is the CodaLab Competition for the SemEval-2018 Task 9: Hypernym Discovery.

Jan 08, 2018- No end date
174 participants


SemEval-2019 Task 12 - Toponym Resolution in Scientific Papers

Organized by dweissen

This challenge on toponym resolution, also known as geoparsing, geo-grounding or place name resolution, aims to assign geographic coordinates to ...

Jan 01, 2018- No end date
41 participants


[inactive] SemEval-2018 task 7

Organized by dbusca

Please note that this task is being moved to another CodaLab page: https://competitions.codalab.org/competitions/17422

Sep 01, 2017- No end date
37 participants


SemEval 2018 Task 4: Character Identification on Multiparty Dialogues

Organized by jdchoi

An entity linking task where mentions are personal nouns and entities are characters in the TV show, <i>Friends</i>.

Aug 21, 2017- No end date
86 participants


SemEval-2018 task 7 Semantic Relation Extraction and Classification in Scientific Papers

Organized by gabor.kata

This is the CodaLab competition page for the 2018 SemEval task on Semantic Relation Extraction and Classification in Scientific Papers.

Aug 21, 2017- No end date
175 participants


SemEval-2018 task 3 - Irony detection in English tweets

Organized by Eslefeve

This is SemEval-2018 task 3 on irony detection with two subtasks A and B.

Aug 21, 2017-Jan 29, 2018
415 participants


SemEval-2018 Task 5: Counting Events and Participants in the Long Tail

Organized by filipilievski

Competition for the SemEval-2018 Task 5 entitled Counting Events and Participants within Highly Ambiguous Data covering a very long tail.

Aug 14, 2017- No end date
67 participants


SemEval-2018 Task 11: Machine Comprehension using Commonsense Knowledge

Organized by simono

This is the CodaLab competition for the SemEval 2018 Task 11: Machine Comprehension using Commonsense Knowledge.

Aug 14, 2017- No end date
294 participants


SemEval-2018 Task 6: Parsing Time Normalizations

Organized by Egoitz

Parsing Time Normalization

Aug 14, 2017- No end date
59 participants


SemEval-2018 Task 1: Affect in Tweets (AIT-2018)

Organized by felipebravom

We present an array of tasks where systems have to automatically determine the intensity of emotions (E) and intensity of ...

Aug 14, 2017- No end date
349 participants


SemEval 2018 Task 10 Capturing Discriminative Attributes

Organized by krebs

Capturing Discriminative Attributes is a SemEval 2018 competition.

Jun 01, 2017- No end date
164 participants


SemEval 2018 Task 8: SecureNLP (Semantic Extraction from CybersecUrity REports using NLP)

Organized by PeterP

Extract entities, relations, and malware attributes from a cybersecurity report.

Jun 01, 2017- No end date
232 participants


SemEval-2018 Task 12 - The Argument Reasoning Comprehension Task

Organized by ivan.habernal

Given a natural language argument consisting of a claim, premise, and context, the goal is to choose the correct warrant ...

Jun 01, 2017- No end date
110 participants


SemEval-2018 Task 2, Multilingual Emoji Prediction

Organized by CamachoCollados

This is a SemEval shared task on emoji prediction in English and Spanish

Jun 01, 2017- No end date
405 participants


SemEval-2017 Task 7, Subtask 3

Organized by Logological

Interpretation of English Puns

Dec 05, 2016-Jan 30, 2050
29 participants


SemEval-2017 Task 7, Subtask 2

Organized by Logological

Location of English Puns

Dec 05, 2016-Jan 22, 2050
21 participants


SemEval-2017 Task 7, Subtask 1

Organized by Logological

Detection of English Puns

Dec 05, 2016-Jan 15, 2050
45 participants


SemEval 2017 Task 10 ScienceIE

Organized by flavioAlexander

Extracting Keyphrases and Relations from Scientific Publications

Sep 01, 2016-Jan 31, 2017
54 participants


SemEval-2017 Task 1: Semantic Textual Similarity

Organized by ilopez077

Official competition site for the SemEval-2017 Task 1: Semantic Textual Similarity

Aug 01, 2016-Feb 13, 2017
67 participants


Competition for SemEval-2017/Task-11

Organized by julsal

End-User Development using Natural Language.

Aug 01, 2016-Feb 04, 2017
9 participants


SemEval-2017 Task 3 Subtask B

Organized by DorisHoogeveen

This is the SemEval 2017 Task 3 Subtask B competition.

Aug 01, 2016-Jan 31, 2017
36 participants


SemEval-2017 Task 3 Subtask D

Organized by DorisHoogeveen

This is the SemEval 2017 Task 3 Subtask D competition.

Aug 01, 2016-Jan 31, 2017
13 participants


SemEval-2017 Task 3 Subtask A

Organized by DorisHoogeveen

This is the SemEval 2017 Task 3 Subtask A competition.

Aug 01, 2016-Jan 31, 2017
45 participants


SemEval-2017 Task 3 Subtask C

Organized by DorisHoogeveen

This is the SemEval 2017 Task 3 Subtask C competition.

Aug 01, 2016-Jan 31, 2017
23 participants


SemEval-2017 Task 3 Subtask E

Organized by DorisHoogeveen

This is the SemEval 2017 Task 3 Subtask E competition.

Aug 01, 2016-Jan 31, 2017
16 participants


SemEval-2017 Task 6: "#HashtagWars Learning a Sense of Humor" - Subtask B

Organized by jgc128

This the the official competition for the SemEval-2017 Task 6 - Subtask B

Aug 01, 2016-Jan 31, 2017
17 participants


SemEval-2017 Task 6: "#HashtagWars Learning a Sense of Humor" - Subtask A

Organized by jgc128

This the the official competition for the SemEval-2017 Task 6 - Subtask A

Aug 01, 2016-Jan 31, 2017
20 participants


SemEval-2017 Task 4B Arabic, Sentiment Analysis in Twitter

Organized by seirasto

This is the competition for Subtask B in Arabic of Task 4

Aug 01, 2016-Jan 30, 2017
15 participants


SemEval-2017 Task 4D Arabic, Sentiment Analysis in Twitter

Organized by seirasto

This is the competition for Subtask D in Arabic of Task 4

Aug 01, 2016-Jan 30, 2017
7 participants


SemEval-2017 Task 4D English, Sentiment Analysis in Twitter

Organized by seirasto

This is the competition for Subtask D in English of Task 4

Aug 01, 2016-Jan 30, 2017
28 participants


SemEval-2017 Task 4B English, Sentiment Analysis in Twitter

Organized by seirasto

This is the competition for Subtask B in English of Task 4

Aug 01, 2016-Jan 30, 2017
44 participants


SemEval-2017 Task 4E Arabic, Sentiment Analysis in Twitter

Organized by seirasto

This is the competition for Subtask E in Arabic of Task 4

Aug 01, 2016-Jan 22, 2017
9 participants


SemEval-2017 Task 4A English, Sentiment Analysis in Twitter

Organized by seirasto

This is the competition for Subtask A in English of Task 4

Aug 01, 2016-Jan 22, 2017
90 participants


SemEval-2017 Task 4E English, Sentiment Analysis in Twitter

Organized by seirasto

This is the competition for Subtask E in English of Task 4

Aug 01, 2016-Jan 22, 2017
19 participants


SemEval-2017 Task 4C Arabic, Sentiment Analysis in Twitter

Organized by seirasto

This is the competition for Subtask C in Arabic of Task 4

Aug 01, 2016-Jan 22, 2017
6 participants


SemEval-2017 Task 4A Arabic, Sentiment Analysis in Twitter

Organized by seirasto

This is the competition for Subtask A in Arabic of Task 4

Aug 01, 2016-Jan 22, 2017
20 participants


SemEval-2017 Task 4C English, Sentiment Analysis in Twitter

Organized by seirasto

This is the competition for Subtask C in English of Task 4

Aug 01, 2016-Jan 22, 2017
28 participants


SemEval-2017 Task 9 (generation subtask): English News/Forum generation from AMR

Organized by jonmay

Given a News/Discussion Forum AMR, produce an English sentence.

Aug 01, 2016-Jan 21, 2017
18 participants


SemEval-2017 Task 9 (parsing subtask): English Biomedical AMR parsing

Organized by jonmay

Given a Biomedical paper sentence, produce an AMR.

Aug 01, 2016-Jan 20, 2017
22 participants


SemEval 2017 Task 12: Clinical TempEval

Organized by bethard

Jun 01, 2016- No end date
111 participants


SemEval-2017 Task 2 Subtask 2, Cross-lingual Word Similarity

Organized by CamachoCollados

This is a competition on cross-lingual word similarity. Data available for ten pair of languages involving English, Farsi, German, Italian ...

Jan 09, 2016-Jan 31, 2017
16 participants


SemEval-2017 Task 2 Subtask 1, Multilingual Word Similarity

Organized by CamachoCollados

This is a competition on monolingual word similarity. Data available for English, Farsi, German, Italian and Spanish. More information at ...

Jan 09, 2016-Jan 31, 2017
35 participants


Learn how to create your own competition.