NSURL - Task 6: Co-reference Resolution in Farsi

Organized by nasrin.taghizadeh - Current server time: June 19, 2019, 3:14 p.m. UTC

Current

Development
May 1, 2019, midnight UTC

Next

Evaluation
July 8, 2019, midnight UTC

End

Competition Ends
Never

NSURL - Task 6: Co-reference Resolution in Farsi

Organized by University of Tehran, in collaboration with ITRC

This is the website for the shared task of Co-reference in Farsi organized at NSURL 2019

Co-reference resolution is defined as the task of determining which mentions in a discourse refer to the same real world entity. It is important for higher level tasks like question answering, event detection from news, dialog systems, and chat bots. Formally, the input is a text; and the participants should find which phrases are co-referred.

The results well be sent to all participants who submitted runs to the competition. (after 15-July-2019).

In case you don't receive the e-mail, please contact us via <nsurl@itrc.ac.ir>

Thanks for participating!

Important Dates

Evaluation start: 08 July 2019
Evaluation end: 15 July 2019
Paper submission: 29 July 2019
Author notification: 12 August 2019
Camera ready: 26 Augest 2019
Workshop: 11, 12 September 2019

Task Participation

To participate in this task , the team leader has to do the following:

  1. Choose a name for your team (The name should reflect your team)
  2. login to CodaLab
  3. Prepare your codes according to the true format provided on 'Participate' tab.
  4. Upload your codes in dropbox and share the link with us.
  5. Submit your results on test data on 'Participate --> Submit/View Results' tab.

Paper Submission

The team leader has to do the following:

  1. login as an author to https://easychair.org/conferences/?conf=nsurl2019
  2. add the paper title: NSURL-2019 Task 6: Co-reference Resoultion in Farsi
  3. Paper authors of the paper: The team members
  4. Paper abstract and keywords: add an abstract and keywords.
  5. submit the paper.

Participants are highly encouraged to report the result of 5-fold cross-validation on the training data in their papers.

Task Organizer

If you have any queries regarding this task, please refer to the task organizers:

 

NSURL - Task 6: Co-reference Resolution in Farsi: Evaluation

The submission will be evaluated using following metrics: MUC, B-CUBED, CEAFe, CoNLL score, and LEA.

Evaluation codes can be downloaded from:

https://github.com/ns-moosavi/coval

 

NSURL - Task 6: Co-reference Resolution in Farsi: Rules

Submissions must be submitted before the 2019-07-07 00:00:00. You may submit 5 submissions every day and 5 in total.

Download Size (mb) Phase
Public Data 4.505 #1 Development

Development

Start: May 1, 2019, midnight

Description: Development phase: create models and submit them; feed-back are provided on the validation set. Your program should read test file and produce the output file.

Evaluation

Start: July 8, 2019, midnight

Description: Evaluation phase: submissions from the previous phase are automatically cloned and used to compute the final score. The results on the test set will be revealed when the organizers make them available.

Competition Ends

Never

You must be logged in to participate in competitions.

Sign In
# Username Score
1 nasrin.taghizadeh 0.00