Dialog State Tracking Challenge 5 (DSTC5)

Organized by seokhwan.kim - Current server time: Nov. 14, 2018, 11:58 a.m. UTC

First phase

Development phase
April 14, 2016, midnight UTC

End

Competition Ends
July 27, 2016, 11:59 p.m. UTC

Dialog state tracking is one of the key sub-tasks of dialog management, which defines the representation of dialog states and updates them at each moment on a given on-going conversation. To provide a common testbed for this task, the first Dialog State Tracking Challenge (DSTC) was organized. More recently, Dialog State Tracking Challenges 2 & 3 and Dialog State Tracking Challenge 4 have been successfully completed.

In this fifth edition of the Dialog State Tracking Challenge, we will continue evaluating the dialog state tracking task on human-human dialogs. Different from DSTC4, in this edition of the Challenge we will focus on cross-language DST. In addition to this main task, we also propose a series of pilot tracks for the core components in developing end-to-end dialog systems based on the same dataset. We expect these shared efforts on human dialogs will contribute to progress in developing much more human-like systems.

More details can be found at http://workshop.colips.org/dstc5/index.html

Each submission should be done by uploading a single zip file that consists of a JSON file named ‘answer.json’ generated following the definition in the handbook. If there’s no error on the submitted file, the results can be posted to the leaderboard and compared to the results from other participants.

More details regarding participating in CodaLab competitions can be found at https://github.com/codalab/codalab/wiki/User_Participating-in-a-Competition.

 

Development phase

Start: April 14, 2016, midnight

Evaluation phase

Start: July 21, 2016, midnight

Competition Ends

July 27, 2016, 11:59 p.m.

You must be logged in to participate in competitions.

Sign In