Dialog State Tracking Challenge 4 (DSTC4) for Development Set

Organized by seokhwan.kim - Current server time: Jan. 25, 2021, 10:19 a.m. UTC

First phase

Development phase
April 15, 2015, midnight UTC


Competition Ends
Aug. 31, 2015, 11:59 p.m. UTC

Dialog state tracking is one of the key sub-tasks of dialog management, which defines the representation of dialog states and updates them at each moment on a given on-going conversation. To provide a common testbed for this task, the first Dialog State Tracking Challenge (DSTC) was organized. More recently, Dialog State Tracking Challenges 2 & 3 have been successfully completed.

In this fourth edition of the Dialog State Tracking Challenge, we will focus on a dialog state tracking task on human-human dialogs. In addition to this main task, we also propose a series of pilot tracks for the core components in developing end-to-end dialog systems based on the same dataset. We expect these shared efforts on human dialogs will contribute to progress in developing much more human-like systems.

More details can be found at http://www.colips.org/workshop/dstc4/index.html.

Each submission should be done by uploading a single zip file that consists of a JSON file named ‘answer.json’ generated following the definition in the handbook. If there’s no error on the submitted file, the results can be posted to the leaderboard and compared to the results from other participants.

More details regarding participating in CodaLab competitions can be found at https://github.com/codalab/codalab/wiki/User_Participating-in-a-Competition.


Development phase

Start: April 15, 2015, midnight

Competition Ends

Aug. 31, 2015, 11:59 p.m.

You must be logged in to participate in competitions.

Sign In