Competition for SemEval-2017/Task-11

Organized by julsal - Current server time: March 24, 2018, 12:18 a.m. UTC

First phase

Aug. 1, 2016, midnight UTC


Competition Ends
Feb. 4, 2017, 5:10 p.m. UTC


This task proposes a challenge to support the interaction of end-users with applications, micro-services and software APIs using natural language. It aims at supporting the evaluation and evolution of the discussions surrounding the application of natural language processing techniques within the context of end-user natural language programming.

Recent advances in Natural Language Processing bring the opportunity of improving the interaction between users and software artefacts, supporting end-users programming mediated by natural language. This ability to match user’s action intents and information needs to formal actions within a set of Application Programming Interfaces (APIs), using the semantics of natural language as the mediation layer between both, can significantly impact the accessibility of software development.

This SemEval task aims at developing the state-of-the-art discussions and techniques concerning the semantic interpretation of natural language commands and user action intents, bridging the semantic gap between users and software artefacts.

Evaluation Criteria

This is the page that tells you how competition submissions will be evaluated and scored.

Terms and Conditions

This page enumerated the terms and conditions of the competition.


Start: Aug. 1, 2016, midnight


Start: Jan. 9, 2017, midnight

Competition Ends

Feb. 4, 2017, 5:10 p.m.

You must be logged in to participate in competitions.

Sign In