Competition

Task Objective and Definition

The objective of the AESW Shared Task is to promote the use of NLP tools to help ELL writers improve the quality of their scientific writing.

The main goals of the task are

• to identify sentence-level features that are unique to scientific writing;
• to provide a common ground for development and comparison of sentence-level automated writing evaluation systems for scientific writing;
• to establish the state-of-the-art performance in the field.

Some interesting uses of sentence-level quality evaluations are the following:

• automated writing evaluation of submitted scientific articles;
• authoring tools for writing English scientific texts;
• filtering out sentences that need quality improvement.

The task will examine automated evaluation of scientific writing at the sentence-level by using the output of professionally edited scientific texts. The dataset contains aligned text extracts before and after they were edited by native English speakers.

The goal of the task is to predict whether a given sentence needs language editing to improve it. The task is a binary classification task. Two types of predictions will be evaluated: binary prediction (False or True) and probabilistic estimation (between 0 and 1).

See more details at http://textmining.lt/aesw/index.html.