COSC7336 - Text Summarizations

Organized by UH_RiTUAL - Current server time: March 24, 2018, 12:14 a.m. UTC


GigaWord Testing
Sept. 19, 2017, midnight UTC


Tedtalk Testing
Sept. 19, 2017, midnight UTC


Competition Ends
Nov. 18, 2017, 5 a.m. UTC


There is a lot of practical value in the ability of automatically summarizing text. For the second part of this practical, you will need to design and train a system to perform text summarization.


The Competition

This competition will test your predictions for the test data and rank them against average bleu score. There are two data sets for testing your system: one for TED Talk testing, another for Gigaword testing. See the Evaluation tab for more information about submissions.

You can post/answer questions in the forums tab but be mindful not to provide solutions to the shared task. You can also email the administrator or instructors for more one-on-one help.

Evaluation Criteria

To upload a submission you will need to create an account with Codalab. You'll then be able to register under the Participate tab after accpeting the terms and conditions. Once you've created an account and registered, you can begin submitting your output for evaluation.


For successfully completing your system submission you need to submit a text file (submission.csv) with your system’s predictions and your source code in a single zip file. Your predictions should be in the format of two columns where the first column is the file ID as given to you in the testing data and where the secong column is the actual prediction made by your system. It’s important that the zip file only contains the two files mentioned above, not a zip containing a folder with the contents in it; this will cause the evaluation script to fail. Please name your zip files ``
NOTE: CodaLab is an open source framework for running competitions. Your system submissions will be ranked according to accuracy of the system but the ranking will be public and thus it’s super important that the username you choose for the submission is not disclosing your identity. In order to identify which student gets credit for which system submission, please note in your report, and in your source code, the name you used to identify your submission in Codalab (username).
After successfully uploading a submission, be sure to click on the 'Submit to Leaderboard' button so that you can see your results against everyone else's.

To test against the testing TED Talk testing data set, submit your predictions in the TED Talk Testing tab. For testing against the Gigaword testing data set, submit your predictions in the Gigaword Testing tab.

Terms and Conditions

Cheating, plagiarism, and other forms of academic dishonesty will not be tolerated. This includes copying code from the internet without the written consent of the author. Visit University's Academic Honesty Policy for more information. By accepting these terms and conditions, you agree to the consequences if found guity of any transgressions. Feel free to contact us if you have any doubts.

GigaWord Testing

Start: Sept. 19, 2017, midnight

Tedtalk Testing

Start: Sept. 19, 2017, midnight

Competition Ends

Nov. 18, 2017, 5 a.m.

You must be logged in to participate in competitions.

Sign In
# Username Score
1 UH_RiTUAL 1.0000
2 blackbishop 0.5314
3 jinaobo 0.5088