Dear participants,
We have just published the official results of the competition. You can see the results in the main overview page (https://competitions.codalab.org/competitions/30090) or you can download the official results from http://www.fing.edu.uy/inco/grupos/pln/haha/haha_2021_test_results.zip (top_results_test.csv is the official results table, while you can see all results for all users in all_results_test.csv).
We included the team names for the users that set them. If you want to change or include a different team name associated to your user, please write us to hahapln@fing.edu.uy. We will use the team names in tables in the overview paper of the task when available.
Please take in consideration that the final results might differ slightly from the results shown in the evaluation phase leaderboard, because of the issue discussed here: https://competitions.codalab.org/forums/26786/5801/
For the final results we considered the top result for each user for each task.
Remember the deadline for submitting your system description papers is June 17. The following are the instructions for the papers (notice there are some slight changes in the footnote and citation):
- System description papers should be formatted according to the Springer Conference Proceedings style: https://www.springer.com/gp/computer-science/lncs/conference-proceedings-guidelines. Latex and Word templates can be found there.
- The papers should be between 5 and 8 pages long, including references.
- Papers must be written in English.
- Each paper must include a copyright footnote on the first page of each paper: {\let\thefootnote\relax\footnotetext{Copyright \textcopyright\ 2021 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). IberLEF 2021, September 2021, Málaga, Spain.}}
For UK or US government employees consider the following:
Special cases: If an author is a Crown employee (e.g. UK government), the copyright of the paper may be with the Crown. Then, use the license clause "Crown Copyright © 2021. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0)." for the paper. If the author is an employee of the US government, then there may be no copyright with the paper. In this case, use the license clause "No copyright. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).".
- Eliminate the numbering in the pages of the paper, if there is one, and make sure that there are no headers or footnotes, except the mandatory copyright as a footnote on the first page.
- Authors should be described with their name and their full affiliation (university and country). Names must be complete (no initials), e.g. “Soto Pérez” instead of “S. Pérez”.
- Titles of papers should be in emphatic capital English notation, i.e., "Filling an Author Agreement by Autocompletion" rather than "Filling an author agreement by autocompletion".
- At least one author of each paper must sign the CEUR copyright agreement. Instructions and templates can be found at http://ceur-ws.org/HOWTOSUBMIT.html. The signed form must be sent along with the paper to the task organizers.
- IberLEF 2021 proceedings can be tentatively referred to as: Manuel Montes, Paolo Rosso, Julio Gonzalo, Ezra Aragón, Rodrigo Agerri, Miguel Ángel Álvarez-Carmona, Elena Álvarez Mellado, Jorge Carrillo-de-Albornoz, Luis Chiruzzo, Larissa Freitas, Helena Gómez Adorno, Yoan Gutiérrez, Salud María Jiménez Zafra, Salvador Lima, Flor Miriam Plaza-de-Arco and Mariona Taulé (eds.): Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021), CEUR Workshop Proceedings, 2021.
- Please cite the overview paper for this callenge using the following citation (this citation might still change slightly):
@article{haha2021overview,
title={{Overview of HAHA at IberLEF 2021: Detecting, Rating and Analyzing Humor in Spanish}},
author={Chiruzzo, Luis and Castro, Santiago and {Góngora}, Santiago and {Rosá}, Aiala and Meaney, J. A. and Mihalcea, Rada},
journal = {Procesamiento del Lenguaje Natural},
volume = {67},
number = {0},
pages={},
year = {2021},
keywords = {},
issn = {1989-7553},
}
Regards,
Luis