CFP: EvaLatin 2026 - The Fourth Evaluation Campaign of NLP tools for Latin
* Website: https://circse.github.io/LT4HALA/2026/EvaLatin * Date: Monday, May 11 2026 * Place: co-located with LREC 2026, May 11-16, Palma, Mallorca (Spain) * Submission runs: check task guidelines * Submission technical reports: https://softconf.com/lrec2026/LT4HALA2026/ * DESCRIPTION EvaLatin 2026 is the fourth evaluation campaign of NLP tools for Latin. The campaign is designed with the aim of promoting the development of resources and language technologies for the Latin language, and foster collaboration among scholars working on Latin, as well as attracting researchers from different disciplines. EvaLatin 2026 edition focusses on 2 tasks: * Dependency Parsing; * Named Entity Recognition (NER). The dependency parsing task is based on the Universal Dependencies<https://universaldependencies.org/> (UD) framework. No specific training set is released but participants are free to make use of any (kind of) data/resource they consider useful for the task, including the Latin treebanks already available in the UD collection. In this regard, one of the challenges of this task is to understand which treebank (or combination of treebanks) is the most suitable to deal with new test data. Test data will be distributed in the CoNLL-U format with gold tokenization, lemmatization, part-of-speech tagging and morphological annotation. For more details, see the guidelines at the specific section of EvaLatin<https://circse.github.io/LT4HALA/2026/EvaLatin> webpage. In the NER task, participants are required to develop systems capable of automatically identifying and classifying proper names in provided Classical Latin texts. The goal is to detect the span of the mention and assign it to a pre-defined category. A small sample set (plain text HIPE IOB format) will be made available in advance, together with the guidelines. Test data will be distributed in the same HIPE IOB format with the values for the NER predictions obscured. For more details, see the guidelines at the specific section of EvaLatin<https://circse.github.io/LT4HALA/2026/EvaLatin> webpage. * SUBMISSIONS Participants are required to submit their runs using specific email addresses (see the guidelines for each task) and to provide a technical report that should include a brief description of their approach, focusing on the adopted algorithms, models and resources, a summary of their experiments, and an analysis of the obtained results. Technical reports will be included in the proceedings as short papers: the maximum length is 4 pages (excluding references) and they should follow the LREC 2026 official format). Reports will receive a light review (we will check for the correctness of the format, the exactness of results and ranking, and overall exposition). Reports should be submitted using the START submission page of the workshop (https://softconf.com/lrec2026/LT4HALA2026/ ). Reports of the shared tasks are not anonymous. All participants will have the opportunity to present their results at the workshop, as an oral or poster presentation. Participants are allowed to use any approach (e.g. from traditional machine learning algorithms to Large Language Models) and any resource (annotated and non-annotated data, embeddings): all approaches and resources are expected to be described in the systems’ reports. Technical reports should follow the LREC stylesheet, which is available on the LREC 2026 website on the Author’s kit page<https://lrec2026.info/authors-kit/>. * WORKSHOP IMPORTANT DATES * 22 December 2025: guidelines available * Evaluation Window I - Task: Dependency Parsing * 3 February 2026: test data available * 10 February 2026: system results due to organizers * Evaluation Window II - Task: Named Entity Recognition * 12 February 2026: test data available * 19 February 2026: system results due to organizers * 10 March 2026: reports due to organizers * 20 March 2026: short report review deadline * 27 March 2026: camera ready version of reports due to organizers (strict deadline) Best Regards, Federica Iurescia (on behalf of the organizing committee) Federica Iurescia Postdoctoral Researcher LiLa: Linking Latin https://lila-erc.eu/#page-top CIRCSE Research Centre https://centridiricerca.unicatt.it/circse_index.html Facoltà di Scienze Linguistiche e Letterature Straniere Franciscanum Building, 2nd Floor, room 219 Università Cattolica del Sacro Cuore Largo Gemelli 1, 20123 Milan, Italy [http://static.unicatt.it/ext-portale/5xmille_firma_mail_2023.jpg] <https://www.unicatt.it/uc/5xmille>
_______________________________________________ Corpora mailing list -- [email protected] https://list.elra.info/mailman3/postorius/lists/corpora.list.elra.info/ To unsubscribe send an email to [email protected]
