Dear MT community,
It is not too late yet to register for participation in the LoReHLT evaluation! An updated evaluation plan, the signup link, as well as the data license agreement are now all available at https://www.nist.gov/itl/iad/mig/lorehlt-evaluations. Please see the original announcement below. Let us know if we can answer any questions that may help you decide to sign up! Best regards, Kay Peterson NIST ITL IAD Multimodal Information Group http://www.nist.gov/itl/iad/mig<https://messaging.nist.gov/owa/redir.aspx?C=7fddaa5c952a45c69e1494d501011ad0&URL=http%3a%2f%2fwww.nist.gov%2fitl%2fiad%2fmig> Phone (+1) 301-975-2960 ________________________________ From: Peterson, Kay (Fed) Sent: Monday, February 26, 2018 2:34 PM To: MT_LIST; [email protected] Subject: Call for participation in LoReHLT18 Machine Translation task Dear MT community, The National Institute of Standards and Technology (NIST) is pleased to announce LoReHLT18 (Low Resource HLT 2018) - an open evaluation series launched in 2016 aimed to advance human language technologies that provide rapid and effective response to emerging incidents where the language resources are very limited. The core tasks for 2018 will continue to be machine translation (MT), entity discover and linking (EDL), and situation frames (SF), but we are introducing several changes to the program: * Two surprise incident languages (ILs), as in 2017, plus English for EDL and SF for each IL * Check points reduced to two, with a shorter evaluation window * SF task redefined with updated performance scoring metrics * SF text and speech as a single task * Previously evaluated languages, Oromo and Tigrinya from LoReHLT17, offered as an "Open Test on Additional Languages" (OTAL), a separate and simplified evaluation on both MT and EDL The entire program is open to anyone who wishes to participate. As before, open participants may choose to participate in one or all tasks, in one or more languages, and (for the 2018 new IL) in one or both checkpoints. We expect the main LoReHLT evaluation to occur in July, but OTAL will take place in September. We will be offering a dry run in Mandarin Chinese new participants to become familiar with data format and evaluation procedures (but we will not provide any scores on the dry run). While we are finalizing the official evaluation plan, which we expect to release to the public within a month, please visit our LoReHLT main page at https://www.nist.gov/itl/iad/mig/lorehlt-evaluations to learn more about the program overall and about past evaluations. If you have any questions, please do not hesitate to contact us at [email protected]<mailto:[email protected]>. We look forward to hearing from you! Best, Kay Peterson NIST ITL IAD Multimodal Information Group http://www.nist.gov/itl/iad/mig<https://messaging.nist.gov/owa/redir.aspx?C=7fddaa5c952a45c69e1494d501011ad0&URL=http%3a%2f%2fwww.nist.gov%2fitl%2fiad%2fmig> Phone (+1) 301-975-2960
_______________________________________________ Mt-list site list [email protected] http://lists.eamt.org/mailman/listinfo/mt-list
