MT community, NIST's next Open Machine Translation evaluation, OpenMT12, will be officially announced and open for registration in late October 2011. For your planning purposes, I would like to make you aware of it now and provide a tentative schedule.
Highlights will include: - A re-run of the 2008/2009 Arabic-to-English and Chinese-to-English Progress tests, with data to be released to participants after this evaluation - Translation from Arabic, Chinese, Dari, Farsi and Korean into English on a parallel source data set - Additional translation data for Chinese-to-English - A system combination track to follow the main evaluation - Performance measurement by automatic metrics and human rankings Tentative schedule: October 28 2011: Evaluation plan released October 28 2011 - February 3 2012: Registration period (early registration highly encouraged) November 2011: Training data available from LDC January 16 - February 24 2012: Dry run submission period - required (early submission highly encouraged) April 2 - April 6 2012: Main evaluation period April 16 - 20 2012: System combination evaluation period April 20 2012: Preliminary release of results to participants April 27 2012: System descriptions due April 30 - June 1 2012: Human assessment period June 25 - 26 2012: Workshop in the Washington DC area - attendance required August 31 2012: Official public release of results Please direct any questions to [email protected]<mailto:[email protected]>. We are hoping for a lively 2012 evaluation! Best, Kay Peterson / NIST OpenMT Team NIST ITL IAD Multimodal Information Group http://www.nist.gov/itl/iad/mig Phone (+1) 301-975-2960
_______________________________________________ Mt-list mailing list
