Re: [Moses-support] Reference about tuning the BLEU coefficients

2015-02-03 Thread Mikel L. Forcada
Thanks a million Ondrej! I'd check Daniel Cer's thesis, Will do! I'm not sure if he did anything with BLEU coefficients but he definitely convinced himself that there was no better tuning metric than BLEU. ...but we're running the tuning task at WMT this year again, so something new will

Re: [Moses-support] Reference about tuning the BLEU coefficients

2015-02-03 Thread Ondrej Bojar
Dear Mikel, I'd check Daniel Cer's thesis, I'm not sure if he did anything with BLEU coefficients but he definitely convinced himself that there was no better tuning metric than BLEU. ...but we're running the tuning task at WMT this year again, so something new will hopefully show up.

[Moses-support] Reference about tuning the BLEU coefficients

2015-02-02 Thread Mikel L. Forcada
Dear list, the correlation of BLEU with manual measurements of quality has extensively been studied (Callison-Burch et al., WMT Findings paper). But, would anyone know of any paper where people have actually tuned the BLEU coefficients to approximate some kind of manual measurement of

Re: [Moses-support] Reference about tuning the BLEU coefficients

2015-02-02 Thread Philipp Koehn
Hi, while the original BLEU paper mentions co-efficients, there are not used (i.e., all are set to 1/4). There have efforts to create tunable metrics, but these are not widely used. -phi On Mon, Feb 2, 2015 at 4:34 AM, Mikel L. Forcada m...@dlsi.ua.es wrote: Dear list, the correlation of

Re: [Moses-support] Reference about tuning the BLEU coefficients

2015-02-02 Thread Mikel Forcada
Thanks a million, Philipp! About these tunable metrics, has anything been published? do you have any references? Cheers Mikel Hi, while the original BLEU paper mentions co-efficients, there are not used (i.e., all are set to 1/4). There have efforts to create tunable metrics, but these