Re: [Moses-support] The BELU score from MultiEval is much lower than which generated by the Moses mert-moses.pl script

2013-01-24 Thread Tan, Jun
: Thursday, 24 January 2013 5:44 PM To: Tan, Jun Cc: moses-support@mit.edu Subject: Re: [Moses-support] The BELU score from MultiEval is much lower than which generated by the Moses mert-moses.pl script Hi Jun mert-moses.pl is not an evaluation script, it's for tuning the MT engine. It will report

[Moses-support] The BELU score from MultiEval is much lower than which generated by the Moses mert-moses.pl script

2013-01-23 Thread Tan, Jun
Hello all, I have created an English-Chinese MT engine via Moses. I’m doing the translation quality evaluation regard this engine. I have an evaluation report created by MultiEval tool about 1000 sentences. I found the BELU score is much lower than the score generated by the mert-moses.pl

Re: [Moses-support] Dose Moses support binarised translation table for factored model?

2012-09-04 Thread Tan, Jun
in the phrase-table from | to _, and the decoding did work. -Original Message- From: phko...@gmail.com [mailto:phko...@gmail.com] On Behalf Of Philipp Koehn Sent: Wednesday, September 05, 2012 4:22 AM To: Tan, Jun Cc: moses-support@mit.edu Subject: Re: [Moses-support] Dose Moses support binarised

[Moses-support] Dose Moses support binarised translation table for factored model?

2012-09-03 Thread Tan, Jun
Hi all, I built a factored model following the guideline on Moses web page. In order to faster the decoding speed, I’m trying to use the binarised phrase table. The binaring progress is finished, when trying to decode with the binarised phrase table, the translation got failed. The input and

Re: [Moses-support] What will happen if training Moses with duplicated corpus?

2012-08-30 Thread Tan, Jun
tmp]# wc -l phrase-table1 21546088 phrase-table1 -Original Message- From: phko...@gmail.com [mailto:phko...@gmail.com] On Behalf Of Philipp Koehn Sent: Thursday, August 30, 2012 5:02 AM To: Tan, Jun Cc: moses-support@mit.edu Subject: Re: [Moses-support] What will happen if training Moses

Re: [Moses-support] What will happen if training Moses with duplicated corpus?

2012-08-28 Thread Tan, Jun
, August 29, 2012 4:31 AM To: Tan, Jun Cc: moses-support@mit.edu Subject: Re: [Moses-support] What will happen if training Moses with duplicated corpus? Hi, It is not obvious to me why this would happen due to data duplication - there are things like Good Turing smoothing that would be affected

[Moses-support] What will happen if training Moses with duplicated corpus?

2012-08-27 Thread Tan, Jun
Hi all, Just like the thread title says, what will happen in that situation? I did an experiment to create two Moses translation models, one created by the original corpus, the other created by two copy of the same corpus. And in the last, I found that the BLEU score is a little different

[Moses-support] Malformed input issue happened during decoding process, when using factored model

2012-08-23 Thread Tan, Jun
Hi all, I’m learning about the factored model, tried to create a factored model following the guideline on Moses website. Everything goes fine during the creating process, but got a “Malformed input issue” when doing the first time decoding like below: Loading lexical distortion models...have

Re: [Moses-support] how does Moses handle with the apostrophes?

2012-08-07 Thread Tan, Jun
, and the Moses got installed in June, the version should be relatively new. Do you have any ideas how to fix it? From: Tom Hoar [mailto:tah...@precisiontranslationtools.com] Sent: Tuesday, August 07, 2012 1:13 PM To: Tan, Jun Cc: moses-support@mit.edu Subject: Re: [Moses-support] how does

Re: [Moses-support] how does Moses handle with the apostrophes?

2012-08-07 Thread Tan, Jun
$text =~ s/\/\quot;/g; # xml $text =~ s/\[/\#91;/g; # syntax non-terminal $text =~ s/\]/\#93;/g; # syntax non-terminal -Original Message- From: Barry Haddow [mailto:bhad...@staffmail.ed.ac.uk] Sent: Tuesday, August 07, 2012 5:55 PM To: Tan, Jun Cc: moses-support@mit.edu Subject

Re: [Moses-support] how does Moses handle with the apostrophes?

2012-08-07 Thread Tan, Jun
: Barry Haddow [mailto:bhad...@staffmail.ed.ac.uk] Sent: Tuesday, August 07, 2012 6:18 PM To: Tan, Jun Cc: moses-support@mit.edu Subject: Re: [Moses-support] how does Moses handle with the apostrophes? Hi Jun If you're using this version of the tokeniser on your source sentence, then I would expect