Re: [Moses-support] Configuring LMs

2014-05-28 Thread Kenneth Heafield
KenLM will happily consume an ARPA file produced by SRILM. However, you created a binary file with SRILM. On 05/28/14 02:41, Lars Bungum wrote: > Still, it works to use the KENLM feature with the IRSTLM LM (but not, > SRILM as I discovered). ___ Moses-

Re: [Moses-support] Moses Training issue

2014-05-28 Thread Hieu Hoang
are you sure you are running giza++ on the cleaned data, ie. sentences with wildly diffent lengths are discarded? giza++ really doesn't like such sentences On 26/05/14 06:53, Mohsen Afshin wrote: Hi Moses devs I just followed the guide on installation of Moses here

Re: [Moses-support] n-grams in source language

2014-05-28 Thread Hieu Hoang
there is no such process. If you think it would useful for translation, you go ahead and implement it On 26/05/14 11:16, Andrew wrote: Hello, I know that language model is constructed using n-gram from target language, but where does the process that compares the n-grams used in source lang

Re: [Moses-support] Problem with mert-moses.pl I don't have directory

2014-05-28 Thread Laura Enguix Bou
Hi, Thanks everyone, as Philipp says that was in the latest versions. My call to mert has been finally: nohup $SCRIPTS_ROOTDIR/training/mert-moses.pl /home/lauenbo/Programs/data/EuTrans-corpus/${CorpusTraining}.${exten_origen} /home/lauenbo/Programs/data/EuTrans-corpus/${CorpusTraining}.${exten_d

Re: [Moses-support] Popular science articles about current MT

2014-05-28 Thread Barry Haddow
Hi Joerg There was this one in New Scientist - not really "mainstream" MT though http://www.newscientist.com/article/mg21028175.400-cracking-the-code-of-machine-translation.html#.U4ZFtKa4ByQ cheers - Barry On 28/05/14 20:39, Joerg Tiedemann wrote: > I'm looking for high-level popular science ar

[Moses-support] Popular science articles about current MT

2014-05-28 Thread Joerg Tiedemann
I'm looking for high-level popular science articles about current trends in MT. They could include some details but should not be too technical. Any ideas? Thanks! Jörg ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/

Re: [Moses-support] About adding features

2014-05-28 Thread Hieu Hoang
On 28/05/14 08:40, Jianri Li wrote: Hi, all, I have several questions about adding log-linear feature to MOSES. I want to add a phrasepair feature to the decoder, it need to read a new phrase table from a file, which consists of lines that contains a phrase pair string and a score. that's

Re: [Moses-support] Problems with segmentation mismatch and many unknown words for Chinese translation

2014-05-28 Thread Prashant Mathur
Hi Gideon, I am also doing experiments with Chinese-English and I am getting BLEU scores of around 9 points but in my case I am using one particular training corpus which doesn't have a high overlap with NIST testsets. So, it is bound to give low scores at least in my case. Could you re-check if y

[Moses-support] Fwd:Feature Function

2014-05-28 Thread Jianri Li
I resend the email due to the HTML file scrubbed .   Hi, all,   Maybe my question is not clear, what I want to know is:   When ScoreComponentCollecetion.PlusEquals method is called, how the weight of log-linear model could be assigned to the new feature?   Thanks,Jianri  --

[Moses-support] Feature Function

2014-05-28 Thread Jianri Li
 Hi, all,   Maybe my question is not clear, what I want to know is:   When ScoreComponentCollecetion.PlusEquals method is called, how the weight of log-linear model could be assigned to the new feature?   Thanks,Jianri   Orig! inal Email    Hi, all,  I ha

[Moses-support] Problems with segmentation mismatch and many unknown words for Chinese translation

2014-05-28 Thread Gideon Wenniger
Dear Sir/Madam, As my Machine Translation research focuses mainly on improving word order I would like to run experiments with Chinese, i.e. Chinese-English, as much work on reordering has been focusing on this language pair and it would be good to compare to it. Unfortunately, while I have be

Re: [Moses-support] Configuring LMs

2014-05-28 Thread Matthias Huck
Hi Lars, The format for the -lm parameter string in train-model.perl is: factor:order:filename:type "SRILM" if type == 0 "IRSTLM" if type == 1 "KENLM lazyken=0" if type == 8 "KENLM lazyken=1" if type == 9 The type is set to 0 if you omit it in the parameter string. If you want to use SRILM, IR

Re: [Moses-support] Configuring LMs

2014-05-28 Thread Lars Bungum
Hi, thanks for the pointer, good information! But the instructions for building the Baseline model found here http://www.statmt.org/moses/?n=Moses.Baseline builds the translation model with the parameters: nohup nice ~/mosesdecoder/scripts/training/train-model.perl -root-dir train \ -corpu

[Moses-support] About adding features

2014-05-28 Thread Jianri Li
Hi, all,  I have several questions about adding log-linear feature to MOSES.  I want to add a phrasepair feature to the decoder, it need to read a new phrase table from a file, which consists of lines that contains a phrase pair string and a score.  As intro! duced in MOSES homepage (in the