Re: [Moses-support] ERROR: use --lm factor:order:filename to specify at least one language model

2016-03-28 Thread Philipp Koehn
Hi, you have to give the training script the location of the language model since the language model has to built separately but the moses.ini config file (that is the result of training) includes a pointer to it, so the training script needs to know what to fill in. -phi On Sat, Mar 26, 2016 at

Re: [Moses-support] moses 2.1 vs 3

2016-03-28 Thread Mohammad Salameh
Hi Hieu, The Moses version I downloaded was in 8 December 2015. I downloaded several versions after that date that all shared the same issue. So I think that was it. Thanks again On Mon, Mar 28, 2016 at 5:04 PM, Hieu Hoang wrote: > well spotted, there seemed to have been a mistake which I've ju

Re: [Moses-support] moses 2.1 vs 3

2016-03-28 Thread Hieu Hoang
well spotted, there seemed to have been a mistake which I've just fixed https://github.com/moses-smt/mosesdecoder/commit/b8bc4a9fb64731b593ba56cce1da1af0bbb6138e But are you sure the problem was in Moses 3? It seemed the bug was introduced only in Dec 2015 https://github.com/moses-smt/mosesdecod

Re: [Moses-support] moses 2.1 vs 3

2016-03-28 Thread Mohammad Salameh
Hi Hieu Please find the model files on Google drive. https://drive.google.com/folderview?id=0B9m7_C7udg78dElpWUpubG1qV28&usp=sharing I have generated a smaller phrase table, reordering model (filtered based on tst.en.5) and language model for sharing. I was also able to reproduce the same behavio

Re: [Moses-support] tokenizer for German language

2016-03-28 Thread Hieu Hoang
use the tokenizer.perl script with the arg -l de On 28/03/2016 15:23, Alapan Kuila wrote: Sir, Please provide some script or program for German tokenizer. Is it right to use tokenizer.perl ( ~/moses/scripts/tokenizer/tokenizer.perl) for German tokenization?Please help. Thanks and regards,

Re: [Moses-support] moses 2.1 vs 3

2016-03-28 Thread Hieu Hoang
Hi Mohammad Can you make your model files available for download. I'll take a look at it. It should work the same asy Hieu Hoang http://www.hoang.co.uk/hieu On 28 Mar 2016 5:01 pm, "Mohammad Salameh" wrote: > Hi > I have recently started using Moses 3.0 and I noticed the following > difference

[Moses-support] moses 2.1 vs 3

2016-03-28 Thread Mohammad Salameh
Hi I have recently started using Moses 3.0 and I noticed the following difference compared to Moses 2.1 Assuming ttable-limit is set to 20, Moses 3.0 retrieves the 20 translation options of each source segment from the phrase table. But before calculating the future costs and while it is checking t

Re: [Moses-support] ERROR: use --lm factor:order:filename to specify at least one language model

2016-03-28 Thread Hieu Hoang
On 26/03/2016 12:37, Zhanwang Chen wrote: when I run: $MOSES/scripts/training/train-model.perl -hierarchical -ghkm -external-bin-dir /home/zhanwang/giza-pp/tools/ -root-dir . --corpus corpus/nl2mr --f mr --e nl showed: ERROR: use --lm factor:order:filename to specify at least one language

Re: [Moses-support] ERROR: use --lm factor:order:filename to specify at least one language model

2016-03-28 Thread Hieu Hoang
On 26/03/2016 12:37, Zhanwang Chen wrote: when I run: $MOSES/scripts/training/train-model.perl -hierarchical -ghkm -external-bin-dir /home/zhanwang/giza-pp/tools/ -root-dir . --corpus corpus/nl2mr --f mr --e nl showed: ERROR: use --lm factor:order:filename to specify at least one language

[Moses-support] tokenizer for German language

2016-03-28 Thread Alapan Kuila
Sir, Please provide some script or program for German tokenizer. Is it right to use tokenizer.perl ( ~/moses/scripts/tokenizer/tokenizer.perl) for German tokenization?Please help. Thanks and regards, Alapan ___ Moses-support mailing list Moses-support@m

Re: [Moses-support] english-japanese translation

2016-03-28 Thread Graham Neubig
Hello Vishal, Yes, that's what pre-ordering means. Specifically it means re-ordering the source side. Graham On Mon, Mar 28, 2016 at 2:16 PM, Vishal Goyal(विशाल गोयल) < vishal@gmail.com> wrote: > Dear Graham, > Greetings. > Please clarify that Pre-Ordering in your reply means, that making t