[Moses-support] ERROR: Lexical reordering scoring failed

2014-06-01 Thread Tom Hoar
I experienced an error that I've not seen before using train-model.perl from Moses Release 1.0. Here are the final lines of the output log as the script terminated. The error message Illegal reordering type used: d is new to me. (7) learn reordering model @ Sun Jun 1 00:12:55 IST 2014 (7.1)

[Moses-support] Need help/suggestions in setup EMS

2014-06-01 Thread Attilio Santocchia
Hello, I'm starting to use moses and I'm going through the documentation. The how-to is quite clear and I was able to setup a test machine for the Experiment but now I'd like to have some advice. Our plan is to start an intensive test of a lot of public and private corpora we already have for

Re: [Moses-support] Moses-support Digest, Vol 91, Issue 52

2014-06-01 Thread Hieu Hoang
The tokenizer.perl is getting too large and unwieldy. It duplicates escape-special-chars and i don't want it to duplicate this standalone functionality. On 01/06/14 06:02, Philipp Koehn wrote: Hi, should that be part of the tokenizer and/or the escape-special-characters script? -phi On

[Moses-support] adding arbitary feature functions on the command line

2014-06-01 Thread Hieu Hoang
I've just added some more arguments to the decoder so that you can add new feature functions (+weights) to the decoder without having to change the ini file. It will work during tuning too. ./moses -feature-add Feature function args... -weight-add FFName= 0.1 To use it in the EMS:

Re: [Moses-support] Moses-support Digest, Vol 91, Issue 52

2014-06-01 Thread Philipp Koehn
Hi, Fair enough - one can always pipe through both. -phi On Jun 1, 2014 3:00 PM, Hieu Hoang hieuho...@gmail.com wrote: The tokenizer.perl is getting too large and unwieldy. It duplicates escape-special-chars and i don't want it to duplicate this standalone functionality. On 01/06/14