Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Read, James C
The following command works fine for when a language model is specified. Deleting the line KENLM lazyken=0 name=LM0 factor=0 path=$PWD/blm.en order=3 causes the script to fail with error: ERROR: Failed to run '/pathtomoses/mosesdecoder/bin/moses -config /pathtodata/binarised/moses.ini

[Moses-support] Tuning with no language model

2016-01-13 Thread Read, James C
Returning to an old discussion we once had on this list. I've tried to tune some systems with no reference in the configuration file to a language model so that I can do Moses justice when comparing it to a number of lines of work I have done that use only translation models and various

Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Hieu Hoang
Can you please send me the moses.ini file you're using and the exact command you're executing. You should be able to tune without a LM. I've done it myself a couple of years ago. There's no distinction between a LM and any other feature function On 13/01/16 13:22, Read, James C wrote:

Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Hieu Hoang
* Read, James C; Moses Support *Subject:* Re: [Moses-support] Tuning with no language model did you delete the line LM0= 0.5 too? On 13/01/16 13:53, Read, James C wrote: The following command works fine for when a language model is specified. Deleting the line KENLM lazyken=0 name=LM0 factor=0

Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Read, James C
get this error without deleting LM0 line. From: Hieu Hoang <hieuho...@gmail.com> Sent: Wednesday, January 13, 2016 1:58 PM To: Read, James C; Moses Support Subject: Re: [Moses-support] Tuning with no language model there lies your problem. There's a weight for

Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Read, James C
The following command works fine for when a language model is specified. Deleting the line KENLM lazyken=0 name=LM0 factor=0 path=/pathtodata/blm.en order=3 causes the script to fail with error: ERROR: Failed to run '/pathtomoses/mosesdecoder/bin/moses -config

Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Read, James C
no From: Hieu Hoang <hieuho...@gmail.com> Sent: Wednesday, January 13, 2016 1:56 PM To: Read, James C; Moses Support Subject: Re: [Moses-support] Tuning with no language model did you delete the line LM0= 0.5 too? On 13/01/16 13:53, Read, James C

Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Hieu Hoang
> -- > *From:* Hieu Hoang <hieuho...@gmail.com> > *Sent:* Wednesday, January 13, 2016 1:58 PM > > *To:* Read, James C; Moses Support > *Subject:* Re: [Moses-support] Tuning with no language model > > there lies your problem. There's a wei

Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Hieu Hoang
:* Hieu Hoang <hieuho...@gmail.com> *Sent:* Wednesday, January 13, 2016 2:05 PM *To:* Read, James C *Cc:* Moses Support *Subject:* Re: [Moses-support] Tuning with no language model please show me the EXACT moses.ini and command that you use. Hieu Hoang http://www.hoang.co.uk/hieu On 13 Januar

Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Hieu Hoang
nesday, January 13, 2016 2:40 PM > *To:* Hieu Hoang > > *Cc:* Moses Support > *Subject:* Re: [Moses-support] Tuning with no language model > > > This is what I get when I run the same command as you: > > > LexicalReordering0= 0.30 0.30 0.30 0.30 0.30

Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Read, James C
Moses Support Subject: Re: [Moses-support] Tuning with no language model you can delete all feature functions except for the UnknownWordPenalty. In the current moses, thats hardcoded into decoding. So be my guest and delete away! Hieu Hoang http://www.hoang.co.uk/hieu On 13 January 2016 at 15:02

Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Read, James C
3rd_party_software/mosesdecoder/bin/ From: Hieu Hoang <hieuho...@gmail.com><mailto:hieuho...@gmail.com> Sent: Wednesday, January 13, 2016 2:05 PM To: Read, James C Cc: Moses Support Subject: Re: [Moses-support] Tuning with no language model please show me t

Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Read, James C
: Wednesday, January 13, 2016 2:45 PM To: Hieu Hoang Cc: Moses Support Subject: Re: [Moses-support] Tuning with no language model /media/bigdata/jcread/llv/data/europarlv7/raw/aligned/bg-en/training_data$ /media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/mert-moses.pl -no-filter

Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Read, James C
just the TM? From: Hieu Hoang <hieuho...@gmail.com> Sent: Wednesday, January 13, 2016 2:51 PM To: Read, James C Cc: Moses Support Subject: Re: [Moses-support] Tuning with no language model ok. The mert script create a temporary directory every time y

Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Hieu Hoang
ons or completely disable their operation leaving just the > TM? > > > -- > *From:* Hieu Hoang <hieuho...@gmail.com> > *Sent:* Wednesday, January 13, 2016 2:51 PM > > *To:* Read, James C > *Cc:* Moses Support > *Subject:* Re: [Moses-support

Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Read, James C
, 2016 2:05 PM To: Read, James C Cc: Moses Support Subject: Re: [Moses-support] Tuning with no language model please show me the EXACT moses.ini and command that you use. Hieu Hoang http://www.hoang.co.uk/hieu On 13 January 2016 at 14:04, Read, James C <jcr...@essex.ac.uk<mailto:jcr...

Re: [Moses-support] Tuning with no language model

2016-01-13 Thread Matthias Huck
oang <hieuho...@gmail.com> > Sent: Wednesday, January 13, 2016 3:05 PM > To: Read, James C > Cc: Moses Support > Subject: Re: [Moses-support] Tuning with no language model > > you can delete all feature functions except for the > UnknownWordPenalty. In the current moses, tha

[Moses-support] tuning failure with language model type unknown

2012-12-19 Thread Ezgi Yildirim
Dear all, I am using moses compiled with srilm library. I compiled moses with ./bjam -- toolset=gcc-4.6.1 --with-srilm=/home/ezgi/tools/srilm -j 32 command. I did not appeal to binarized language model. This is my language file specification in /home/ezgi/working-v1/model/moses.ini file:

Re: [Moses-support] tuning failure with language model type unknown

2012-12-19 Thread ezgi yıldırım
Thanks for quick reply! I had changed the path for a trick, and unfortunately i forgot to revert it. Ezgi On Wed, Dec 19, 2012 at 12:27 PM, Kenneth Heafield mo...@kheafield.comwrote: The moses executable lives in /home/ezgi/mosesdecoder/bin/moses . Please update your command line

Re: [Moses-support] Tuning failure with Language model type unknown.

2009-12-29 Thread Ronan
Hi, It was resolved by removing the lm-binarizer option in the config file. Thanks for your answer, Ronan 2009/12/28 Barry Haddow bhad...@inf.ed.ac.uk: Hi Ronan This is the problem:             ERROR:Language model type unknown. Probably not compiled into library You need to compile with

Re: [Moses-support] Tuning failure with Language model type unknown.

2009-12-28 Thread Barry Haddow
Hi Ronan This is the problem: ERROR:Language model type unknown. Probably not compiled into library You need to compile with irstlm in order to use a binarised language model. See here for instructions: http://www.statmt.org/moses/?n=Development.GetStarted regards Barry On

[Moses-support] Tuning failure with Language model type unknown.

2009-12-27 Thread Ronan
Hello, I am currently trying to train a Moses system, which goes fine until the tuning step. I get the following error : Creating lexical reordering... weights: 0.11 0.11 0.11 0.11 0.11 0.11 binary file loaded, default OFF_T: -1