[Moses-support] tuning failure with language model type unknown
Dear all, I am using moses compiled with srilm library. I compiled moses with ./bjam -- toolset=gcc-4.6.1 --with-srilm=/home/ezgi/tools/srilm -j 32 command. I did not appeal to binarized language model. This is my language file specification in /home/ezgi/working-v1/model/moses.ini file: [lmodel-file] 0 0 5 /home/ezgi/working-v1/lm/SETIMES.en-tr.lm I used the following command for tuning step and I got an error message can be seen below (home/ezgi/working-v1/tuning/mert.out file). mosesdecoder/scripts/training/mert-moses.pl /home/ezgi/working- v1/tuning/SETIMES.en-tr.dev.lowercased.en /home/ezgi/working- v1/tuning/SETIMES.en-tr.dev.lowercased.tr /home/ezgi/mosesdecoder/moses- cmd/src/moses /home/ezgi/working-v1/model/moses.ini --working-dir /home/ezgi/working-v1/tuning/mert --mertdir /home/ezgi/mosesdecoder/mert -- rootdir /home/ezgi/mosesdecoder/scripts/ --decoder-flags -v 0 working- v1/tuning/mert.out (home/ezgi/working-v1/tuning/mert.out) Using SCRIPTS_ROOTDIR: /home/ezgi/mosesdecoder/scripts/ filtering the phrase tables... Tue Dec 18 17:11:08 EET 2012 exec: /home/ezgi/mosesdecoder/scripts/training/filter-model-given-input.pl ./filtered /home/ezgi/working-v1/model/moses.ini /home/ezgi/working- v1/tuning/SETIMES.en-tr.dev.lowercased.en Executing: /home/ezgi/mosesdecoder/scripts/training/filter-model-given-input.pl ./filtered /home/ezgi/working-v1/model/moses.ini /home/ezgi/working- v1/tuning/SETIMES.en-tr.dev.lowercased.en filterphrases.out 2 filterphrases.err Asking moses for feature names and values from filtered/moses.ini Executing: /home/ezgi/mosesdecoder/moses-cmd/src/moses -v 0 -config filtered/moses.ini -inputtype 0 -show-weights ./features.list /home/ezgi/mosesdecoder/moses-cmd/src Creating lexical reordering... weights: 0.300 0.300 0.300 0.300 0.300 0.300 Loading table into memory...done. ERROR:Language model type unknown. Probably not compiled into library ERROR:no LM created. We probably don't have it compiled Exit code: 1 Failed to run moses with the config filtered/moses.ini at mosesdecoder/scripts/training/mert-moses.pl line 1169. What can I do to fix this? Thanks in advance, Ezgi ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] tuning failure with language model type unknown
Thanks for quick reply! I had changed the path for a trick, and unfortunately i forgot to revert it. Ezgi On Wed, Dec 19, 2012 at 12:27 PM, Kenneth Heafield mo...@kheafield.comwrote: The moses executable lives in /home/ezgi/mosesdecoder/bin/moses . Please update your command line accordingly. Kenneth On 12/19/12 09:15, Ezgi Yildirim wrote: Dear all, I am using moses compiled with srilm library. I compiled moses with ./bjam -- toolset=gcc-4.6.1 --with-srilm=/home/ezgi/tools/srilm -j 32 command. I did not appeal to binarized language model. This is my language file specification in /home/ezgi/working-v1/model/moses.ini file: [lmodel-file] 0 0 5 /home/ezgi/working-v1/lm/SETIMES.en-tr.lm I used the following command for tuning step and I got an error message can be seen below (home/ezgi/working-v1/tuning/mert.out file). mosesdecoder/scripts/training/mert-moses.pl /home/ezgi/working- v1/tuning/SETIMES.en-tr.dev.lowercased.en /home/ezgi/working- v1/tuning/SETIMES.en-tr.dev.lowercased.tr /home/ezgi/mosesdecoder/moses- cmd/src/moses /home/ezgi/working-v1/model/moses.ini --working-dir /home/ezgi/working-v1/tuning/mert --mertdir /home/ezgi/mosesdecoder/mert -- rootdir /home/ezgi/mosesdecoder/scripts/ --decoder-flags -v 0 working- v1/tuning/mert.out (home/ezgi/working-v1/tuning/mert.out) Using SCRIPTS_ROOTDIR: /home/ezgi/mosesdecoder/scripts/ filtering the phrase tables... Tue Dec 18 17:11:08 EET 2012 exec: /home/ezgi/mosesdecoder/scripts/training/ filter-model-given-input.pl ./filtered /home/ezgi/working-v1/model/moses.ini /home/ezgi/working- v1/tuning/SETIMES.en-tr.dev.lowercased.en Executing: /home/ezgi/mosesdecoder/scripts/training/ filter-model-given-input.pl ./filtered /home/ezgi/working-v1/model/moses.ini /home/ezgi/working- v1/tuning/SETIMES.en-tr.dev.lowercased.en filterphrases.out 2 filterphrases.err Asking moses for feature names and values from filtered/moses.ini Executing: /home/ezgi/mosesdecoder/moses-cmd/src/moses -v 0 -config filtered/moses.ini -inputtype 0 -show-weights ./features.list /home/ezgi/mosesdecoder/moses-cmd/src Creating lexical reordering... weights: 0.300 0.300 0.300 0.300 0.300 0.300 Loading table into memory...done. ERROR:Language model type unknown. Probably not compiled into library ERROR:no LM created. We probably don't have it compiled Exit code: 1 Failed to run moses with the config filtered/moses.ini at mosesdecoder/scripts/training/mert-moses.pl line 1169. What can I do to fix this? Thanks in advance, Ezgi ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Tuning failure with Language model type unknown.
Hi, It was resolved by removing the lm-binarizer option in the config file. Thanks for your answer, Ronan 2009/12/28 Barry Haddow bhad...@inf.ed.ac.uk: Hi Ronan This is the problem: ERROR:Language model type unknown. Probably not compiled into library You need to compile with irstlm in order to use a binarised language model. See here for instructions: http://www.statmt.org/moses/?n=Development.GetStarted regards Barry On Monday 28 Dec 2009 00:34:48 Ronan wrote: Hello, I am currently trying to train a Moses system, which goes fine until the tuning step. I get the following error : Creating lexical reordering... weights: 0.11 0.11 0.11 0.11 0.11 0.11 binary file loaded, default OFF_T: -1 Created lexical orientation reordering ERROR:Language model type unknown. Probably not compiled into library ERROR:no LM created. We probably don't have it compiled Exit code: 1 The decoder died. CONFIG WAS -w 0.00 -lm 0.11 -d 0.11 0.11 0.11 0.11 0.11 0.11 0.11 -tm 0.03 0.02 0.03 0.02 0.00 I have checked the archives of the mailing list, and couldn't find anything to resolve the problem. The language model line in the run1.moses.ini is the following # language models: type(srilm/irstlm), factors, order, file [lmodel-file] 1 0 5 /home/s0678231/disk1/mt-system/lm/europarl.binlm.1 Is anyone able to help with this ? Thanks in advance, Ronan ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Tuning failure with Language model type unknown.
Hi Ronan This is the problem: ERROR:Language model type unknown. Probably not compiled into library You need to compile with irstlm in order to use a binarised language model. See here for instructions: http://www.statmt.org/moses/?n=Development.GetStarted regards Barry On Monday 28 Dec 2009 00:34:48 Ronan wrote: Hello, I am currently trying to train a Moses system, which goes fine until the tuning step. I get the following error : Creating lexical reordering... weights: 0.11 0.11 0.11 0.11 0.11 0.11 binary file loaded, default OFF_T: -1 Created lexical orientation reordering ERROR:Language model type unknown. Probably not compiled into library ERROR:no LM created. We probably don't have it compiled Exit code: 1 The decoder died. CONFIG WAS -w 0.00 -lm 0.11 -d 0.11 0.11 0.11 0.11 0.11 0.11 0.11 -tm 0.03 0.02 0.03 0.02 0.00 I have checked the archives of the mailing list, and couldn't find anything to resolve the problem. The language model line in the run1.moses.ini is the following # language models: type(srilm/irstlm), factors, order, file [lmodel-file] 1 0 5 /home/s0678231/disk1/mt-system/lm/europarl.binlm.1 Is anyone able to help with this ? Thanks in advance, Ronan ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
[Moses-support] Tuning failure with Language model type unknown.
Hello, I am currently trying to train a Moses system, which goes fine until the tuning step. I get the following error : Creating lexical reordering... weights: 0.11 0.11 0.11 0.11 0.11 0.11 binary file loaded, default OFF_T: -1 Created lexical orientation reordering ERROR:Language model type unknown. Probably not compiled into library ERROR:no LM created. We probably don't have it compiled Exit code: 1 The decoder died. CONFIG WAS -w 0.00 -lm 0.11 -d 0.11 0.11 0.11 0.11 0.11 0.11 0.11 -tm 0.03 0.02 0.03 0.02 0.00 I have checked the archives of the mailing list, and couldn't find anything to resolve the problem. The language model line in the run1.moses.ini is the following # language models: type(srilm/irstlm), factors, order, file [lmodel-file] 1 0 5 /home/s0678231/disk1/mt-system/lm/europarl.binlm.1 Is anyone able to help with this ? Thanks in advance, Ronan ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
