回复： [Moses-support] Question 2 in reordering table file
Sorry, Philipp I made a mistake. The mail should be Fong Puichi: fongpui...@yahoo.com.hk Name: Liang Tian (田亮) Lab: Natural Language Processing& Portuguese Chinese Machine Translation Laboratory (澳门大学中葡机器翻译实验室NLP2CT) Email: tianliang0...@yahoo.com.cn Phone: (853)62059782 (+86)18676421801 发件人： 亮 田 收件人： Philipp Koehn 抄送： "moses-support@mit.edu" 发送日期： 2012年4月15日, 星期日, 下午 5:09 主题: 回复： [Moses-support] Question 2 in reordering table file Dear Fong Puichi, As Philipp had said, your first file is a word alignment file ( the file name shoul be named as grow-diag-final-and), which is not a reordering model file. If you want to know more about it, you can run the nine training steps one by one with the parameter --first-step --last-step. The word alignment file will be generated in the third step(--first-step 1 --last-step 3). By the way, the Moses version is not the newest one (version 2010-8-13) , the document I have given to you is only an reference about the Moses installation. You can download the newest version with the following command: git clone git://github.com/moses-smt/mosesdecoder.git After you have the source package, you can install it with the following similar command: ./bjam --with-srilm==/path/to/srilm --with-irstlm=/path/to/irstlm --with-giza=/path/to/giza One example is: /usr/local/bin/bjam --with-srilm=/home/tianliang/research/srilm --with-irstlm=/usr/local/irstlm --with-giza=/home/tianliang/research/giza-pp/bin --with-xmlrpc-c=/usr/ Note that there are three files in the directory of "/home/tianliang/research/giza-pp/bin/": GIZA++, mkcls, snt2cooc.out The installation details can refer to the step-by-step manual: http://www.statmt.org/moses_steps.html Finally, all the executable files are located in ~/dist/bin/, such as Moses, Mosesserver and processPhraseTable Note again: the file path I have shown you contains my user name (tianliang), there is no need to name the same user name in you own system! Name: Liang Tian (田亮) Lab: Natural Language Processing& Portuguese Chinese Machine Translation Laboratory (澳门大学中葡机器翻译实验室NLP2CT) Email: tianliang0...@yahoo.com.cn Phone: (853)62059782 (+86)18676421801 发件人： Philipp Koehn 收件人： Fong Po Po 抄送： Moses 发送日期： 2012年4月13日, 星期五, 上午 11:16 主题: Re: [Moses-support] Question 2 in reordering table file Hi, the first file looks like a word alignment file. Also: you are using train-factored-phrase-model.perl which indicates that you are using a very old version of Moses. Please check out the latest release from the git repository. -phi On Thu, Apr 12, 2012 at 5:51 PM, Fong Po Po wrote: Dear all: > > When I type this command to run Moses: > >/train-factored-phrase- model.perl --scripts-root-dir $SCRIPTS_ROOTDIR >--corpus /home/tianliang/mosesdecoder/corpus/clean --f eng --e chn --alignment >grow-diag-final-and -reordering msd-bidirectional-fe –lm >0:5:/home/tianliang/mosesdecoder/corpus/chinese.gz:0 > > and get one reordering table file which is the binary file > like this: > >0-0 1-1 2-2 3-2 4-2 5-2 6-3 >0-0 1-1 2-2 3-3 4-4 >0-0 1-1 2-2 3-2 4-3 6-3 7-3 8-3 9-3 5-4 4-5 4-6 4-7 4-8 >3-0 1-1 2-1 4-2 0-3 5-5 6-8 >0-0 1-1 2-1 3-1 4-1 5-1 6-2 >0-0 3-1 1-2 2-2 3-2 3-3 4-4 >0-0 1-1 2-2 3-3 4-4 5-5 6-6 7-7 8-8 9-9 > > but when I type >command:moses-scripts/scripts-20091014-1938/training/train-factored-phrase-model.perl > -scripts-root-dir moses-scripts/scripts-20091014-1938/ -root-dir work -corpus >work/corpus/sample -f chinese -e en -alignment grow-diag-final-and -reordering >msd-bidirectional-fe -lm 0:2:/work/lm/sample.lm >& work/training02.out & >[1] 5400 > > and get one reordering file: > > 一個 ||| a ||| 0.538462 0.0769231 0.384615 0.846154 0.0769231 0.0769231 > 一個 ||| an ||| 0.692308 0.0769231 0.230769 0.846154 0.0769231 0.0769231 > > Why the format of these two reordering file are different? > Thanks! > >Best Regards, >Fong Pui Chi >___ >Moses-support mailing list >Moses-support@mit.edu >http://mailman.mit.edu/mailman/listinfo/moses-sup
回复： [Moses-support] Question 2 in reordering table file
Dear Fong Puichi, As Philipp had said, your first file is a word alignment file ( the file name shoul be named as grow-diag-final-and), which is not a reordering model file. If you want to know more about it, you can run the nine training steps one by one with the parameter --first-step --last-step. The word alignment file will be generated in the third step(--first-step 1 --last-step 3). By the way, the Moses version is not the newest one (version 2010-8-13) , the document I have given to you is only an reference about the Moses installation. You can download the newest version with the following command: git clone git://github.com/moses-smt/mosesdecoder.git After you have the source package, you can install it with the following similar command: ./bjam --with-srilm==/path/to/srilm --with-irstlm=/path/to/irstlm --with-giza=/path/to/giza One example is: /usr/local/bin/bjam --with-srilm=/home/tianliang/research/srilm --with-irstlm=/usr/local/irstlm --with-giza=/home/tianliang/research/giza-pp/bin --with-xmlrpc-c=/usr/ Note that there are three files in the directory of "/home/tianliang/research/giza-pp/bin/": GIZA++, mkcls, snt2cooc.out The installation details can refer to the step-by-step manual: http://www.statmt.org/moses_steps.html Finally, all the executable files are located in ~/dist/bin/, such as Moses, Mosesserver and processPhraseTable Note again: the file path I have shown you contains my user name (tianliang), there is no need to name the same user name in you own system! Name: Liang Tian (田亮) Lab: Natural Language Processing& Portuguese Chinese Machine Translation Laboratory (澳门大学中葡机器翻译实验室NLP2CT) Email: tianliang0...@yahoo.com.cn Phone: (853)62059782 (+86)18676421801 发件人： Philipp Koehn 收件人： Fong Po Po 抄送： Moses 发送日期： 2012年4月13日, 星期五, 上午 11:16 主题: Re: [Moses-support] Question 2 in reordering table file Hi,the first file looks like a word alignment file.Also: you are using train-factored-phrase-model.perl which indicates that you areusing a very old version of Moses. Please check out the latest release from the git repository.-phi On Thu, Apr 12, 2012 at 5:51 PM, Fong Po Po wrote: Dear all: > > When I type this command to run Moses: > >/train-factored-phrase- model.perl --scripts-root-dir $SCRIPTS_ROOTDIR >--corpus /home/tianliang/mosesdecoder/corpus/clean --f eng --e chn --alignment >grow-diag-final-and -reordering msd-bidirectional-fe –lm >0:5:/home/tianliang/mosesdecoder/corpus/chinese.gz:0 > > and get one reordering table file which is the binary file > like this: > >0-0 1-1 2-2 3-2 4-2 5-2 6-3 >0-0 1-1 2-2 3-3 4-4 >0-0 1-1 2-2 3-2 4-3 6-3 7-3 8-3 9-3 5-4 4-5 4-6 4-7 4-8 >3-0 1-1 2-1 4-2 0-3 5-5 6-8 >0-0 1-1 2-1 3-1 4-1 5-1 6-2 >0-0 3-1 1-2 2-2 3-2 3-3 4-4 >0-0 1-1 2-2 3-3 4-4 5-5 6-6 7-7 8-8 9-9 > > but when I type >command:moses-scripts/scripts-20091014-1938/training/train-factored-phrase-model.perl > -scripts-root-dir moses-scripts/scripts-20091014-1938/ -root-dir work -corpus >work/corpus/sample -f chinese -e en -alignment grow-diag-final-and -reordering >msd-bidirectional-fe -lm 0:2:/work/lm/sample.lm >& work/training02.out & >[1] 5400 > > and get one reordering file: > > 一個 ||| a ||| 0.538462 0.0769231 0.384615 0.846154 0.0769231 0.0769231 > 一個 ||| an ||| 0.692308 0.0769231 0.230769 0.846154 0.0769231 0.0769231 > > Why the format of these two reordering file are different? > Thanks! > >Best Regards, >Fong Pui Chi >___ >Moses-support mailing list >Moses-support@mit.edu >http://mailman.mit.edu/mailman/listinfo/moses-support > > ___Moses-support mailing > listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support >___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Question 2 in reordering table file
Hi, the first file looks like a word alignment file. Also: you are using train-factored-phrase-model.perl which indicates that you are using a very old version of Moses. Please check out the latest release from the git repository. -phi On Thu, Apr 12, 2012 at 5:51 PM, Fong Po Po wrote: > Dear all: > >When I type this command to run Moses: > > > */train-factored-phrase- model.perl --scripts-root-dir $SCRIPTS_ROOTDIR > --corpus /home/tianliang/mosesdecoder/corpus/clean --f eng --e chn > --alignment grow-diag-final-and -reordering msd-bidirectional-fe –lm > 0:5:/home/tianliang/mosesdecoder/corpus/chinese.gz:0 * > >and get one reordering table file which is the binary file > like this: > > > 0-0 1-1 2-2 3-2 4-2 5-2 6-3 > > 0-0 1-1 2-2 3-3 4-4 > > 0-0 1-1 2-2 3-2 4-3 6-3 7-3 8-3 9-3 5-4 4-5 4-6 4-7 4-8 > > 3-0 1-1 2-1 4-2 0-3 5-5 6-8 > > 0-0 1-1 2-1 3-1 4-1 5-1 6-2 > > 0-0 3-1 1-2 2-2 3-2 3-3 4-4 > 0-0 1-1 2-2 3-3 4-4 5-5 6-6 7-7 8-8 9-9 > >but when I type command: > > moses-scripts/scripts-20091014-1938/training/train-factored-phrase-model.perl > -scripts-root-dir moses-scripts/scripts-20091014-1938/ -root-dir work > -corpus work/corpus/sample -f chinese -e en -alignment grow-diag-final-and > -reordering msd-bidirectional-fe -lm 0:2:/work/lm/sample.lm >& > work/training02.out & > [1] 5400 > > >and get one reordering file: > >一個 ||| a ||| 0.538462 0.0769231 0.384615 0.846154 0.0769231 > 0.0769231 >一個 ||| an ||| 0.692308 0.0769231 0.230769 0.846154 0.0769231 > 0.0769231 > >Why the format of these two reordering file are different? >Thanks! > > Best Regards, > Fong Pui Chi > > > ___ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support > > ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
[Moses-support] Question 2 in reordering table file
Dear all: When I type this command to run Moses: /train-factored-phrase- model.perl --scripts-root-dir $SCRIPTS_ROOTDIR --corpus /home/tianliang/mosesdecoder/corpus/clean --f eng --e chn --alignment grow-diag-final-and -reordering msd-bidirectional-fe –lm 0:5:/home/tianliang/mosesdecoder/corpus/chinese.gz:0 and get one reordering table file which is the binary file like this: 0-0 1-1 2-2 3-2 4-2 5-2 6-3 0-0 1-1 2-2 3-3 4-4 0-0 1-1 2-2 3-2 4-3 6-3 7-3 8-3 9-3 5-4 4-5 4-6 4-7 4-8 3-0 1-1 2-1 4-2 0-3 5-5 6-8 0-0 1-1 2-1 3-1 4-1 5-1 6-2 0-0 3-1 1-2 2-2 3-2 3-3 4-4 0-0 1-1 2-2 3-3 4-4 5-5 6-6 7-7 8-8 9-9 but when I type command: moses-scripts/scripts-20091014-1938/training/train-factored-phrase-model.perl -scripts-root-dir moses-scripts/scripts-20091014-1938/ -root-dir work -corpus work/corpus/sample -f chinese -e en -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:2:/work/lm/sample.lm >& work/training02.out & [1] 5400 and get one reordering file: 一個 ||| a ||| 0.538462 0.0769231 0.384615 0.846154 0.0769231 0.0769231 一個 ||| an ||| 0.692308 0.0769231 0.230769 0.846154 0.0769231 0.0769231 Why the format of these two reordering file are different? Thanks! Best Regards, Fong Pui Chi___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
