[Moses-support] Boost problem compiling Moses
I'm trying to compile Moses on Mac OS X. I installed Boost using fink. I get the following error message: Failed to run bash -c g++ -dM -x c++ -E /dev/null -include boost/version.hpp 2/dev/null |grep '#define BOOST_' Boost does not seem to be installed or g++ is confused. Any ideas? Thanks, Lane ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Boost problem compiling Moses
Hi Lane, Try running g++ -dM -x c++ -E /dev/null -include boost/version.hpp That should help you figure out how your Boost install is insufficient. Missing Boost variables? Kenneth On 09/03/12 15:56, Lane Schwartz wrote: I'm trying to compile Moses on Mac OS X. I installed Boost using fink. I get the following error message: Failed to run bash -c g++ -dM -x c++ -E /dev/null -include boost/version.hpp 2/dev/null |grep '#define BOOST_' Boost does not seem to be installed or g++ is confused. Any ideas? Thanks, Lane ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Boost problem compiling Moses
That works! On Mon, Sep 3, 2012 at 4:12 PM, Christian Federmann cfederm...@dfki.de wrote: Hi Lane, all, I added some bits to make Moses work with MacPorts installed versions of Boost. This _could_ also work for fink (adapt the /path/to/macports bit). See the BUILD-INSTRUCTIONS.txt section on options: --with-macports=/path/to/macports use MacPorts on Mac OS X. Cheers, Christian On Sep 3, 2012, at 4:56 PM, Lane Schwartz wrote: I'm trying to compile Moses on Mac OS X. I installed Boost using fink. I get the following error message: Failed to run bash -c g++ -dM -x c++ -E /dev/null -include boost/version.hpp 2/dev/null |grep '#define BOOST_' Boost does not seem to be installed or g++ is confused. Any ideas? Thanks, Lane ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Dipl.-Inf. Christian Federmann, Researcher, Language Technology Lab Office +1.09 -- Phone +49-681/857-75-5353, Fax +49-681/857-75-5338 DFKI GmbH, Campus D3 2, Stuhlsatzenhausweg 3, 66123 Saarbruecken http://www.dfki.de/~cfedermann --- Deutsches Forschungszentrum fuer Kuenstliche Intelligenz GmbH Trippstadter Strasse 122, D-67663 Kaiserslautern, Germany Geschaeftsfuehrung: Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender) Dr. Walter Olthoff Vorsitzender des Aufsichtsrats: Prof. Dr. h.c. Hans A. Aukes Amtsgericht Kaiserslautern, HRB 2313 --- -- When a place gets crowded enough to require ID's, social collapse is not far away. It is time to go elsewhere. The best thing about space travel is that it made it possible to go elsewhere. -- R.A. Heinlein, Time Enough For Love ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
[Moses-support] Moses in Eclipse
Hello, does anybody of you use Eclipse for coding for Moses? How do you build using boost? As a start, I am using the project files provided in the git-repository (in mosesdecoder/contrib/other-builds). For each of the projects, in the project properties, I specified bjam ${workspace_loc}/mosesdecoder as the Build command and switched off Generate Makefiles automatically. Given the output on the Console tab, this seems to work. However, Eclipse itself does still complain about errors (reported in the Problems tab), such as unresolved inclusions and functions. Is there a different way to specify the bjam build process? Do you use the provided project files? Some more infos about my system: Ubuntu 12.04, Eclipse Indigo 3.7.2 with CDT 8.0.2, recent Moses checkout (c639cdbb38c3140454be62f4d88843f0bfa05aa8) I'd be thankful for any hints/comments. Best, Miriam -- Miriam Kaeshammer M.Sc. Institut fuer Sprache und Information Heinrich-Heine-Universitaet Duesseldorf http://user.phil-fak.uni-duesseldorf.de/~kaeshammer/ ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
[Moses-support] sigtest-filter directory
Hi all, The Moses wiki lists the path of the phrase table pruner as sigtest-filter, but it's now been moved to contrib/sigtest-filter. 1) Could someone change this on the wiki or could I get access to do it myself? 2) Given that the documentation has collected a bit of dust, should I still expect the pruner to work? Thanks, Jon ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Boost problem compiling Moses
Glad to hear that, Lane :) Best, Chris Lane Schwartz dowob...@gmail.com hat am 3. September 2012 um 17:55 geschrieben: That works! On Mon, Sep 3, 2012 at 4:12 PM, Christian Federmann cfederm...@dfki.de wrote: Hi Lane, all, I added some bits to make Moses work with MacPorts installed versions of Boost. This _could_ also work for fink (adapt the /path/to/macports bit). See the BUILD-INSTRUCTIONS.txt section on options: --with-macports=/path/to/macports use MacPorts on Mac OS X. Cheers, Christian On Sep 3, 2012, at 4:56 PM, Lane Schwartz wrote: I'm trying to compile Moses on Mac OS X. I installed Boost using fink. I get the following error message: Failed to run bash -c g++ -dM -x c++ -E /dev/null -include boost/version.hpp 2/dev/null |grep '#define BOOST_' Boost does not seem to be installed or g++ is confused. Any ideas? Thanks, Lane ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Dipl.-Inf. Christian Federmann, Researcher, Language Technology Lab Office +1.09 -- Phone +49-681/857-75-5353, Fax +49-681/857-75-5338 DFKI GmbH, Campus D3 2, Stuhlsatzenhausweg 3, 66123 Saarbruecken http://www.dfki.de/~cfedermann --- Deutsches Forschungszentrum fuer Kuenstliche Intelligenz GmbH Trippstadter Strasse 122, D-67663 Kaiserslautern, Germany Geschaeftsfuehrung: Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender) Dr. Walter Olthoff Vorsitzender des Aufsichtsrats: Prof. Dr. h.c. Hans A. Aukes Amtsgericht Kaiserslautern, HRB 2313 --- -- When a place gets crowded enough to require ID's, social collapse is not far away. It is time to go elsewhere. The best thing about space travel is that it made it possible to go elsewhere. -- R.A. Heinlein, Time Enough For Love -- Dipl.-Inf. Christian Federmann, Researcher, Language Technology Lab Office +1.09 -- Phone +49-681/857-75-5353, Fax +49-681/857-75-5338 DFKI GmbH, Campus D3 2, Stuhlsatzenhausweg 3, 66123 Saarbruecken http://www.dfki.de/~cfedermann --- Deutsches Forschungszentrum fuer Kuenstliche Intelligenz GmbH Trippstadter Strasse 122, D-67663 Kaiserslautern, Germany Geschaeftsfuehrung: Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender) Dr. Walter Olthoff Vorsitzender des Aufsichtsrats: Prof. Dr. h.c. Hans A. Aukes Amtsgericht Kaiserslautern, HRB 2313 --- ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
[Moses-support] Questions in http://kheafield.com/code/kenlm/developers/
Dear all: I have read http://kheafield.com/code/kenlm/developers/ I see wget -O - http://kheafield.com/code/kenlm.tar.gz |tar xz cd kenlm ./compile.sh ./query file.arpa text If file.arpa does not exist, we cannot do this command: ./query file.arpa text How can we do this command if file.arpa does not exist? Thanks! Best Regards, Fong Pui Chi___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
[Moses-support] Dose Moses support binarised translation table for factored model?
Hi all, I built a factored model following the guideline on Moses web page. In order to faster the decoding speed, I’m trying to use the binarised phrase table. The binaring progress is finished, when trying to decode with the binarised phrase table, the translation got failed. The input and output are the same. Dose Moses support binarised translation table for factored model? Does anybody also meet this issue? Below are the outputs of the decoding process: 1.decoding with binarised phrase-table: [root@Redhat-252 binarised-model]# echo 'the_DT' | /data/moses/moses-smt-mosesdecoder/bin/moses -f moses.ini Defined parameters (per moses.ini or switch): config: moses.ini distortion-limit: 6 factor-delimiter: _ input-factors: 0 lmodel-file: 0 0 3 /data/english-chinese_POS_tag/chinese-lm/english-chinese.lm.cn 0 1 3 /data/english-chinese_POS_tag/chinese-pos-lm/english-chinese.lm.cn mapping: 0 T 0 ttable-file: 1 0 0,1 5 /data/english-chinese_POS_tag/binarised-model/phrase-table ttable-limit: 20 weight-d: 0.6 weight-l: 0.2500 0.2500 weight-t: 0.20 0.20 0.20 0.20 0.20 weight-w: -1 /data/moses/moses-smt-mosesdecoder/bin Loading lexical distortion models...have 0 models Start loading LanguageModel /data/english-chinese_POS_tag/chinese-lm/english-chinese.lm.cn : [0.001] seconds /data/english-chinese_POS_tag/chinese-lm/english-chinese.lm.cn: line 125679: warning: non-zero probability for unk in closed-vocabulary LM Start loading LanguageModel /data/english-chinese_POS_tag/chinese-pos-lm/english-chinese.lm.cn : [7.148] seconds /data/english-chinese_POS_tag/chinese-pos-lm/english-chinese.lm.cn: line 46: warning: non-zero probability for unk in closed-vocabulary LM Finished loading LanguageModels : [7.214] seconds Start loading PhraseTable /data/english-chinese_POS_tag/binarised-model/phrase-table : [7.214] seconds filePath: /data/english-chinese_POS_tag/binarised-model/phrase-table Finished loading phrase tables : [7.214] seconds IO from STDOUT/STDIN Created input-output object : [7.214] seconds Translating line 0 in thread id 140249033144064 Translating: the reading bin ttable size of OFF_T 8 binary phrasefile loaded, default OFF_T: -1 Line 0: Collecting options took 0.000 seconds Line 0: Search took 0.000 seconds the BEST TRANSLATION: the_UNK_UNK_UNK [1] [total=-111.439] 0.000, -1.000, -100.000, -23.206, -26.549, 0.000, 0.000, 0.000, 0.000, 0.000 0-0 Line 0: Translation took 0.894 seconds total 2.Normal decoding [root@Redhat-252 english-chinese_POS_tag]# echo 'the_DT' | /data/moses/moses-smt-mosesdecoder/bin/moses -f train/model/moses.ini Defined parameters (per moses.ini or switch): config: train/model/moses.ini distortion-limit: 6 factor-delimiter: _ input-factors: 0 lmodel-file: 0 0 3 /data/english-chinese_POS_tag/chinese-lm/english-chinese.lm.cn 0 1 3 /data/english-chinese_POS_tag/chinese-pos-lm/english-chinese.lm.cn mapping: 0 T 0 ttable-file: 0 0 0,1 5 /data/english-chinese_POS_tag/train/model/phrase-table.0-0,1.gz ttable-limit: 20 weight-d: 0.6 weight-l: 0.2500 0.2500 weight-t: 0.20 0.20 0.20 0.20 0.20 weight-w: -1 /data/moses/moses-smt-mosesdecoder/bin Loading lexical distortion models...have 0 models Start loading LanguageModel /data/english-chinese_POS_tag/chinese-lm/english-chinese.lm.cn : [0.000] seconds /data/english-chinese_POS_tag/chinese-lm/english-chinese.lm.cn: line 125679: warning: non-zero probability for unk in closed-vocabulary LM Start loading LanguageModel /data/english-chinese_POS_tag/chinese-pos-lm/english-chinese.lm.cn : [4.239] seconds /data/english-chinese_POS_tag/chinese-pos-lm/english-chinese.lm.cn: line 46: warning: non-zero probability for unk in closed-vocabulary LM Finished loading LanguageModels : [4.254] seconds Start loading PhraseTable /data/english-chinese_POS_tag/train/model/phrase-table.0-0,1.gz : [4.254] seconds filePath: /data/english-chinese_POS_tag/train/model/phrase-table.0-0,1.gz Finished loading phrase tables : [4.254] seconds Start loading phrase table from /data/english-chinese_POS_tag/train/model/phrase-table.0-0,1.gz : [4.254] seconds Reading /data/english-chinese_POS_tag/train/model/phrase-table.0-0,1.gz 5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100 Finished loading phrase tables : [422.886] seconds IO from STDOUT/STDIN Created input-output object : [422.895] seconds Translating line 0 in thread id 139991742867200 Translating: the Line 0: Collecting options took 0.061 seconds Line 0: Search took 0.185 seconds 在 BEST TRANSLATION: 在_P [1] [total=-6.025] 0.000, -1.000, 0.000, -12.496, -9.723, -1.545, -1.590, -2.312, -2.906, 1.000 Line 0: Translation took 0.247 seconds total