[Moses-support] Boost problem compiling Moses

2012-09-03 Thread Lane Schwartz
I'm trying to compile Moses on Mac OS X. I installed Boost using fink.
I get the following error message:

Failed to run bash -c g++  -dM -x c++ -E /dev/null -include
boost/version.hpp 2/dev/null |grep '#define BOOST_'
Boost does not seem to be installed or g++ is confused.

Any ideas?

Thanks,
Lane
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Boost problem compiling Moses

2012-09-03 Thread Kenneth Heafield
Hi Lane,

Try running

g++  -dM -x c++ -E /dev/null -include boost/version.hpp

That should help you figure out how your Boost install is insufficient. 
  Missing Boost variables?

Kenneth

On 09/03/12 15:56, Lane Schwartz wrote:
 I'm trying to compile Moses on Mac OS X. I installed Boost using fink.
 I get the following error message:

 Failed to run bash -c g++  -dM -x c++ -E /dev/null -include
 boost/version.hpp 2/dev/null |grep '#define BOOST_'
 Boost does not seem to be installed or g++ is confused.

 Any ideas?

 Thanks,
 Lane
 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Boost problem compiling Moses

2012-09-03 Thread Lane Schwartz
That works!


On Mon, Sep 3, 2012 at 4:12 PM, Christian Federmann cfederm...@dfki.de wrote:
 Hi Lane, all,

 I added some bits to make Moses work with MacPorts installed versions of 
 Boost.

 This _could_ also work for fink (adapt the /path/to/macports bit).

 See the BUILD-INSTRUCTIONS.txt section on options:

 --with-macports=/path/to/macports use MacPorts on Mac OS X.

 Cheers,
Christian



 On Sep 3, 2012, at 4:56 PM, Lane Schwartz wrote:

 I'm trying to compile Moses on Mac OS X. I installed Boost using fink.
 I get the following error message:

 Failed to run bash -c g++  -dM -x c++ -E /dev/null -include
 boost/version.hpp 2/dev/null |grep '#define BOOST_'
 Boost does not seem to be installed or g++ is confused.

 Any ideas?

 Thanks,
 Lane
 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support




 --
 Dipl.-Inf. Christian Federmann, Researcher, Language Technology Lab
 Office +1.09 -- Phone +49-681/857-75-5353,  Fax +49-681/857-75-5338
 DFKI GmbH,  Campus D3 2,  Stuhlsatzenhausweg 3,  66123 Saarbruecken
 http://www.dfki.de/~cfedermann

 ---
 Deutsches Forschungszentrum fuer Kuenstliche Intelligenz GmbH
 Trippstadter Strasse 122, D-67663 Kaiserslautern, Germany
 Geschaeftsfuehrung:
 Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender)
 Dr. Walter Olthoff
 Vorsitzender des Aufsichtsrats:
 Prof. Dr. h.c. Hans A. Aukes
 Amtsgericht Kaiserslautern, HRB 2313
 ---






-- 
When a place gets crowded enough to require ID's, social collapse is not
far away.  It is time to go elsewhere.  The best thing about space travel
is that it made it possible to go elsewhere.
-- R.A. Heinlein, Time Enough For Love
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


[Moses-support] Moses in Eclipse

2012-09-03 Thread Miriam Kaeshammer
Hello,

does anybody of you use Eclipse for coding for Moses? How do you build 
using boost?

As a start, I am using the project files provided in the git-repository 
(in mosesdecoder/contrib/other-builds). For each of the projects, in the 
project properties, I specified
 bjam ${workspace_loc}/mosesdecoder
as the Build command and switched off Generate Makefiles 
automatically. Given the output on the Console tab, this seems to work. 
However, Eclipse itself does still complain about errors (reported in 
the Problems tab), such as unresolved inclusions and functions.

Is there a different way to specify the bjam build process? Do you use 
the provided project files?

Some more infos about my system:
Ubuntu 12.04, Eclipse Indigo 3.7.2 with CDT 8.0.2, recent Moses checkout 
(c639cdbb38c3140454be62f4d88843f0bfa05aa8)

I'd be thankful for any hints/comments.

Best,
Miriam

-- 
Miriam Kaeshammer M.Sc.
Institut fuer Sprache und Information
Heinrich-Heine-Universitaet Duesseldorf
http://user.phil-fak.uni-duesseldorf.de/~kaeshammer/

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


[Moses-support] sigtest-filter directory

2012-09-03 Thread Jonathan Clark
Hi all,

The Moses wiki lists the path of the phrase table pruner as
sigtest-filter, but it's now been moved to contrib/sigtest-filter.

1) Could someone change this on the wiki or could I get access to do it myself?
2) Given that the documentation has collected a bit of dust, should I
still expect the pruner to work?

Thanks,
Jon
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Boost problem compiling Moses

2012-09-03 Thread Christian Federmann
Glad to hear that, Lane :)

Best,
   Chris







Lane Schwartz dowob...@gmail.com hat am 3. September 2012 um 17:55
geschrieben:

 That works!


 On Mon, Sep 3, 2012 at 4:12 PM, Christian Federmann cfederm...@dfki.de
 wrote:
  Hi Lane, all,
 
  I added some bits to make Moses work with MacPorts installed versions of
  Boost.
 
  This _could_ also work for fink (adapt the /path/to/macports bit).
 
  See the BUILD-INSTRUCTIONS.txt section on options:
 
  --with-macports=/path/to/macports use MacPorts on Mac OS X.
 
  Cheers,
 Christian
 
 
 
  On Sep 3, 2012, at 4:56 PM, Lane Schwartz wrote:
 
  I'm trying to compile Moses on Mac OS X. I installed Boost using fink.
  I get the following error message:
 
  Failed to run bash -c g++  -dM -x c++ -E /dev/null -include
  boost/version.hpp 2/dev/null |grep '#define BOOST_'
  Boost does not seem to be installed or g++ is confused.
 
  Any ideas?
 
  Thanks,
  Lane
  ___
  Moses-support mailing list
  Moses-support@mit.edu
  http://mailman.mit.edu/mailman/listinfo/moses-support
 
 
 
 
  --
  Dipl.-Inf. Christian Federmann, Researcher, Language Technology Lab
  Office +1.09 -- Phone +49-681/857-75-5353,  Fax +49-681/857-75-5338
  DFKI GmbH,  Campus D3 2,  Stuhlsatzenhausweg 3,  66123 Saarbruecken
  http://www.dfki.de/~cfedermann
 
  ---
  Deutsches Forschungszentrum fuer Kuenstliche Intelligenz GmbH
  Trippstadter Strasse 122, D-67663 Kaiserslautern, Germany
  Geschaeftsfuehrung:
  Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender)
  Dr. Walter Olthoff
  Vorsitzender des Aufsichtsrats:
  Prof. Dr. h.c. Hans A. Aukes
  Amtsgericht Kaiserslautern, HRB 2313
  ---
 
 
 



 --
 When a place gets crowded enough to require ID's, social collapse is not
 far away.  It is time to go elsewhere.  The best thing about space travel
 is that it made it possible to go elsewhere.
 -- R.A. Heinlein, Time Enough For Love
--
Dipl.-Inf. Christian Federmann, Researcher, Language Technology Lab
Office +1.09 -- Phone +49-681/857-75-5353,  Fax +49-681/857-75-5338
DFKI GmbH,  Campus D3 2,  Stuhlsatzenhausweg 3,  66123 Saarbruecken
http://www.dfki.de/~cfedermann

---
Deutsches Forschungszentrum fuer Kuenstliche Intelligenz GmbH
Trippstadter Strasse 122, D-67663 Kaiserslautern, Germany
Geschaeftsfuehrung:
Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender)
Dr. Walter Olthoff
Vorsitzender des Aufsichtsrats:
Prof. Dr. h.c. Hans A. Aukes
Amtsgericht Kaiserslautern, HRB 2313
---
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


[Moses-support] Questions in http://kheafield.com/code/kenlm/developers/

2012-09-03 Thread Fong Po Po
Dear all: 
 
I have read 
http://kheafield.com/code/kenlm/developers/
 
I see 
wget -O - http://kheafield.com/code/kenlm.tar.gz |tar xz 
cd kenlm
./compile.sh
./query file.arpa text
 
If file.arpa does not exist, we cannot do this command: 
./query file.arpa text
How can we do this command if file.arpa does not exist?
Thanks!
 
Best Regards,
Fong Pui Chi___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


[Moses-support] Dose Moses support binarised translation table for factored model?

2012-09-03 Thread Tan, Jun
Hi all,

I built a factored model following the guideline on Moses web page. In order to 
faster the decoding speed, I’m trying to use the binarised phrase table.
The binaring progress is finished, when trying to decode with the binarised 
phrase table, the translation got failed.  The input and output are the same.
Dose Moses support binarised translation table for factored model? Does anybody 
also meet this issue?
Below are the outputs of the decoding process:

1.decoding with binarised phrase-table:
[root@Redhat-252 binarised-model]# echo 'the_DT' | 
/data/moses/moses-smt-mosesdecoder/bin/moses  -f moses.ini
Defined parameters (per moses.ini or switch):
config: moses.ini
distortion-limit: 6
factor-delimiter: _
input-factors: 0
lmodel-file: 0 0 3 
/data/english-chinese_POS_tag/chinese-lm/english-chinese.lm.cn 0 1 3 
/data/english-chinese_POS_tag/chinese-pos-lm/english-chinese.lm.cn
mapping: 0 T 0
ttable-file: 1 0 0,1 5 
/data/english-chinese_POS_tag/binarised-model/phrase-table
ttable-limit: 20
weight-d: 0.6
weight-l: 0.2500 0.2500
weight-t: 0.20 0.20 0.20 0.20 0.20
weight-w: -1
/data/moses/moses-smt-mosesdecoder/bin
Loading lexical distortion models...have 0 models
Start loading LanguageModel 
/data/english-chinese_POS_tag/chinese-lm/english-chinese.lm.cn : [0.001] seconds
/data/english-chinese_POS_tag/chinese-lm/english-chinese.lm.cn: line 125679: 
warning: non-zero probability for unk in closed-vocabulary LM
Start loading LanguageModel 
/data/english-chinese_POS_tag/chinese-pos-lm/english-chinese.lm.cn : [7.148] 
seconds
/data/english-chinese_POS_tag/chinese-pos-lm/english-chinese.lm.cn: line 46: 
warning: non-zero probability for unk in closed-vocabulary LM
Finished loading LanguageModels : [7.214] seconds
Start loading PhraseTable 
/data/english-chinese_POS_tag/binarised-model/phrase-table : [7.214] seconds
filePath: /data/english-chinese_POS_tag/binarised-model/phrase-table
Finished loading phrase tables : [7.214] seconds
IO from STDOUT/STDIN
Created input-output object : [7.214] seconds
Translating line 0  in thread id 140249033144064
Translating: the

reading bin ttable
size of OFF_T 8
binary phrasefile loaded, default OFF_T: -1
Line 0: Collecting options took 0.000 seconds
Line 0: Search took 0.000 seconds
the
BEST TRANSLATION: the_UNK_UNK_UNK [1]  [total=-111.439] 0.000, -1.000, 
-100.000, -23.206, -26.549, 0.000, 0.000, 0.000, 0.000, 0.000 0-0
Line 0: Translation took 0.894 seconds total

2.Normal decoding

[root@Redhat-252 english-chinese_POS_tag]# echo 'the_DT' | 
/data/moses/moses-smt-mosesdecoder/bin/moses -f train/model/moses.ini
Defined parameters (per moses.ini or switch):
config: train/model/moses.ini
distortion-limit: 6
factor-delimiter: _
input-factors: 0
lmodel-file: 0 0 3 
/data/english-chinese_POS_tag/chinese-lm/english-chinese.lm.cn 0 1 3 
/data/english-chinese_POS_tag/chinese-pos-lm/english-chinese.lm.cn
mapping: 0 T 0
ttable-file: 0 0 0,1 5 
/data/english-chinese_POS_tag/train/model/phrase-table.0-0,1.gz
ttable-limit: 20
weight-d: 0.6
weight-l: 0.2500 0.2500
weight-t: 0.20 0.20 0.20 0.20 0.20
weight-w: -1
/data/moses/moses-smt-mosesdecoder/bin
Loading lexical distortion models...have 0 models
Start loading LanguageModel 
/data/english-chinese_POS_tag/chinese-lm/english-chinese.lm.cn : [0.000] seconds
/data/english-chinese_POS_tag/chinese-lm/english-chinese.lm.cn: line 125679: 
warning: non-zero probability for unk in closed-vocabulary LM
Start loading LanguageModel 
/data/english-chinese_POS_tag/chinese-pos-lm/english-chinese.lm.cn : [4.239] 
seconds
/data/english-chinese_POS_tag/chinese-pos-lm/english-chinese.lm.cn: line 46: 
warning: non-zero probability for unk in closed-vocabulary LM
Finished loading LanguageModels : [4.254] seconds
Start loading PhraseTable 
/data/english-chinese_POS_tag/train/model/phrase-table.0-0,1.gz : [4.254] 
seconds
filePath: /data/english-chinese_POS_tag/train/model/phrase-table.0-0,1.gz
Finished loading phrase tables : [4.254] seconds
Start loading phrase table from 
/data/english-chinese_POS_tag/train/model/phrase-table.0-0,1.gz : [4.254] 
seconds
Reading /data/english-chinese_POS_tag/train/model/phrase-table.0-0,1.gz
5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100

Finished loading phrase tables : [422.886] seconds
IO from STDOUT/STDIN
Created input-output object : [422.895] seconds
Translating line 0  in thread id 139991742867200
Translating: the

Line 0: Collecting options took 0.061 seconds
Line 0: Search took 0.185 seconds
在
BEST TRANSLATION: 在_P [1]  [total=-6.025] 0.000, -1.000, 0.000, -12.496, 
-9.723, -1.545, -1.590, -2.312, -2.906, 1.000
Line 0: Translation took 0.247 seconds total