Re: [Moses-support] Error in running BLEU score evaluation

2011-05-23 Thread Philipp Koehn
Hi, please check the original version of the tool for documentation: ftp://jaguar.ncsl.nist.gov/mt/resources/mteval-v13a-20091001.tar.gz -phi On Tue, May 24, 2011 at 5:29 AM, nakul sharma wrote: > Hi All, > > I am trying to run BLEU score evaluation of translation carried out by moses > softwar

[Moses-support] Error in running BLEU score evaluation

2011-05-23 Thread nakul sharma
Hi All, I am trying to run BLEU score evaluation of translation carried out by moses software. I am using NIST tool for this as mentioned in the moses step-by-step guide available online. I am stuck at the following command of wrapping the output English sentences into the XML format. Comman

Re: [Moses-support] KenLM support for high order values

2011-05-23 Thread Tom Hoar
Thanks. If I change the value to something like 12, how does this affect the overall memory requirements/allocation for the State object? I.e. if I compile with kMaxOrder = 12, and use Kenlm for a model with order = 6, is more memory required/allocated and if so, how much? Or, does the a

Re: [Moses-support] Erratic IRSTLM compile failures

2011-05-23 Thread Tom Hoar
Note: I reverted to the irstlm-5.60.02.tgz tarball and the problem disappeared. I'll use this revision for now. Tom On Tue, 24 May 2011 09:09:49 +0700, Tom Hoar wrote: We're updating DoMY with the newest Moses components. Our IRLSTM installation script includes this: cpus=`grep -c "^pro

[Moses-support] Erratic IRSTLM compile failures

2011-05-23 Thread Tom Hoar
We're updating DoMY with the newest Moses components. Our IRLSTM installation script includes this: cpus=`grep -c "^processor" /proc/cpuinfo` export MACHTYPE=`uname -m` export LC_ALL=C export IRSTLM=/usr/src/irstlm ./regenerate-makefiles.sh &>>"$log" ./configure --prefix=$IRSTLM --enable-cachin

Re: [Moses-support] Beam thresholding

2011-05-23 Thread Philipp Koehn
Hi, you should make it smaller (e.g., 0.1f). Hypotheses whose score is worse than the best in a stack by this factor are dropped. -phi On Mon, May 23, 2011 at 7:50 PM, Lane Schwartz wrote: > I'm trying to understand how to set the beam-threshold parameter. The > default value is 0.

Re: [Moses-support] Yet another problem with Boost.

2011-05-23 Thread Barry Haddow
Hi Simon The log files came through ok. I don't really know what's going on. configure finds your boost thread library and sets the paths correctly, but for some reason when the moses build uses these paths, it fails. Maybe there's something wrong with your boost thread lib? Try running nm -C

Re: [Moses-support] KenLM support for high order values

2011-05-23 Thread Kenneth Heafield
Edit kenlm/lm/max_order.hh and recompile. The reason is to minimize the size of the State object held by each hypothesis while avoiding dynamic memory allocation. On 05/23/11 15:39, Tom Hoar wrote: > I use KenLM's build_binary for language models. There are no problems > order values up to 6 gram

Re: [Moses-support] What happened to --with-boost-libdir?

2011-05-23 Thread Barry Haddow
Hi Lane That's puzzling. It works when I set --with but not --enable. That is a slightly odd combination - you are telling moses where boost is but you don't want it to use it - but it shouldn't cause a compile error. I fixed a small bug in configure.in which meant that threading was always on.

[Moses-support] KenLM support for high order values

2011-05-23 Thread Tom Hoar
I use KenLM's build_binary for language models. There are no problems order values up to 6 grams. It halts 7 grams with a warning to change a value somewhere to support higher values. I don't have a current log output. Can you share what change to make and where? Thanks. Tom

Re: [Moses-support] What happened to --with-boost-libdir?

2011-05-23 Thread Lane Schwartz
Turns out the solution is to set --enable-boost. Once I do that things configure and compile correctly. In my previous unsuccessful attempts, I must have been setting --with-boost but not --enable boost. Cheers, Lane On Mon, May 23, 2011 at 5:29 AM, Barry Haddow wrote: > Hi Lane > > On our ser

[Moses-support] Beam thresholding

2011-05-23 Thread Lane Schwartz
I'm trying to understand how to set the beam-threshold parameter. The default value is 0.1f. If I want this parameter to prune less, should I make the value large (for example, 0.1) or make it smaller (for example 0.1f)? Thanks, Lane ___ Mos

Re: [Moses-support] Query moses

2011-05-23 Thread Kenneth Heafield
head config.log Not aware of e.g. a runtime query. On 05/23/11 12:48, Barry Haddow wrote: > On Monday 23 May 2011 17:39, Tom Hoar wrote: >> Is there a way to query the moses binary to report what configure >> options were used? i.e. such as which --with-[xxxlm]= > > > No. > > Do you want to kn

Re: [Moses-support] Query moses

2011-05-23 Thread Barry Haddow
On Monday 23 May 2011 17:39, Tom Hoar wrote: > Is there a way to query the moses binary to report what configure > options were used? i.e. such as which --with-[xxxlm]= No. Do you want to know what LM was built in to moses? You can get that information with nm (sort of). nm -C moses-cmd/src/mo

[Moses-support] Query moses

2011-05-23 Thread Tom Hoar
Is there a way to query the moses binary to report what configure options were used? i.e. such as which --with-[xxxlm]= Tom___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Yet another problem with Boost.

2011-05-23 Thread Barry Haddow
Hi Simon According to the attached logs you ran with --with-boost=/home/ilps/smt/software/boost/boost_1_46_1/include for the dynamic configuration, whereas you should use --with-boost=/home/ilps/smt/software/boost/boost_1_46_1 The static logs you sent are empty. You've got another install o

Re: [Moses-support] What happened to --with-boost-libdir?

2011-05-23 Thread Barry Haddow
Hi Lane On our servers the boost libraries are in /usr/lib64 and it works find. Could you run ls -l /usr/lib64/libboost_* and send me the output? cheers - Barry On Monday 23 May 2011 10:25, Barry Haddow wrote: > Hi Lane > > Looking at the macro, it should check /usr/lib64, so I don't know wh

Re: [Moses-support] What happened to --with-boost-libdir?

2011-05-23 Thread Barry Haddow
Hi Lane Looking at the macro, it should check /usr/lib64, so I don't know why it's not finding the boost libraries for you. The usual problem with centos is that it has a very old automake - did you install an up-to-date one? Could you send me your config.log ? cheers - Barry On Friday 20 Ma

[Moses-support] Call for Papers for the Open Source Convention held at the Sixth MT Marathon

2011-05-23 Thread Nicola Bertoldi
(Apologies if you receive multiple copies. Please, distribute it among potentially interested colleagues.) CALL FOR PAPERS: OPEN SOURCE TOOLS FOR MACHINE TRANSLATION The Machine Translation Marathon 2011 is the sixth in a series of events promoted by EuroMatrix and EuroMatrixPlus, which are