[Moses-support] mosesv2-decoder-error

2014-02-26 Thread nadeem khan
Hi all; I am getting this error while running decoder with alignment flags: FeatureFunction: UnknownWordPenalty0 start: 9 end: 9 line=PhraseDictionaryMemory input-factor=0 output-factor=0 path=/home/legends/work/hin-eng/f5/model/phrase-table.gz num-features=5 table-limit=20 FeatureFunction: Phra

Re: [Moses-support] tuning (weights, normalization)

2014-02-26 Thread Hieu Hoang
On 25 February 2014 09:57, Jani Dugonik wrote: > Hi, > > I have a few questions about tuning weights. > > a) On statmt website it says: > > "Good values for the weights for phrase translation table (weight-t, > short tm), language model (weight-l, short lm), and reordering model ( > weight-d, sh

Re: [Moses-support] --activate-features in mert-moses.perl not working?

2014-02-26 Thread Hieu Hoang
we should sort out the tuneable/activate feature issue when you get to Edinburgh. They seem to overlap and cause problems if we don't sort it out it may be that we should delete 1 of these options and depend wholly on the other On 26 February 2014 08:17, Rico Sennrich wrote: > On 26.02.2014 0

Re: [Moses-support] Moses training performance

2014-02-26 Thread Andrzej Zydron
Title: Email signature standard Hi Hieu and Barry, Thank you for your replies and suggestions. The Xeon server is completely dedicated to Moses and is running absolutely nothing else, as opp

Re: [Moses-support] ERROR: Can't generate symmetrized alignment file

2014-02-26 Thread cyrine.na...@univ-lorraine.fr
Thank you, Yes le problem is solved by using absolute paths Best Cyrine 2014-02-26 19:37 GMT+01:00 Massinissa Ahmim < massinissa.ah...@linguacustodia.com>: > Use absolute paths to all the scripts, and make sure your parallel files > have the same names but the extension > > > 2014-02-26 18:25 G

Re: [Moses-support] ERROR: Can't generate symmetrized alignment file

2014-02-26 Thread Massinissa Ahmim
Use absolute paths to all the scripts, and make sure your parallel files have the same names but the extension 2014-02-26 18:25 GMT+01:00 cyrine.na...@univ-lorraine.fr < cyrine.na...@gmail.com>: > Thank you > Massinissa > , > > I try to

[Moses-support] Need help in resolving an error in moses installation

2014-02-26 Thread Sampada Dehankar
EXACT command executed : ./bjam --with-srilm=/home/sampada/Documents/Semester_2/CS_712_ADV_NLP/moses1/srilm --with-giza=/home/sampada/Documents/Semester_2/CS_712_ADV_NLP/moses1/bin Please find attached build.log. build.log.tar.gz Description: GNU Zip compressed data ___

Re: [Moses-support] Moses training performance

2014-02-26 Thread Hieu Hoang
Is there any other tasks running on either machines, especially the Xeon? If there is, the comparison is invalid. Other processes may not only hog cpu, but disk io and filesystem cache. To get good comparison, you need to run it twice, 1st to make sure everything is read from disk & in cache, 2nd

Re: [Moses-support] ERROR: Can't generate symmetrized alignment file

2014-02-26 Thread cyrine.na...@univ-lorraine.fr
Thank you Massinissa , I try to do the command that you propose, but it stills the same problem The symal script is in anothe directory.. 2014-02-26 17:46 GMT+01:00 Massinissa Ahmim < massinissa.ah...@linguacustodia.com>: > Hi Cyrine,

Re: [Moses-support] ERROR: Can't generate symmetrized alignment file

2014-02-26 Thread Massinissa Ahmim
Hi Cyrine, Try to run this command instead : ...train-model.perl -corpus /home/corpus/Apprentissage/ train..tok.true.clean.low1 -f en -e fr -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:3:/home/corpus/Apprentissage/FR3GR.lm:8 -external-bin-dir /home/moses/bin" You don't

[Moses-support] ERROR: Can't generate symmetrized alignment file

2014-02-26 Thread cyrine.na...@univ-lorraine.fr
Hello, I try to train phrase model with this command : " train-model.perl -corpus /home/corpus/Apprentissage/train..tok.true.clean.low1 /home/corpus/Apprentissage/train..tok.true.clean.low1 -f en -e fr -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:3:/home/corpus/Apprentis

Re: [Moses-support] Concatenating large files for LM

2014-02-26 Thread Per Tunedal
Oops! Now it works OK. I must have made a typo. I thought the files might be too large to handle with cat. Yours, Per Tunedal On Wed, Feb 26, 2014, at 15:11, Per Tunedal wrote: > > Hi, > I've collected tons of text to estimate a new language model, but ran > into trouble when trying to combine so

[Moses-support] Concatenating large files for LM

2014-02-26 Thread Per Tunedal
Hi, I've collected tons of text to estimate a new language model, but ran into trouble when trying to combine some large files. Eg. if I combine Europarl7 (1 880 000 000 lines) with Wikipedia (15 070 000 000) I get only 15 644 000 lines, and not the expected 16 950 000 lines. I tried: cat /home

[Moses-support] JOB OFFER – Statistical Machine Translation Expert – CDI – Luxembourg

2014-02-26 Thread Riad, Ali
Dear all, Top of Form I allow myself to use this network of experts in the field of machine translation as part of a large project of machine translation at the European Commission in Luxembourg that has started 3,5 years ago. Now that the project is running well and is gaining respectability,

Re: [Moses-support] Moses Compilation error

2014-02-26 Thread priyanka
Thanks Hieu for your reply. I tried compiling moses without srilm, but I am still getting the same error. Can you please suggest any other solution, to resolve this issue. Thanks, Priyanka On 2014-02-25 22:28, Hieu Hoang wrote: > There's a problem with your SRILM library. > > My advise - don't

Re: [Moses-support] --activate-features in mert-moses.perl not working?

2014-02-26 Thread Rico Sennrich
On 26.02.2014 07:24, moses-support-requ...@mit.edu wrote: > Hi Hieu, Rico, > this does not seem to be an issue with the ini-file. It actually works > as well with stand-alone moses. The issue seems to be the mert-moses.pl > script which switches off features that are not returned by the decoder > b

[Moses-support] Moses in server mode

2014-02-26 Thread Sarah Schulz
Hello, I am running Moses in server mode using the python lib xmlrpclib. When I send long messages to Moses, it crashes. I guess it has to do with a limitation of the message size. I could find a possibility to increase the allowed message size for the XML-RPC implementation for C/C++ (which s