Re: [Moses-support] manual: 3.2.1 Train an unfactored model

2014-03-11 Thread Massinissa Ahmim
Hi Peter,

There is obviously an issue with your training data, have you used
the proj-syndicate corpora? if so please paste here your training command
I'd be interested to see that.

Regards

M


2014-03-11 19:25 GMT+01:00 Peter Kleiweg p.c.j.klei...@rug.nl:


 Hi,

 From the manual: http://www.statmt.org/moses/manual/manual.pdf

 I have run the example from part 3.2.1, page 64, to create
 unfactored/model/moses.ini

 At the bottom of page 67 is this example:

 moses -f unfactored/model/moses.ini  in -d 0.2

 The file 'in' contains:

 menschen beschreibt putin .

 (The -d 0.2 causes an error in all examples, so I leave that out)


 I get an error:

 Exception: moses/Word.cpp:112 in void
 Moses::Word::CreateFromString(Moses::FactorDirection, const
 std::vectorlong unsigned int, const StringPiece, bool) threw
 StrayFactorException because `fit'.
 You have configured 1 factors but the word !|!|. contains factor
 delimiter | too many times.

 What is wrong, and how do I fix this?

 All other examples in section 3.2 work OK.


 I have moses built with both IRSTLM and SRILM.


 --
 Peter Kleiweg
 http://pkleiweg.home.xs4all.nl/
 ___
 Moses-support mailing list
 Moses-support@mit.edu
 http://mailman.mit.edu/mailman/listinfo/moses-support




-- 

[image: Description : Description : lingua_custodia_final full logo]

 *The Translation Trustee*

*1, Place Charles de Gaulle*

*78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23   Mobile : +33 7 61 44 40 84*

*Email :*  *massinissa.ah...@linguacustodia.com
massinissa.ah...@linguacustodia.com*

*Website :*  *www.linguacustodia.com http://www.linguacustodia.com/ -
www.thetranslationtrustee.com  http://www.thetranslationtrustee.com*

ü Pensez à l'environnement, n'imprimez ce courriel que si nécessaire.

Please do not print this email unless it is absolutely necessary. Spread
environmental awareness.
inline: image001.jpg___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] manual: 3.2.1 Train an unfactored model

2014-03-11 Thread Peter Kleiweg
Massinissa Ahmim schreef op de 11e dag van de lentemaand van het jaar 2014:

 Hi Peter,
 
 There is obviously an issue with your training data, have you used
 the proj-syndicate corpora? if so please paste here your training command
 I'd be interested to see that.

I have data downloaded from here: 
http://www.statmt.org/moses/download/factored-corpus.tgz


This is the training command:

train-model.perl \
  --root-dir unfactored \
  --corpus factored-corpus/proj-syndicate \
  --f de --e en \
  --lm 0:3:/net/aistaff/kleiweg/moses/test/factored-corpus/surface.lm:0 \
  --external-bin-dir /net/aps/64/opt/moses/giza-pp/bin \
training.out \
   2 training.err 

 
 Regards
 
 M
 
 
 2014-03-11 19:25 GMT+01:00 Peter Kleiweg p.c.j.klei...@rug.nl:
 
 
  Hi,
 
  From the manual: http://www.statmt.org/moses/manual/manual.pdf
 
  I have run the example from part 3.2.1, page 64, to create
  unfactored/model/moses.ini
 
  At the bottom of page 67 is this example:
 
  moses -f unfactored/model/moses.ini  in -d 0.2
 
  The file 'in' contains:
 
  menschen beschreibt putin .
 
  (The -d 0.2 causes an error in all examples, so I leave that out)
 
 
  I get an error:
 
  Exception: moses/Word.cpp:112 in void
  Moses::Word::CreateFromString(Moses::FactorDirection, const
  std::vectorlong unsigned int, const StringPiece, bool) threw
  StrayFactorException because `fit'.
  You have configured 1 factors but the word !|!|. contains factor
  delimiter | too many times.
 
  What is wrong, and how do I fix this?
 
  All other examples in section 3.2 work OK.
 
 
  I have moses built with both IRSTLM and SRILM.




-- 
Peter Kleiweg
http://pkleiweg.home.xs4all.nl/
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] manual: 3.2.1 Train an unfactored model

2014-03-11 Thread Tom Hoar
Shouldn't the moses option come before the  redirection like this?

moses -d 0.2 -f unfactored/model/moses.ini  in


On 03/12/2014 01:46 AM, Peter Kleiweg wrote:
 moses -f unfactored/model/moses.ini  in -d 0.2

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support