Re: [Moses-support] manual: 3.2.1 Train an unfactored model
Hi Peter, There is obviously an issue with your training data, have you used the proj-syndicate corpora? if so please paste here your training command I'd be interested to see that. Regards M 2014-03-11 19:25 GMT+01:00 Peter Kleiweg p.c.j.klei...@rug.nl: Hi, From the manual: http://www.statmt.org/moses/manual/manual.pdf I have run the example from part 3.2.1, page 64, to create unfactored/model/moses.ini At the bottom of page 67 is this example: moses -f unfactored/model/moses.ini in -d 0.2 The file 'in' contains: menschen beschreibt putin . (The -d 0.2 causes an error in all examples, so I leave that out) I get an error: Exception: moses/Word.cpp:112 in void Moses::Word::CreateFromString(Moses::FactorDirection, const std::vectorlong unsigned int, const StringPiece, bool) threw StrayFactorException because `fit'. You have configured 1 factors but the word !|!|. contains factor delimiter | too many times. What is wrong, and how do I fix this? All other examples in section 3.2 work OK. I have moses built with both IRSTLM and SRILM. -- Peter Kleiweg http://pkleiweg.home.xs4all.nl/ ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- [image: Description : Description : lingua_custodia_final full logo] *The Translation Trustee* *1, Place Charles de Gaulle* *78180 Montigny-le-Bretonneux* *Tel : +33 1 30 44 04 23 Mobile : +33 7 61 44 40 84* *Email :* *massinissa.ah...@linguacustodia.com massinissa.ah...@linguacustodia.com* *Website :* *www.linguacustodia.com http://www.linguacustodia.com/ - www.thetranslationtrustee.com http://www.thetranslationtrustee.com* ü Pensez à l'environnement, n'imprimez ce courriel que si nécessaire. Please do not print this email unless it is absolutely necessary. Spread environmental awareness. inline: image001.jpg___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] manual: 3.2.1 Train an unfactored model
Massinissa Ahmim schreef op de 11e dag van de lentemaand van het jaar 2014: Hi Peter, There is obviously an issue with your training data, have you used the proj-syndicate corpora? if so please paste here your training command I'd be interested to see that. I have data downloaded from here: http://www.statmt.org/moses/download/factored-corpus.tgz This is the training command: train-model.perl \ --root-dir unfactored \ --corpus factored-corpus/proj-syndicate \ --f de --e en \ --lm 0:3:/net/aistaff/kleiweg/moses/test/factored-corpus/surface.lm:0 \ --external-bin-dir /net/aps/64/opt/moses/giza-pp/bin \ training.out \ 2 training.err Regards M 2014-03-11 19:25 GMT+01:00 Peter Kleiweg p.c.j.klei...@rug.nl: Hi, From the manual: http://www.statmt.org/moses/manual/manual.pdf I have run the example from part 3.2.1, page 64, to create unfactored/model/moses.ini At the bottom of page 67 is this example: moses -f unfactored/model/moses.ini in -d 0.2 The file 'in' contains: menschen beschreibt putin . (The -d 0.2 causes an error in all examples, so I leave that out) I get an error: Exception: moses/Word.cpp:112 in void Moses::Word::CreateFromString(Moses::FactorDirection, const std::vectorlong unsigned int, const StringPiece, bool) threw StrayFactorException because `fit'. You have configured 1 factors but the word !|!|. contains factor delimiter | too many times. What is wrong, and how do I fix this? All other examples in section 3.2 work OK. I have moses built with both IRSTLM and SRILM. -- Peter Kleiweg http://pkleiweg.home.xs4all.nl/ ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] manual: 3.2.1 Train an unfactored model
Shouldn't the moses option come before the redirection like this? moses -d 0.2 -f unfactored/model/moses.ini in On 03/12/2014 01:46 AM, Peter Kleiweg wrote: moses -f unfactored/model/moses.ini in -d 0.2 ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support