don't use relative paths, ie. change filtered-newstest2011 -> /whatever/filtered-newstest2011 mert-work/moses.ini -> /whatever/mert-work/moses.ini
Hieu Hoang http://www.hoang.co.uk/hieu On 16 September 2016 at 05:42, Steve Braich <steveb...@gmail.com> wrote: > Hello, > > I am going thru the steps described in the baseline system instructions. > I have no problems until the very end when I try to filter out the test > data from the binarised model. > > > > Here is the step in the instructions where the error appears: > > *The model that we've trained can then be filtered for this test set, > meaning that we only retain the entries needed translate the test set. This > will make the translation a lot faster.* > > > > *cd ~/working* > > *~/mosesdecoder/scripts/training/filter-model-given-input.pl > <http://filter-model-given-input.pl> filtered-newstest2011 > mert-work/moses.ini ~/corpus/newstest2011.true.fr > <http://newstest2011.true.fr> -Binarizer > ~/mosesdecoder/bin/processPhraseTableMin* > > > > Here is the error message: > > *Can't open '< /home/steve/working/binarised-model/reordering-table' at > /home/steve/mosesdecoder/scripts/training/filter-model-given-input.pl > <http://filter-model-given-input.pl> line 439.* > > > > Keep in mind the following: > > - I compiled moses with the following parameters. It is the same > compilation. I did not recompile moses at any point during the process. > ./bjam -a --with-boost=/home/steve/mosesdecoder/boost_1_55_0 > --with-cmph=$HOME/mosesdecoder/cmph/cmph-2.0 > NOTE: I did try recompiling with the absolute path for cmph. Same > error. > - I checked all paths first to make sure they exist. > - I am able to translate segments using the binarised model with no > problem > - I provided my moses.ini file below. > > Questions: > > - Can I recompile moses after training and/or tuning, and expect that > it should work for testing? I ask because I want to know if the solution > is to modify the compile options, do I have to start from scratch again? > (Can you filter a binarised model using moses with different compile > options that were used to train the model?) > > Thanks, > Steve > > > Moses.ini file > > # MERT optimized configuration > > # decoder /home/steve/mosesdecoder/bin/moses > > # BLEU 0.18611 on dev /home/steve/corpus/news-test2008.true.fr > > # We were before running iteration 5 > > # finished Thu Sep 15 01:53:22 PDT 2016 > > ### MOSES CONFIG FILE ### > > ######################### > > > # input factors > > [input-factors] > > 0 > > > # mapping steps > > [mapping] > > 0 T 0 > > > [distortion-limit] > > 6 > > > # feature functions > > [feature] > > UnknownWordPenalty > > WordPenalty > > PhrasePenalty > > PhraseDictionaryCompact name=TranslationModel0 num-features=4 > path=/home/steve/working/binarised-model/phrase-table.minphr > input-factor=0 output-factor=0 > > LexicalReordering name=LexicalReordering0 num-features=6 > type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 > path=/home/steve/working/binarised-model/reordering-table > > Distortion > > KENLM name=LM0 factor=0 path=/home/steve/lm/news-commentary-v8.fr-en.blm.en > order=3 > > > # dense weights for feature functions > > > [threads] > > 4 > > [weight] > > > LexicalReordering0= 0.0760973 0.0426988 0.0872591 0.0872621 0.0141898 > 0.0348721 > > Distortion0= 0.0721205 > > LM0= 0.0908638 > > WordPenalty0= -0.153776 > > PhrasePenalty0= 0.0874059 > > TranslationModel0= 0.0162038 0.0871216 0.0687163 0.0814132 > > UnknownWordPenalty0= 1 > > > _______________________________________________ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listinfo/moses-support > >
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
