Hello,

I am going thru the steps described in the baseline system instructions.  I
have no problems until the very end when I try to filter out the test data
from the binarised model.



Here is the step in the instructions where the error appears:

*The model that we've trained can then be filtered for this test set,
meaning that we only retain the entries needed translate the test set. This
will make the translation a lot faster.*



*cd ~/working*

*~/mosesdecoder/scripts/training/filter-model-given-input.pl
<http://filter-model-given-input.pl> filtered-newstest2011
mert-work/moses.ini ~/corpus/newstest2011.true.fr
<http://newstest2011.true.fr> -Binarizer
~/mosesdecoder/bin/processPhraseTableMin*



Here is the error message:

*Can't open '< /home/steve/working/binarised-model/reordering-table' at
/home/steve/mosesdecoder/scripts/training/filter-model-given-input.pl
<http://filter-model-given-input.pl> line 439.*



Keep in mind the following:

   - I compiled moses with the following parameters.  It is the same
   compilation.  I did not recompile moses at any point during the process.
   ./bjam -a --with-boost=/home/steve/mosesdecoder/boost_1_55_0
   --with-cmph=$HOME/mosesdecoder/cmph/cmph-2.0
   NOTE: I did try recompiling with the absolute path for cmph.  Same error.
   - I checked all paths first to make sure they exist.
   - I am able to translate segments using the binarised model with no
   problem
   - I provided my moses.ini file below.

Questions:

   - Can I recompile moses after training and/or tuning, and expect that it
   should work for testing?  I ask because I want to know if the solution is
   to modify the compile options, do I have to start from scratch again?  (Can
   you filter a binarised model using moses with different compile options
   that were used to train the model?)

Thanks,
Steve


Moses.ini file

# MERT optimized configuration

# decoder /home/steve/mosesdecoder/bin/moses

# BLEU 0.18611 on dev /home/steve/corpus/news-test2008.true.fr

# We were before running iteration 5

# finished Thu Sep 15 01:53:22 PDT 2016

### MOSES CONFIG FILE ###

#########################


# input factors

[input-factors]

0


# mapping steps

[mapping]

0 T 0


[distortion-limit]

6


# feature functions

[feature]

UnknownWordPenalty

WordPenalty

PhrasePenalty

PhraseDictionaryCompact name=TranslationModel0 num-features=4
path=/home/steve/working/binarised-model/phrase-table.minphr input-factor=0
output-factor=0

LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/steve/working/binarised-model/reordering-table

Distortion

KENLM name=LM0 factor=0 path=/home/steve/lm/news-commentary-v8.fr-en.blm.en
order=3


# dense weights for feature functions


[threads]

4

[weight]


LexicalReordering0= 0.0760973 0.0426988 0.0872591 0.0872621 0.0141898
0.0348721

Distortion0= 0.0721205

LM0= 0.0908638

WordPenalty0= -0.153776

PhrasePenalty0= 0.0874059

TranslationModel0= 0.0162038 0.0871216 0.0687163 0.0814132

UnknownWordPenalty0= 1
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to