Hi,

I'm trying to add this line to config:

ttable-binarizer = "$moses-bin-dir/processPhraseTableMin -threads all"

This option is supported by processPhraseTableMin
command(https://github.com/moses-smt/mosesdecoder/blob/master/misc/processPh
raseTableMin.cpp line 24).

/home/moses/src/mosesdecoder/scripts/training/binarize-model.perl
/home/moses/working/experiments/model/moses.ini.1 /home/mose
s/working/experiments/model/moses.bin.ini.3 -Binarizer
/home/moses/src/mosesdecoder/bin/processPhraseTableMin -threads all

But it produces error "Unknown option: threads" in file
TRAINING_binarize-config.3.STDERR (and stops training).

I removed this option but it seems that such case it uses only one thread:

moses     1470  113 10.8 4255200 3448392 pts/13 Sl  11:05  66:03
/home/moses/src/mosesdecoder/bin/processPhraseTableMin -in
/home/moses/working/experiments/model/moses.bin.ini.5.tables/phrase-table.0-
0.1.1.gz.sorted -out
/home/moses/working/experiments/model/moses.bin.ini.5.tables/phrase-table.0-
0.1.1 -nscores 4 -threads 1

I know that my server is able to run around 16 threads (and indeed does
during former steps).

What can I do to improve this step to use more threads?

Regards,
TG



_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to