Hi All,

 

I'm trying to create compact phrase table during BilingualLM training. It
works fine but there is one moment when process slows down.

 

I set up 18 threads for TRAINING:binarize-config step :

 

ttable-binarizer = "$moses-bin-dir/processPhraseTableMin -threads 18"

 

But one of scripts (filter-model-given-input.pl) adds own default setting
"threads 1" what overrides 18 threads:

 

moses     8081  0.0  0.0  24840  6976 pts/5    SN   11:13   0:00 perl
/home/moses/src/mosesdecoder/scripts/training/binarize-model.perl
/home/moses/working/experiments/EN-PL/BilingualLM/model/moses.ini.1
/home/moses/working/experiments/EN-PL/BilingualLM/model/moses.bin.ini.2
-Binarizer /home/moses/src/mosesdecoder/bin/processPhraseTableMin -threads
18

 

moses     8083  0.0  0.0  20984  7120 pts/5    SN   11:13   0:00 perl
/home/moses/src/mosesdecoder/scripts/training/filter-model-given-input.pl
/home/moses/working/experiments/EN-PL/BilingualLM/model/moses.bin.ini.2.tabl
es /home/moses/working/experiments/EN-PL/BilingualLM/model/moses.ini.1
/dev/null -nofilter -Binarizer
/home/moses/src/mosesdecoder/bin/processPhraseTableMin -threads 18

 

moses    31792  126  2.6 2357912 1996868 pts/5 SNl  13:48  46:44
/home/moses/src/mosesdecoder/bin/processPhraseTableMin -threads 18 -in
/home/moses/working/experiments/EN-PL/BilingualLM/model/moses.bin.ini.2.tabl
es/phrase-table.0-0.1.1.gz.sorted.gz -out
/home/moses/working/experiments/EN-PL/BilingualLM/model/moses.bin.ini.2.tabl
es/phrase-table.0-0.1.1 -nscores 4 -threads 1

 

 

My question is : should it be as it is or I made some error in
configuration?


Regards,

Thomas

 

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to