Hi Massinissa, my commands: ~/mosesdecoder/bin/processPhraseTable \ -ttable 0 0 train/model/Kryptering1.sv-fr.phrase-table.pruned \ -nscores 5 -out train/binarised-model/Kryptering1.sv-fr.phrase-table
~/mosesdecoder/bin/processLexicalTable \ -in train/model/reordering-table.wbe-msd-bidirectional-fe.gz \ -out train/binarised-model/Kryptering1.sv-fr.reordering-table I tried the following changes in moses.ini: # OLD FORMAT a binary table type (1) is assumed [ttable-file] #0 0 0 5 /home/per/working/train/model/phrase-table.gz 0 0 0 5 /home/per/working/train/binarised-model/Kryptering1.sv-fr.phrase-table # distortion (reordering) files [distortion-file] #0-0 wbe-msd-bidirectional-fe-allff 6 /home/per/working/train/model/reordering-table.wbe-msd-bidirectional-fe.gz 0-0 wbe-msd-bidirectional-fe-allff 6 /home/per/working/train/binarised-model/Kryptering1.sv-fr.reordering-table But it doesn't work. Maybe changing the zeros to ones would do the trick? 1 0 0 5 /home/per/working/train/binarised-model/Kryptering1.sv-fr.phrase-table 1-0 wbe-msd-bidirectional-fe-allff 6 /home/per/working/train/binarised-model/Kryptering1.sv-fr.reordering-table Yours, Per Tunedal On Fri, Feb 28, 2014, at 9:55, Massinissa Ahmim wrote: > Hi Per, > > Could you please past here the command your ran to binarise the > Phrase-table? > > The current paths in your moses.ini should be to the out-put of > processPhraseTable, > for instance, if the output was > /home/per/working/train/model/whatever/phrase-table/ > , then you have to change your current path by this one making sure to > use > the stemming (taking the .gz off as I did above) and switching the first > moses parameter (from 0 to 1) as follows : > > > 1 0 0 5 /home/per/working/train/model/whatever/phrase-table/ > > > Same thing with the reordering table > > Regards > > Massinissa > > > 2014-02-28 7:47 GMT+01:00 Per Tunedal <per.tune...@operamail.com>: > > > > > Hi, > > tried to binarise the phrase table and got in to trouble. > > > > 1. Error messages, as below. What's that? > > distinct source phrases: 439511 distinct first words of source phrases: > > 67600 number of phrase pairs (line count): 940438 > > Count of lines with missing alignments: 0/940438 > > WARNING: there are src voc entries with no phrase translation: count > > 2168 > > There exists phrase translations for 65432 entries > > > > 2. Modify the moses.ini file. I've found this on the Moses/Baseline > > page: > > 1. Change PhraseDictionaryMemory to PhraseDictionaryBinary > > 2. Set the path of the PhraseDictionary feature to point to > > $HOME/working/train/binarised-model/Kryptering1.sv-fr.phrase-table > > 3. Set the path of the LexicalReordering feature to point to > > $HOME/working/train/binarised-model/Kryptering1.sv-fr.reordering-table > > > > But I cannot find any such entries in my moses.ini - maybe because I'm > > running a somewhat older version of Moses. I've found e.g. the following > > lines in my ini-file: > > > > [ttable-file] > > 0 0 0 5 /home/per/working/train/model/phrase-table.gz > > > > # distortion (reordering) files > > [distortion-file] > > 0-0 wbe-msd-bidirectional-fe-allff 6 > > /home/per/working/train/model/reordering-table.wbe-msd-bidirectional-fe.gz > > > > How should I change the entries to use my binarised model? > > > > Yours, > > Per Tunedal > > > > _______________________________________________ > > Moses-support mailing list > > Moses-support@mit.edu > > http://mailman.mit.edu/mailman/listinfo/moses-support > > > > > > -- > > [image: Description : Description : lingua_custodia_final full logo] > > *The Translation Trustee* > > *1, Place Charles de Gaulle* > > *78180 Montigny-le-Bretonneux* > > *Tel : +33 1 30 44 04 23 Mobile : +33 7 61 44 40 84* > > *Email :* *massinissa.ah...@linguacustodia.com > <massinissa.ah...@linguacustodia.com>* > > *Website :* *www.linguacustodia.com <http://www.linguacustodia.com/> - > www.thetranslationtrustee.com <http://www.thetranslationtrustee.com>* > > ü Pensez à l'environnement, n'imprimez ce courriel que si nécessaire. > > Please do not print this email unless it is absolutely necessary. Spread > environmental awareness. > Email had 1 attachment: > + image001.jpg > 6k (image/jpeg) _______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
