You need to binarize the phrase-table to prevent it all being loaded into memory. The implementation of the binary phrase-table is similar, but different, from the binary phrase-table for phrase-based: http://www.statmt.org/moses/?n=Moses.SyntaxTutorial You then have to change the ini file to [ttable-file] *2* 0 0 5 /home/alex...phrase-table.0-0.1.1 6 0 0 1 /home/alex...glue-grammar
I think KenLM can read the text LM, as it's doing here, but to minimize memory usage you have to binarize it too. http://www.statmt.org/moses/?n=FactoredTraining.BuildingLanguageModel#ntoc18 if that still uses too much memory, consider reducing the max-chart-span [max-chart-span] *10* 1000 I think the EMS sets it to 20 by default to eek out more BLEU but this may not be usable by a lot of people.
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
