Philipp Koehn [EMAIL PROTECTED] writes:
for some reason that command needs to be called like this:
LC_ALL sort phrase-table | /STATMT/moses/misc/processPhraseTable
-ttable 0 0 - -nscores 5 -out phrase-table
Thanks, I'll try that !
___
Hi,
for some reason that command needs to be called like this:
LC_ALL sort phrase-table | /STATMT/moses/misc/processPhraseTable
-ttable 0 0 - -nscores 5 -out phrase-table
See also documentation here:
http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc2
-phi
On Thu, Feb 28, 2008 at 4:13
-- apologies if this is a duplicate, I'm having trouble posting to the
list --
I just built (as an exercise) a fr-en model based on the first 500K
sentences of Europarl.
It appears the generated model is just way too big to load on my Windows
machine: while trying to load, I see memory/swap
I've seen mention of filtering the model before translation. Many of the phrase
in your TM may not even exist in the document you wish to translate. Why bother
loading them into memory?
Quoting Hubert Crépy [EMAIL PROTECTED]:
-- apologies if this is a duplicate, I'm having trouble posting to
J C Read a écrit :
I've seen mention of filtering the model before translation.
Thanks for the hint, it did point me in the right direction.
I found the moses/scripts/training/filter-model-given-input.pl tool.
Given an a priori known input, it does reduce the model to a manageable
size.
