Re: [Moses-support] lowercasing/recasing

2008-03-06 Thread Hubert Crépy
we tend to focus on raw accuracy figures on well-prepared test data. But adding all the little niceties to take care of all the little idiosyncracies, is also a very large piece of work and has an extremely large impact on the perceived accuracy of the whole system in the real world. (*) unin

Re: [Moses-support] Moses model memory footprint

2008-03-05 Thread Hubert Crépy
difference to memory usage, and on-demand loading is ineffective ? (yes, before you ask, I've changed moses.ini to point at the binary model, and for additional safety, moved the non-binary files away) -- Hubert Crépy ___ Moses-support mailing

Re: [Moses-support] lowercasing/recasing

2008-03-05 Thread Hubert Crépy
sonally would try to favor users who provide good input, and not worry too much about those who don't. Faced with improper input, would it not make more sense to try and "fix it" in the source language before translation, rather than distorting the translation with the induce

[Moses-support] lowercasing/recasing

2008-03-05 Thread Hubert Crépy
Hieu Hoang <[EMAIL PROTECTED]> writes: >> For the WMT task recasing is done by training another Moses model. Is this a >> suitable approach for the online system – would you train the recaser using all >> of the Europarl data?? Another option would be to train the original models on >> data t

Re: [Moses-support] Moses model memory footprint

2008-03-05 Thread Hubert Crépy
Philipp Koehn <[EMAIL PROTECTED]> writes: > for some reason that command needs to be called like this: > LC_ALL sort phrase-table | /STATMT/moses/misc/processPhraseTable > -ttable 0 0 - -nscores 5 -out phrase-table Thanks, I'll try that ! ___ Moses-su

Re: [Moses-support] Moses model memory footprint

2008-02-28 Thread Hubert Crépy
. (whether I try it directly on the .gz zipped table or on a previously gunzipped version -2Gb-, makes no difference...) -- Hubert Crépy ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] Moses model memory footprint

2008-02-28 Thread Hubert Crépy
-- apologies if this is a duplicate, I'm having trouble posting to the list -- I just built (as an exercise) a fr-en model based on the first 500K sentences of Europarl. It appears the generated model is just way too big to load on my Windows machine: while trying to load, I see memory/swap goi

Re: [Moses-support] Training scripts/executables under Win32 ?

2008-02-22 Thread Hubert Crépy
laptop...) ? Thanks for your support, much appreciated. -- Hubert Crépy ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Training scripts/executables under Win32 ?

2008-02-22 Thread Hubert Crépy
actor 0.4 -nodumps 1 -nsmooth 4 -o working-dir/giza.fr-en/fr-en -onlyaldumps 1 -p0 0.999 -s working-dir/corpus/en.vcb -t working-dir/corpus/fr.vcb died with signal 11, with coredump Er, what now ? :-/ -- Hubert Crépy ___ Moses-support mailin

Re: [Moses-support] Training scripts/executables under Win32 ?

2008-02-22 Thread Hubert Crépy
In addition to my own failings and setup oddities, I found what I think to be a small bug in the build setup: I had to edit released-filesWIN32 to list: training/mbr/mbr.exe It was missing the trailing .exe and rsync was failing. -- Hubert Crépy

Re: [Moses-support] Training scripts/executables under Win32 ?

2008-02-22 Thread Hubert Crépy
actor 0.4 -nodumps 1 -nsmooth 4 -o working-dir/giza.fr-en/fr-en -onlyaldumps 1 -p0 0.999 -s working-dir/corpus/en.vcb -t working-dir/corpus/fr.vcb died with signal 11, with coredump Er, what now ? :-/ -- Hubert Crépy ___ Moses-support mailin

Re: [Moses-support] Training scripts/executables under Win32 ?

2008-02-22 Thread Hubert Crépy
un ./configure..." That's fixed now. Thanks. Moving on to the next stumbling block... -- Hubert Crépy, from Paris ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] Training scripts/executables under Win32 ?

2008-02-20 Thread Hubert Crépy
situation is not that ideal. Comments from you experts would be appreciated. -- Hubert Crépy, from Paris ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] Training scripts/executables under Win32 ?

2008-02-20 Thread Hubert Crépy
situation is not that ideal. Comments from you experts would be appreciated. -- Hubert Crépy, from Paris ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support