Dear Phi, Thanks for the tips on filtering!
Regards, Nat On Tue, Oct 11, 2016 at 9:42 PM, Philipp Koehn <p...@jhu.edu> wrote: > Hi, > > filtering was original introduced as a necessity to deal with memory usage > of the > translation model. Since then, the language models have become bigger and > the data structures to store the translation model more compact, so it may > not be > a useful step anymore. > > There may be a bit of a speed effect, especially during startup, but it is > mainly > done for memory size. > > -phi > > On Mon, Oct 10, 2016 at 11:41 PM, Nat Gillin <nat.gil...@gmail.com> wrote: > >> Dear Moses community, >> >> I have a question regarding filtered and non-filtered translation models, >> is it a common methodology to always filter the models prior to testing? >> >> Is it right that the filtering is to reduce the phrase-table and >> reordering table size such that decoding is faster? Given the appropriate >> beam size and more computing power the same accuracy (BLEU or otherwise) >> can also be achieved without a filtering? >> >> Regards, >> Nat >> >> _______________________________________________ >> Moses-support mailing list >> Moses-support@mit.edu >> http://mailman.mit.edu/mailman/listinfo/moses-support >> >> >
_______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
