Re: [Moses-support] Language Model Inquiry
Then which numbers do I use for IRSTLM and SRILM? On Thu, 29 Apr 2021 at 7:10 PM Hieu Hoang wrote: > > On 4/29/2021 5:27 AM, Marwa Gaser wrote: > > Hello, > > In the baseline training, what do the numbers in the below line represent? > > > 3 for the 3-gram? > > yes > > How about 0 and 8? > > 0 means that the LM over the surface words. If your output has other > factors, eg. Je|PRO suis|VB etudiant|ADJ, you can choose to have the LM on > factor 1 > > 8 means it uses KenLM, as opposed to SRILM or IRSTLM. > > > -lm 0:3:$HOME/lm/news-commentary-v8.fr-en.blm.en:8 > > > ___ > Moses-support mailing > listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support > > -- > Hieu Hoanghttp://statmt.org/hieu > > -- Sent from Gmail Mobile ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
Re: [Moses-support] Language Model Inquiry
On 4/29/2021 5:27 AM, Marwa Gaser wrote: Hello, In the baseline training, what do the numbers in the below line represent? 3 for the 3-gram? yes How about 0 and 8? 0 means that the LM over the surface words. If your output has other factors, eg. Je|PRO suis|VB etudiant|ADJ, you can choose to have the LM on factor 1 8 means it uses KenLM, as opposed to SRILM or IRSTLM. -lm 0:3:$HOME/lm/news-commentary-v8.fr-en.blm.en:8 ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- Hieu Hoang http://statmt.org/hieu ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support
[Moses-support] Language Model Inquiry
Hello, In the baseline training, what do the numbers in the below line represent? 3 for the 3-gram? How about 0 and 8? -lm 0:3:$HOME/lm/news-commentary-v8.fr-en.blm.en:8 ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support