Re: [Moses-support] Language Model Inquiry

2021-05-01 Thread Marwa Gaser
Then which numbers do I use for IRSTLM and SRILM?

On Thu, 29 Apr 2021 at 7:10 PM Hieu Hoang  wrote:

>
> On 4/29/2021 5:27 AM, Marwa Gaser wrote:
>
> Hello,
>
> In the baseline training, what do the numbers in the below line represent?
>
>
> 3 for the 3-gram?
>
> yes
>
> How about 0 and 8?
>
> 0 means that the LM over the surface words. If your output has other
> factors, eg. Je|PRO suis|VB etudiant|ADJ, you can choose to have the LM on
> factor 1
>
> 8 means it uses KenLM, as opposed to SRILM or IRSTLM.
>
>
> -lm 0:3:$HOME/lm/news-commentary-v8.fr-en.blm.en:8
>
>
> ___
> Moses-support mailing 
> listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
> --
> Hieu Hoanghttp://statmt.org/hieu
>
> --
Sent from Gmail Mobile
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


Re: [Moses-support] Language Model Inquiry

2021-04-29 Thread Hieu Hoang


On 4/29/2021 5:27 AM, Marwa Gaser wrote:

Hello,

In the baseline training, what do the numbers in the below line 
represent?



3 for the 3-gram?

yes

How about 0 and 8?


0 means that the LM over the surface words. If your output has other 
factors, eg. Je|PRO suis|VB etudiant|ADJ, you can choose to have the LM 
on factor 1


8 means it uses KenLM, as opposed to SRILM or IRSTLM.



-lm 0:3:$HOME/lm/news-commentary-v8.fr-en.blm.en:8

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


--
Hieu Hoang
http://statmt.org/hieu

___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


[Moses-support] Language Model Inquiry

2021-04-29 Thread Marwa Gaser
Hello,

In the baseline training, what do the numbers in the below line represent?
3 for the 3-gram? How about 0 and 8?

-lm 0:3:$HOME/lm/news-commentary-v8.fr-en.blm.en:8
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support