Re: [Moses-support] Discount fallback in KenLM on super small file

2017-04-24 Thread liling tan
Thanks Kenneth for the answer!! On Mon, Apr 24, 2017 at 2:48 PM, Kenneth Heafield wrote: > Yes. Though formally I would say in range. > > On April 24, 2017 4:18:41 AM GMT+01:00, liling tan > wrote: >> >> Dear Moses community, >> >> Is it correct that when using --discount_fallback, if discount

Re: [Moses-support] Discount fallback in KenLM on super small file

2017-04-23 Thread Kenneth Heafield
Yes. Formally, the condition is in range, not just computable. On April 24, 2017 4:18:41 AM GMT+01:00, liling tan wrote: >Dear Moses community, > >Is it correct that when using --discount_fallback, if discount is >computable from Kneyser-Ney, the fallback will not be used? > > >Regards, >Lilin

[Moses-support] Discount fallback in KenLM on super small file

2017-04-23 Thread liling tan
Dear Moses community, Is it correct that when using --discount_fallback, if discount is computable from Kneyser-Ney, the fallback will not be used? Regards, Liling For context: $ cat test.zh 一 二 三 四 ~$ time ~/mosesdecoder/bin/lmplz -o 3 --discount_fallback=0 < test.zh > test.zh.arpa ==