Hi,
this is ac common error when the data is "odd", such as
heavily duplicated segments, reduced vocabulary, etc.
To avoid the error, just add the switch "--discount_fallback"
when invoking lmplz.
-phi
On Mon, May 15, 2017 at 7:44 AM, rmogla <rmogl...@gmail.com> wrote:
> Hello,
>
> While using KenLM for language model training for Hindi I got this error.
>
>
> mosesdecoder/lm/builder/adjust_counts.cc:61 in void
> lm::builder::{anonymous}::StatCollector::CalculateDiscounts(const
> lm::builder::DiscountConfig&) threw BadDiscountException because
> `discounts_[i].amount[j] < 0.0 || discounts_[i].amount[j] > j'.
>
> ERROR: 1-gram discount out of range for adjusted count 2: -0.0625
> Aborted (core dumped)
>
>
> Please suggest how to remove this error.
>
> Thanking in advance.
> Best Regards
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
