Hello,
I am using multiple language models for my experiments, and am using
Interpolated-LM to optimize the perplexity on the tuning set.
It had worked well when I used a particular tuning set (set A) . But
when I used a different one (set B), it crashed. Here is the log of
the error:
-
Exec
FYI we resolved the problem off-list. KenLM does not load IRST's iARPA
format. You must first run IRST"s compile-lm to generate an ARPA. I
might add an error message specific to this case.
On 07/27/11 09:27, Lee Ball (Applied Language) wrote:
> Hi guys,
>
> I just tried using KenLM out of inte
Hello again,
I ran compile-lm against the model.lm.es.gz and got the output
model.lm.es.blm but when using 8 0 5 in my moses.ini it crashes with this:
0
> " not blank File: model.es.lm.blm
> Aborted
Is this down to bad artefacts in the language model?
Kind regards,
Lee Ball
Infrastructure Ma
That looks like an IRSTLM-format binary file. You might need the "--text
yes" flag for compile-lm.
You can confirm that the file is in the right format by opening it with a
text viewer such as "less". The ARPA format is defined here:
http://www-speech.sri.com/projects/srilm/manpages/ngram-format.5
