Dear Hieu,
Thanks for the info on the KenLM,
Regards,
Liling
On Tue, Aug 11, 2015 at 5:57 PM, Hieu Hoang wrote:
>
>
> On 10/08/2015 17:22, liling tan wrote:
>
> Dear Moses devs/users,
>
> @Marcin @Ken , Thanks for the tips on the -S for build_binary, RAM
> estimation and the probing vs trie ex
On 10/08/2015 17:22, liling tan wrote:
Dear Moses devs/users,
@Marcin @Ken , Thanks for the tips on the -S for build_binary, RAM
estimation and the probing vs trie explanations.
Just to do a check, currently, is there an option for lmplz to output
binarized directly without going through A
Dear Moses devs/users,
@Marcin @Ken , Thanks for the tips on the -S for build_binary, RAM
estimation and the probing vs trie explanations.
Just to do a check, currently, is there an option for lmplz to output
binarized directly without going through ARPA? If there is, is there also a
binary to ar
No there isn't a multithreaded option but I'd love for there to be one.
To be though, tighter binary-level integration with lmplz is a higher
priority rather than trying to make ARPA faster.
You can estimate final model RAM usage by just running build_binary
foo.arpa. For probing, this is about
Dear Moses dev/users,
On a related note, without multi-threads, can anyone give a gauge of how
much RAM is required to binarized a 80GB (compressed .gz) 6gram arpa file?
The no. of ngrams are:
\data\
ngram 1=7503209
ngram 2=131003943
ngram 3=671005861
ngram 4=1510529519
ngram 5=2165163610
ngram 6
Dear Moses dev/users,
Is there multithread option for KenLM's build_binary?
Regards,
Liling
___
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
