Hi,
since KenLM uses shared memory, four instances should take up the same
amount of memory as only one instance (ran yesterday 8 instances with 8
threads each with a 99GB LM on a 128 GB machine). If the model fits into
memory for a single instance it should work if you have enough memory
left for all the phrase tables and the translation process itself (I
guess this is actually the problem). Lazy loading was unbearably slow
for me with the above mentioned configuration, but I was using 64
threads in total, so a lot of concurrent disk access happing, no wonder
there.
Best,
Marcin
W dniu 20.03.2014 14:35, Alexandra Birch pisze:
I have found the answer on the kenlm web page and it seems to be working:
Full or lazy loading
KenLM supports lazy loading via mmap. This allows you to further
reduce memory usage, especially with trie which has good memory
locality. In Moses, this is controlled by the language model number in
moses.ini. Using language model number 8 will load the full model into
memory (MAP_POPULATE on Linux and read() on other OSes). Language
model number 9 will lazily load the model using mmap. I recommend
fully loading if you have the RAM for it; it actually takes less time
to load the full model and use it because the disk does not have to
seek during decoding. Lazy loading works best with local disk and is
not recommended for networked filesystems.
On Thu, Mar 20, 2014 at 2:32 PM, Alexandra Birch <lexi.bi...@gmail.com
<mailto:lexi.bi...@gmail.com>> wrote:
Hi there,
I want to run 4 MT servers at the same time on a machine with
limited memory. Kenlm seems to reserve the amount of memory which
the language model would have taken if it had been loaded into
memory. So I don't have enough memory to run all these servers and
the machine grinds to a halt if I try. Is there any flag I could
use which would limit the amount of memory reserved?
Lexi
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
