LM Training Error:

rupjyoti@rupjyoti:~/smt/lm$ /home/rupjyoti/smt/mosesdecoder/bin/lmplz -o 3
< ../corpus/corpora.true.hi > corpora.arpa.hi
=== 1/5 Counting and sorting n-grams ===
Reading /home/rupjyoti/smt/corpus/corpora.true.hi
----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
tcmalloc: large alloc 1517756416 bytes == 0x56460dd06000 @
tcmalloc: large alloc 5059190784 bytes == (nil) @
****************************************************************************************************
util/scoped.cc:20 in void* util::{anonymous}::InspectAddr(void*,
std::size_t, const char*) threw MallocException because `!addr &&
requested'.
Cannot allocate memory for 5059183080 bytes in malloc
Aborted (core dumped)

Laptop specification of
-memory
       description: System Memory
       physical id: 12
       slot: System board or motherboard
       size: 8GiB
Anyone's help is much appreciated.


Rupjyoti Baruah
Research Scholar
Department of Computer Science and Engineering
IIT,Banaras Hindu University
Varanasi,Uttarpradesh
Contact Number : +91 9401367820
India
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
  • [Moses-suppor... Rupjyoti Baruah Res. Scholar, Dept. of Comp. Engg. IIT (BHU)
    • [Moses-s... Rupjyoti Baruah Res. Scholar, Dept. of Comp. Engg. IIT (BHU)

Reply via email to