Re: Node Manager crashes with OutOfMemory error

2016-07-26 Thread Ravi Prakash
Hi Rahul! Which version of Hadoop are you using? What non-default values of configuration are you setting? You can set HeapDumpOnOutOfMemoryError on the command line while starting up your nodemanagers and see the resulting heap dump in Eclipse MAT / jvisualvm / yourkit to see where are the

Node Manager crashes with OutOfMemory error

2016-07-26 Thread Rahul Chhiber
Hi All, I am running a Hadoop cluster with following configuration :- Master (Resource Manager) - 16GB RAM + 8 vCPU Slave 1 (Node manager 1) - 8GB RAM + 4 vCPU Slave 2 (Node manager 2) - 8GB RAM + 4 vCPU Memory allocated for container use per slave i.e. yarn.nodemanager.resource.memory-mb is