Re: How mapred.map.child.java.opts influence the Container resource allocation

2013-02-04 Thread YouPeng Yang
Hi Arun Thanks a lot. With a container size of 2G, the max heap size i can allocate is ~1.6G. is the heap exclusively possessed by the container ,or shared by all containers which belong to a AM. I also notice that there are several containers allocated in a NM. however o

Re: How mapred.map.child.java.opts influence the Container resource allocation

2013-02-04 Thread Arun C Murthy
Youpeng, The *container* is a generic concept which allows the ResourceManager to provide you a specific amount of resources (memory, cpu etc.). mapred.map.child.java.opts is part of the cmd-line of the Map task's jvm which specifies the heap size. So, in YARN, mapred.map.child.java.opts sh

How mapred.map.child.java.opts influence the Container resource allocation

2013-02-04 Thread YouPeng Yang
Hi All I use YARN and MR.I am confused by the relationship between mapred.map.child.java.opts and Container resource allocation. if I setup mapred.map.child.java.opts = -Xmx2048m ,on nodemanager how Containers will be allocated according to this settings. what about mapred.reduce.ch