Re:Re: Yarn container use huge virtual memory with JVM option -XX:+PrintGCDetails added.

Hi, I did enabled the vmem check. But what I really want to know is that why huge virtual memory(17.9 GB) used when JVM option -XX:+PrintGCDetails was added. The appliction which I run was hadoop jar hadoop-mapreduce-examples-2.7.2.jar pi -D mapreduce.map.java.opts=-XX:+PrintGCDetails 5 100

Re: Yarn container use huge virtual memory with JVM option -XX:+PrintGCDetails added.

ubject: Yarn container use huge virtual memory with JVM option -XX:+PrintGCDetails added. Hi All, I’m currently running Hadoop 2.7.2 on my three node cluster, all node equiped with 32-core CPU and 64 GB memory, Ubuntu 14.04.3 LTS. Yarn’s configuration kept the same with default one,

Yarn container use huge virtual memory with JVM option -XX:+PrintGCDetails added.

am really confused why huge virtual memory allcated when JVM option -XX:+PrintGCDetails was added. Please help! Thank You, JR Error Message 16/04/29 09:43:47 INFO mapreduce.Job: Task Id : attempt_1461846504106_0012_m_04_1, Status : FAILED Container [pid=16629,containerID

Re: JVM option

set it via the hadoop >>> command line (hadoop jar ...)? Next choice would be to do it >>> programmatically in Java using hadoop conf. I can't really change the XML >>> files across the cluster. >>> >>> Regards, >>> Andy >>> >&g

Re: JVM option

it >>> programmatically in Java using hadoop conf. I can't really change the XML >>> files across the cluster. >>> >>> Regards, >>> Andy >>> >>> >>> On Thu, Apr 17, 2014 at 6:39 PM, Azuryy

Re: JVM option

g hadoop conf. I can't really change the XML >> files across the cluster. >> >> Regards, >> Andy >> >> >> On Thu, Apr 17, 2014 at 6:39 PM, Azuryy Yu wrote: >> >>> Do you want add "-Xmx4g" to your MR tasks? if so, just add it as >&

Re: JVM option

the XML > files across the cluster. > > Regards, > Andy > > > On Thu, Apr 17, 2014 at 6:39 PM, Azuryy Yu wrote: > >> Do you want add "-Xmx4g" to your MR tasks? if so, just add it as >> "mapred.child.java.opts" in the mapred-site.xml >>

Re: JVM option

-Xmx4g" to your MR tasks? if so, just add it as > "mapred.child.java.opts" in the mapred-site.xml > > > On Fri, Apr 18, 2014 at 9:35 AM, Andy Srine wrote: > >> Quick question. How would I pass the following JVM option to the Hadoop >> command line? >> >> "-Xmx4G" >> >> hadoop jar >> >> Thanks, >> Andy >> >> > -- Thanks, Andy

Re: JVM option

Do you want add "-Xmx4g" to your MR tasks? if so, just add it as "mapred.child.java.opts" in the mapred-site.xml On Fri, Apr 18, 2014 at 9:35 AM, Andy Srine wrote: > Quick question. How would I pass the following JVM option to the Hadoop > command line? &

JVM option

Quick question. How would I pass the following JVM option to the Hadoop command line? "-Xmx4G" hadoop jar Thanks, Andy