RE: namenode grows overtime

2012-01-20 Thread Uma Maheswara Rao G
/thread/c45bc7ba788b2357 Regards, Uma From: felix gao [gre1...@gmail.com] Sent: Friday, January 20, 2012 6:42 AM To: hdfs-user@hadoop.apache.org Subject: Re: namenode grows overtime Koji, There is no Java options specified other than -Xmx24g, what are some

Re: namenode grows overtime

2012-01-19 Thread felix gao
Koji, There is no Java options specified other than -Xmx24g, what are some of the recommended options for namenode? Thanks, Felix On Wed, Jan 18, 2012 at 3:39 PM, Koji Noguchi knogu...@yahoo-inc.comwrote: Hi Felix, Taking jmap –histo:live pid would tell you what’s occupying the heap.

Re: namenode grows overtime

2012-01-18 Thread Koji Noguchi
Hi Felix, Taking jmap –histo:live pid would tell you what’s occupying the heap. Are you using UseConcMarkSweepGC? If yes, and if you see bunch of java.net.SocksSocketImpl sun.nio.ch.SocketChannelImpl from jmap histo outputs, try passing-XX:-CMSConcurrentMTEnabled . Background:

Re: namenode grows overtime

2012-01-18 Thread Harsh J
Felix, Are you noticing this from the NN Web UI or from proper JVM monitoring tools? Just so you know, the UI had a flaw that has since been fixed: https://issues.apache.org/jira/browse/HDFS-94 On Thu, Jan 19, 2012 at 4:53 AM, felix gao gre1...@gmail.com wrote: Hi guys, we are running Hadoop