C G wrote:
I've got a grid which has been up and running for some time. It's been using a 32 
bit JVM.  I am hitting the wall on memory within NameNode and need to specify max 
heap size > 4G.  Is it possible to switch seemlessly from 32bit JVM to 64bit?  
I've tried this on a small test grid and had no issues, but I want to make sure 
it's OK to proceed.

I do my testing on 64-bit JRockit JVMs; seems fairly stable apart from debugging quirks. And we can assume that all the big clusters have a 64-bit NameNode, though the Sun JVM is recommended. There are some really good papers out there on JVM memory management you should look at which explain why I like the JRockit machine, at least on my desktop

http://www.cs.umd.edu/~pugh/java/memoryModel/
http://www.cs.umd.edu/users/jmanson/java/journal.pdf


Speaking of NameNode, what does it keep in memory?

Filenames. Have you been creating lots of small files?

 Our memory usage ramped up rather suddenly recently.  Also, does 
SecondaryNameNode require the same amount of memory as NameNode?

Thanks for any help,
C G


Reply via email to