Re: Recommendation for Resourcemanager GC configuration

rakash <ravihad...@gmail.com> Cc: "Ravuri, Venkata Puneet" <vrav...@ea.com>, "common-u...@hadoop.apache.org" <user@hadoop.apache.org> Subject: Re: Recommendation for Resourcemanager GC configuration Hi Puneet, Along with the heap dump details, I would also like t

Re: Recommendation for Resourcemanager GC configuration

.com> Cc: "common-u...@hadoop.apache.org" <user@hadoop.apache.org> Subject: Re: Recommendation for Resourcemanager GC configuration What is the ResourceManager JVM’s heap size? What is the value for the configuration yarn.resourcemanager.max-completed-applications? +Vinod On Aug 23, 2017, at

Re: Recommendation for Resourcemanager GC configuration

What is the ResourceManager JVM’s heap size? What is the value for the configuration yarn.resourcemanager.max-completed-applications? +Vinod > On Aug 23, 2017, at 9:23 AM, Ravuri, Venkata Puneet wrote: > > Hello, > > I wanted to know if there is any recommendation for

Re: Recommendation for Resourcemanager GC configuration

Hi Puneet, Along with the heap dump details, I would also like to know the version of the Hadoop-Yarn being used, size of the cluster, all Memory configurations, and JRE version. Also if possible can you share the rational behind the choice for Parallel GC collector over others (CMS or G1) ?

Re: Recommendation for Resourcemanager GC configuration

Hi Puneet Can you take a heap dump and see where most of the churn is? Is it lots of small applications / few really large applications with small containers etc. ? Cheers Ravi On Wed, Aug 23, 2017 at 9:23 AM, Ravuri, Venkata Puneet wrote: > Hello, > > > > I wanted to know if

Recommendation for Resourcemanager GC configuration

Hello, I wanted to know if there is any recommendation for ResourceManager GC settings. Full GC (with Parallel GC, 8 threads) is sometimes taking more than 30 sec due to which state store sessions to Zookeeper time out resulting in FATAL errors. The YARN cluster is heavily used with 1000’s of