Re: yarn.nodemanager.vmem-check-enabled

2013-10-23 Thread Sandy Ryza
Hi John, At Cloudera we turn it off by default and recommend doing so because of the way that Java can behave weirdly with high vmems. -Sandy On Sun, Oct 20, 2013 at 7:34 AM, John Lilley wrote: > Is this option typically enabled in practice? Is there a way for a > specific AM to disable it,

yarn.nodemanager.vmem-check-enabled

2013-10-20 Thread John Lilley
Is this option typically enabled in practice? Is there a way for a specific AM to disable it, or is it site-wide? We are finding that our YARN application, because it launches many threads, each with a somewhat large stack, has a large vmem/pmem ratio (say, 2GB / 200MB). Unless we disable this