Hi Keith, Yes. It can be controlled by the "twill.java.reserved.memory.mb" setting in the YarnConfiguration passed to the "YarnTwillRunnerService". The actual "-Xmx" set for the java process is the container resource memory minus the value set in the "twill.java.reserved.memory.mb". By default the reserved memory is 200MB. It also has a minimum memory ratio constant (0.7), meaning the container size to non-heap memory ratio cannot be lower than 0.7.
E.g. If container size = 1GB, reserved = 200MB, then -Xmx = 800MB If container size = 1GB, reserved = 500MB, then -Xmx = 700MB (because of the min heap ratio). Terence On Fri, Apr 22, 2016 at 9:32 AM, Keith Turner <[email protected]> wrote: > I am running into a problem where YARN is killing my containers started by > Twill because its using too much memory. I would like to increase the gap > between the java -Xmx setting and the yarn memory limit. For example make > the -Xmx setting 75% of the YARN memory limit. Is there a way I can do > this in Twill? > > Thanks, > > Keith >
