Github user pwendell commented on the pull request: https://github.com/apache/incubator-spark/pull/615#issuecomment-35581371 It looks like there is a separate variable called `amMemory` that deals with this in YARN. The command for launching that JVM gets set-up in: common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. To do so, please top-post your response. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---