Shekhar Bansal created SPARK-5861: ------------------------------------- Summary: [yarn-client mode] Application master should not use memory = spark.driver.memory Key: SPARK-5861 URL: https://issues.apache.org/jira/browse/SPARK-5861 Project: Spark Issue Type: Bug Components: YARN Affects Versions: 1.2.1 Reporter: Shekhar Bansal Fix For: 1.3.0, 1.2.2
I am using {code}spark.driver.memory=6g{code}, which creates application master of 7g(yarn.scheduler.minimum-allocation-mb=1024), which is waste of resources. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org