Github user CodingCat commented on the pull request:
https://github.com/apache/incubator-spark/pull/599#discussion_r9767385
Hi, @aarondav, just a bit confused. from the code
private[spark] val executorMemory = conf.getOption("spark.executor.memory")
.orElse(Option(System.getenv("SPARK_MEM")))
.map(Utils.memoryStringToMb)
.getOrElse(512)
SPARK_MEM is to set the memory used by the executor, which has been done in
this PR,
what you are proposing is to control the memory used by the driver. I think
it is hard to achieve since users may run spark-shell in a machine out of the
control of Spark.- [GitHub] incubator-spark pull request: [SPARK-1090] improvem... CodingCat
- [GitHub] incubator-spark pull request: [SPARK-1090] imp... AmplabJenkins
- [GitHub] incubator-spark pull request: [SPARK-1090] imp... aarondav
- [GitHub] incubator-spark pull request: [SPARK-1090] imp... CodingCat
- [GitHub] incubator-spark pull request: [SPARK-1090] imp... aarondav
- [GitHub] incubator-spark pull request: [SPARK-1090] imp... CodingCat
- [GitHub] incubator-spark pull request: [SPARK-1090] imp... CodingCat
- [GitHub] incubator-spark pull request: [SPARK-1090] imp... CodingCat
- [GitHub] incubator-spark pull request: [SPARK-1090] imp... aarondav
- [GitHub] incubator-spark pull request: [SPARK-1090] imp... aarondav
- [GitHub] incubator-spark pull request: [SPARK-1090] imp... CodingCat
- [GitHub] incubator-spark pull request: [SPARK-1090] imp... CodingCat
- [GitHub] incubator-spark pull request: [SPARK-1090] imp... aarondav
- [GitHub] incubator-spark pull request: [SPARK-1090] imp... aarondav
