Yinan Li created SPARK-22743:
--------------------------------
Summary: Consolidate logic for handling
spark.driver.memoryOverhead and spark.executor.memoryOverhead
Key: SPARK-22743
URL: https://issues.apache.org/jira/browse/SPARK-22743
Project: Spark
Issue Type: Improvement
Components: YARN
Affects Versions: 2.3.0
Reporter: Yinan Li
In https://github.com/apache/spark/pull/19717, we will combine
spark.yarn.{driver|executor}.memoryOverhead and
spark.{driver|executor}.driver.memoryOverhead into a single property
spark.{driver|executor}.memoryOverhead. Both the Yarn mode and Kubernetes mode
start to use the new properties, but the logic of handling the property
semantics is somehow duplicated in both modes. We should consolidate the logic
and make both modes share the logic.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
