[
https://issues.apache.org/jira/browse/SPARK-22743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-22743.
----------------------------------
Resolution: Incomplete
> Consolidate logic for handling spark.driver.memoryOverhead and
> spark.executor.memoryOverhead
> --------------------------------------------------------------------------------------------
>
> Key: SPARK-22743
> URL: https://issues.apache.org/jira/browse/SPARK-22743
> Project: Spark
> Issue Type: Improvement
> Components: YARN
> Affects Versions: 2.3.0
> Reporter: Yinan Li
> Priority: Major
> Labels: bulk-closed
>
> In https://github.com/apache/spark/pull/19717, we will combine
> {{spark.yarn.[driver|executor].memoryOverhead}} and
> {{spark.[driver|executor].driver.memoryOverhead}} into a single property
> {{spark.[driver|executor].memoryOverhead}}. Both the Yarn mode and Kubernetes
> mode start to use the new properties, but the logic of handling the property
> semantics is somehow duplicated in both modes. We should consolidate the
> logic and make both modes share the logic.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
