Ryan Blue created SPARK-25021:
---------------------------------
Summary: Add spark.executor.pyspark.memory support to Kubernetes
Key: SPARK-25021
URL: https://issues.apache.org/jira/browse/SPARK-25021
Project: Spark
Issue Type: Bug
Components: Kubernetes
Affects Versions: 2.3.0
Reporter: Ryan Blue
SPARK-25004 adds {{spark.executor.pyspark.memory}} to control the memory
allocation for PySpark and updates YARN to add this memory to its container
requests. Kubernetes should do something similar to account for the python
memory allocation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
