Christian Thiel created SPARK-35702:
---------------------------------------
Summary: Kubernetes: Allow different namespaces for Driver and
Executors
Key: SPARK-35702
URL: https://issues.apache.org/jira/browse/SPARK-35702
Project: Spark
Issue Type: Improvement
Components: Kubernetes
Affects Versions: 3.1.2
Reporter: Christian Thiel
Currently the Kubernetes namespace of driver AND executors always needs to be
identical - specified with {{spark.kubernetes.namespace}}.
Especially when developing in Kubernetes, this is a harsh restriction: In a
_notebook_ Namespace I want to run spark in driver in client mode for
interaction, however executors should get their own dedicated resources in a
dedicated namespace with different policies and different lifecycles.
This could be solved by adding the following two additional configuration
options:
{code:java}
spark.kubernetes.executor.pod.namespace
spark.kubernetes.driver.pod.namespace
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
