Jackey Lee created SPARK-30514:
----------------------------------
Summary: add ENV_PYSPARK_MAJOR_PYTHON_VERSION support for
JavaMainAppResource
Key: SPARK-30514
URL: https://issues.apache.org/jira/browse/SPARK-30514
Project: Spark
Issue Type: Improvement
Components: Kubernetes
Affects Versions: 3.0.0, 3.1.0
Reporter: Jackey Lee
In apache Livy, the program is first started with JavaMainAppResource, and then
start the Python worker. At this time, the program needs to be able to pass
Python environment variables.
In spark on yarn, we support it through spark.yarn.isPython. In k8s, we can
support this in a better way.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
