Jackey Lee created SPARK-30514: ---------------------------------- Summary: add ENV_PYSPARK_MAJOR_PYTHON_VERSION support for JavaMainAppResource Key: SPARK-30514 URL: https://issues.apache.org/jira/browse/SPARK-30514 Project: Spark Issue Type: Improvement Components: Kubernetes Affects Versions: 3.0.0, 3.1.0 Reporter: Jackey Lee
In apache Livy, the program is first started with JavaMainAppResource, and then start the Python worker. At this time, the program needs to be able to pass Python environment variables. In spark on yarn, we support it through spark.yarn.isPython. In k8s, we can support this in a better way. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org