Yinan Li created SPARK-24091: -------------------------------- Summary: Internally used ConfigMap prevents use of user-specified ConfigMaps carrying Spark configs files Key: SPARK-24091 URL: https://issues.apache.org/jira/browse/SPARK-24091 Project: Spark Issue Type: Brainstorming Components: Kubernetes Affects Versions: 2.3.0 Reporter: Yinan Li
The recent PR [https://github.com/apache/spark/pull/20669] for removing the init-container introduced a internally used ConfigMap carrying Spark configuration properties in a file for the driver. This ConfigMap gets mounted under {{$SPARK_HOME/conf}} and the environment variable {{SPARK_CONF_DIR}} is set to point to the mount path. This pretty much prevents users from mounting their own ConfigMaps that carry custom Spark configuration files, e.g., {{log4j.properties}} and {{spark-env.sh}} and leaves users with only the option of building custom images. IMO, it is very useful to support mounting user-specified ConfigMaps for custom Spark configuration files. This worths further discussions. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org