[
https://issues.apache.org/jira/browse/SPARK-25500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18071832#comment-18071832
]
Ravi Sanwal commented on SPARK-25500:
-------------------------------------
This would have been a really good feature [~liyinan926] , I wish we
reconsidered this.
While pod templates works as a jackhammer, sometimes all we need is make a
configmap available to the executors. Pod templates also become clunky where we
have a monorepo style codebase hosting many jobs.
> Specify configmap and secrets in Spark driver and executor pods in Kubernetes
> -----------------------------------------------------------------------------
>
> Key: SPARK-25500
> URL: https://issues.apache.org/jira/browse/SPARK-25500
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes, Spark Core
> Affects Versions: 2.3.1
> Reporter: Abhishek Rao
> Priority: Minor
>
> This uses SPARK-23529. Support for specifying configmap and secrets as
> spark-configuration is requested.
> Using PR #22146, the above functionality can be achieved by passing template
> file. However, for spark properties (like log4j.properties, fairscheduler.xml
> and metrics.properties), we are proposing this approach as this is native to
> other configuration options specifications in spark.
> The configmaps and secrets have to be pre-created before using this as spark
> configuration.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
