[
https://issues.apache.org/jira/browse/SPARK-25500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625661#comment-16625661
]
Abhishek Rao commented on SPARK-25500:
--------------------------------------
Even thought templates work for all scenarios, it would be better for native
spark feature functionality to have it on command-line especially for spark
configuration files like fairscheduler.xml, log4j.properties and
metrics.properties.
This can of course be re-used for other usecases going forward if required.
> Specify configmap and secrets in Spark driver and executor pods in Kubernetes
> -----------------------------------------------------------------------------
>
> Key: SPARK-25500
> URL: https://issues.apache.org/jira/browse/SPARK-25500
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 2.3.1
> Reporter: Abhishek Rao
> Priority: Minor
>
> This uses SPARK-23529. Support for specifying configmap and secrets as
> spark-configuration is requested.
> Using PR #22146, the above functionality can be achieved by passing template
> file. However, for spark properties (like log4j.properties, fairscheduler.xml
> and metrics.properties), we are proposing this approach as this is native to
> other configuration options specifications in spark.
> The configmaps and secrets have to be pre-created before using this as spark
> configuration.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
