[
https://issues.apache.org/jira/browse/SPARK-10766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766438#comment-16766438
]
Marcelo Vanzin edited comment on SPARK-10766 at 2/12/19 8:49 PM:
-----------------------------------------------------------------
-There's a bunch of config options already with the {{spark.yarn.am.}} prefix.-
Sorry, previous comment was about the wrong thing. In any case, you can add
things to the launcher process now using {{--jars}} and they should be picked
up fine (e.g. to generate delegation tokens).
was (Author: vanzin):
There's a bunch of config options already with the {{spark.yarn.am.}} prefix.
> Add some configurations for the client process in yarn-cluster mode.
> ---------------------------------------------------------------------
>
> Key: SPARK-10766
> URL: https://issues.apache.org/jira/browse/SPARK-10766
> Project: Spark
> Issue Type: Improvement
> Components: YARN
> Affects Versions: 1.6.0
> Reporter: carlmartin
> Priority: Major
>
> In the yarn-cluster mode, it's hard to find the correct configuration for the
> client process.
> But this is necessary such as the client process's class path: if I want to
> use hbase on spark, I have to include the hbase jars into client's classpath.
> But *spark.driver.extraClassPath* can't take effect. The way I can do is set
> the hbase jars into the Enviroment of SPARK_CLASSPATH.
> It isn't a better way so I want to add some configuration for this client
> process.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
