[
https://issues.apache.org/jira/browse/SPARK-11828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15236510#comment-15236510
]
Dubkov Mikhail commented on SPARK-11828:
----------------------------------------
[~vanzin]
Could you please look into
http://stackoverflow.com/questions/36133952/why-cant-i-run-spark-shell-with-yarn-in-client-mode/36561486#36561486
We have NPE on line which you added, maybe you have ideas why it happens ?
Thanks!
> DAGScheduler source registered too early with MetricsSystem
> -----------------------------------------------------------
>
> Key: SPARK-11828
> URL: https://issues.apache.org/jira/browse/SPARK-11828
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.6.0
> Reporter: Marcelo Vanzin
> Assignee: Marcelo Vanzin
> Priority: Minor
> Fix For: 1.6.0
>
>
> I see this log message when starting apps on YARN:
> {quote}
> 15/11/18 13:12:56 WARN MetricsSystem: Using default name DAGScheduler for
> source because spark.app.id is not set.
> {quote}
> That's because DAGScheduler registers itself with the metrics system in its
> constructor, and the DAGScheduler is instantiated before "spark.app.id" is
> set in the context's SparkConf.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
