[
https://issues.apache.org/jira/browse/SPARK-15564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303442#comment-15303442
]
Saisai Shao commented on SPARK-15564:
-------------------------------------
According to the your description, I guess you're running streaming application
on yarn cluster mode?
If so you need to set application name through {{--name}} or set
{{spark.app.name}} in conf file / {{--conf}}. Since in yarn cluster mode,
yarn/client starts before driver started, and it will set the app name in yarn
{{ApplicationSubmissionContext}}, at that time app name is not available, so it
will pick class name instead.
> App name is the main class name in Spark streaming jobs
> -------------------------------------------------------
>
> Key: SPARK-15564
> URL: https://issues.apache.org/jira/browse/SPARK-15564
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.6.1
> Reporter: Steven Lowenthal
> Priority: Minor
>
> I've tried everything to set the app name to something other than the class
> name of the job, but spark reports the application name as the class. This
> adversely affects the ability to monitor jobs, we can't have dots in the
> reported app name.
> {code:title=job.scala}
> val defaultAppName = "NDS Transform"
> conf.setAppName(defaultAppName)
> println (s"App Name: ${conf.get("spark.app.name")}")
> ...
> val ssc = new StreamingContext(conf, streamingBatchWindow)
> {code}
> {code:title=output}
> App Name: NDS Transform
> {code}
> Application ID Name
> app-20160526161230-0017 (kill) com.gracenote.ongo.spark.NDSStreamAvro
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
