[ https://issues.apache.org/jira/browse/SPARK-15564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303442#comment-15303442 ]
Saisai Shao commented on SPARK-15564: ------------------------------------- According to the your description, I guess you're running streaming application on yarn cluster mode? If so you need to set application name through {{--name}} or set {{spark.app.name}} in conf file / {{--conf}}. Since in yarn cluster mode, yarn/client starts before driver started, and it will set the app name in yarn {{ApplicationSubmissionContext}}, at that time app name is not available, so it will pick class name instead. > App name is the main class name in Spark streaming jobs > ------------------------------------------------------- > > Key: SPARK-15564 > URL: https://issues.apache.org/jira/browse/SPARK-15564 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 1.6.1 > Reporter: Steven Lowenthal > Priority: Minor > > I've tried everything to set the app name to something other than the class > name of the job, but spark reports the application name as the class. This > adversely affects the ability to monitor jobs, we can't have dots in the > reported app name. > {code:title=job.scala} > val defaultAppName = "NDS Transform" > conf.setAppName(defaultAppName) > println (s"App Name: ${conf.get("spark.app.name")}") > ... > val ssc = new StreamingContext(conf, streamingBatchWindow) > {code} > {code:title=output} > App Name: NDS Transform > {code} > Application ID Name > app-20160526161230-0017 (kill) com.gracenote.ongo.spark.NDSStreamAvro -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org