[ https://issues.apache.org/jira/browse/SPARK-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981337#comment-13981337 ]
Marcelo Vanzin commented on SPARK-1631: --------------------------------------- PR: https://github.com/apache/spark/pull/539 > App name set in SparkConf (not in JVM properties) not respected by Yarn > backend > ------------------------------------------------------------------------------- > > Key: SPARK-1631 > URL: https://issues.apache.org/jira/browse/SPARK-1631 > Project: Spark > Issue Type: Bug > Components: YARN > Reporter: Marcelo Vanzin > Assignee: Marcelo Vanzin > > When you submit an application that sets its name using a SparkContext > constructor or SparkConf.setAppName(), the Yarn app name is not set and the > app shows up as "Spark" in the RM UI. > That's because YarnClientSchedulerBackend only looks at the system properties > to look for the app name, instead of looking at the app's config. > e.g., app initializes like this: > {code} > val sc = new SparkContext(new SparkConf().setAppName("Blah")); > {code} > Start app like this: > {noformat} > ./bin/spark-submit --master yarn --deploy-mode client blah blah blah > {noformat} > And app name in RM UI does not reflect the code. -- This message was sent by Atlassian JIRA (v6.2#6252)