[
https://issues.apache.org/jira/browse/SPARK-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15413167#comment-15413167
]
Sean Owen commented on SPARK-16966:
-----------------------------------
Hm, but SparkKMeans and other examples do call appName(). Even without setting
{{--name}} I don't see why this ends up with a UUID for a name. (You aren't by
chance using an old or modified example -- wasn't sure what
"original-spark-examples" is?)
The problem here is that the builder options override SparkConf settings. And,
if you don't specify a name in the builder options, it will still set a random
one in the options, which then override anything set elsewhere like in Spark
submit I think those three lines of code should be removed because SparkSubmit
will have already ensured spark.app.name is set to something. If that isn't
used, or the app doesn't set one directly, it's an error.
CC [~rxin] if possible for a comment because of
https://github.com/apache/spark/commit/f2ee0ed4b7ecb2855cc4928a9613a07d45446f4e#diff-d91c284798f1c98bf03a31855e26d71cR768
> App Name is a randomUUID even when "spark.app.name" exists
> ----------------------------------------------------------
>
> Key: SPARK-16966
> URL: https://issues.apache.org/jira/browse/SPARK-16966
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Reporter: Weiqing Yang
>
> When submitting an application with "--name":
> ./bin/spark-submit --name myApplicationTest --verbose --executor-cores 3
> --num-executors 1 --master yarn --deploy-mode client --class
> org.apache.spark.examples.SparkKMeans
> examples/target/original-spark-examples_2.11-2.1.0-SNAPSHOT.jar
> hdfs://localhost:9000/lr_big.txt 2 5
> In the history server UI:
> App ID: application_1470694797714_0016
> App Name: 70c06dc5-1b99-4b4a-a826-ea27497e977b
> The App Name should not be a randomUUID
> "70c06dc5-1b99-4b4a-a826-ea27497e977b" since the "spark.app.name" was
> myApplicationTest.
> The application "org.apache.spark.examples.SparkKMeans" above did not invoke
> ".appName()".
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
