Github user phalodi commented on the issue:
https://github.com/apache/spark/pull/15134
@srowen Ok no problem i will close this PR
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/15134
I'm actually not sure why it's set to a UUID versus throwing an error. I
suppose the new API is just different. See
https://github.com/apache/spark/pull/14630 for related discussion.
If you
Github user phalodi commented on the issue:
https://github.com/apache/spark/pull/15134
@jerryshao ok i will change it as you suggested but then i think if UUID is
not a good name then we should also change it for spark session you see below
spark session generate UUID while not defini
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/15134
My concern is that previously Spark will throw an exception if app name is
not set, while in 2.0 we bring in SparkSession which breaks the convention, so
do we need to let SparkSession to be align
Github user phalodi commented on the issue:
https://github.com/apache/spark/pull/15134
@jerryshao yeah you are right jerry for spark-submit and launcher its
works, but for many time user also have usecase to just locally using spark
like reading file with spark more fast even we run i
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/15134
@phalodi we don't restrict user to have to set an app name either for
SparkContext or SparkSession. You could refer to this code in SparkSubmit:
```
// Set name from main class if
Github user phalodi commented on the issue:
https://github.com/apache/spark/pull/15134
@sadikovi Yes it will, like if we will not define app name in SparkConf
object or spark-submit then it will generate exception , In this PR random UUID
is generated for app name if its not defining,
Github user sadikovi commented on the issue:
https://github.com/apache/spark/pull/15134
@phalodi Does this solve (intend to solve) situation when spark-submit is
launched with empty app name? Currently, as of 1.6, it will use empty
application name.
---
If your project is set up for
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/15134
I don't think we should make this change for the reasons @jerryshao gives.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your proj
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15134
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15134
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65567/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15134
**[Test build #65567 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65567/consoleFull)**
for PR 15134 at commit
[`cdc5fa2`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15134
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15134
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/6/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15134
**[Test build #6 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/6/consoleFull)**
for PR 15134 at commit
[`eec4796`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15134
**[Test build #65567 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65567/consoleFull)**
for PR 15134 at commit
[`cdc5fa2`](https://github.com/apache/spark/commit/c
Github user phalodi commented on the issue:
https://github.com/apache/spark/pull/15134
@jerryshao yeah if you suggest i prefix spark- in front of UUID but yeah
still when user use core part of RDD when they dont need to deal with dataset
they create SparkContext and some people also u
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/15134
Well, I understand your meaning, I'm guessing most of the users they're
using SparkSubmit or SparkLaunch to start application and in that case app name
should be well figured out even if not set b
Github user phalodi commented on the issue:
https://github.com/apache/spark/pull/15134
@jerryshao We can i think like if while creating spark context for
application in its configuration i didnt define app name and at a time of
spark-submit i also not provide app name then this will g
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/15134
From my understanding of current code, looks like there's no chance app
name will be null if we're using spark-submit to submit applications.
---
If your project is set up for it, you can reply t
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15134
**[Test build #6 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/6/consoleFull)**
for PR 15134 at commit
[`eec4796`](https://github.com/apache/spark/commit/e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15134
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15134
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65550/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15134
**[Test build #65550 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65550/consoleFull)**
for PR 15134 at commit
[`7a5946d`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15134
**[Test build #65550 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65550/consoleFull)**
for PR 15134 at commit
[`7a5946d`](https://github.com/apache/spark/commit/7
25 matches
Mail list logo
