Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22504
Oh, you should also remove yarn from the PR title. This isn't really
related to yarn in any way (anymore).
---
-
To unsubscribe,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96958/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96958 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96958/testReport)**
for PR 22504 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96956/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96956 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96956/testReport)**
for PR 22504 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96958 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96958/testReport)**
for PR 22504 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96956 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96956/testReport)**
for PR 22504 at commit
Github user ankuriitg commented on the issue:
https://github.com/apache/spark/pull/22504
I looked further into it and it seems that writing to yarn app dir will
mean following certain guidelines: writing filelength, acls, owner, version,
using a compression algorithm, etc. And since
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96902/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96902 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96902/testReport)**
for PR 22504 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96902 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96902/testReport)**
for PR 22504 at commit
Github user ankuriitg commented on the issue:
https://github.com/apache/spark/pull/22504
Got it, I didn't test that. Let me verify that and explore alternate
options.
---
-
To unsubscribe, e-mail:
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/22504
to clarify what I mean "by work", I mean in order for the "yarn logs"
command to read it properly.
---
-
To unsubscribe,
Github user ankuriitg commented on the issue:
https://github.com/apache/spark/pull/22504
It worked in my environment but let me look at hadoop classes to see if it
can be done in a better manner. Meanwhile, I will merge the cleaner code in
this PR.
---
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/22504
its good its optional, but I think if we say we support it internally to
Spark we need to make sure its done properly and works for most yarn setups.
Did you look at using the hadoop
Github user ankuriitg commented on the issue:
https://github.com/apache/spark/pull/22504
Also, for our use case, we are planning to get the logs just via yarn logs
---
-
To unsubscribe, e-mail:
Github user ankuriitg commented on the issue:
https://github.com/apache/spark/pull/22504
Thanks for your comment @tgravescs
Moving the file to yarn logs app dir is optional and users can choose to
disable that. In my case, If they only enable syncToHdfs, the file will be
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/22504
while I see this as being a nice feature, I'm a bit hesitant of the yarn
logs part of this. You are essentially duplicating the yarn nodemanager logic
and assuming you know what its doing.
Github user ankuriitg commented on the issue:
https://github.com/apache/spark/pull/22504
Sure, let me do that
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22504
Just open a separate JIRA, PR to fix it. I suspect we shouldn't run a Spark
job in toString.
---
-
To unsubscribe, e-mail:
Github user ankuriitg commented on the issue:
https://github.com/apache/spark/pull/22504
@srowen - the bug is causing a unit-test failure on this PR. How should I
resolve it?
---
-
To unsubscribe, e-mail:
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22504
@ankuriitg if so please fix it separately; this is a big change that's not
directly related
---
-
To unsubscribe, e-mail:
Github user ankuriitg commented on the issue:
https://github.com/apache/spark/pull/22504
@srowen @jkbradley - it seems that my PR has uncovered some bug in another
class. GeneralizedLinearRegressionTrainingSummary.toString actually runs a
Spark job, so it ends up into an infinite
Github user ankuriitg commented on the issue:
https://github.com/apache/spark/pull/22504
Yes, I will try to reproduce it locally
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user bersprockets commented on the issue:
https://github.com/apache/spark/pull/22504
The Py4JJavaError StackOverflow happens pretty reliably. I am guessing its
related to the change.
---
-
To unsubscribe,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96729/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96729 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96729/testReport)**
for PR 22504 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96729 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96729/testReport)**
for PR 22504 at commit
Github user bersprockets commented on the issue:
https://github.com/apache/spark/pull/22504
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96717/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96717 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96717/testReport)**
for PR 22504 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96717 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96717/testReport)**
for PR 22504 at commit
Github user bersprockets commented on the issue:
https://github.com/apache/spark/pull/22504
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96577/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96577 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96577/testReport)**
for PR 22504 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96576/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96576 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96576/testReport)**
for PR 22504 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96577 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96577/testReport)**
for PR 22504 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96576 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96576/testReport)**
for PR 22504 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96384/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96384 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96384/testReport)**
for PR 22504 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #96384 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96384/testReport)**
for PR 22504 at commit
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22504
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user ankuriitg commented on the issue:
https://github.com/apache/spark/pull/22504
cc: @vanzin @squito
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
55 matches
Mail list logo
