Github user ArtRand commented on the issue:
https://github.com/apache/spark/pull/19272
@vanzin Thanks for the reviews and mentorship!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19272
Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83912/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83912 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83912/testReport)**
for PR 19272 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83912 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83912/testReport)**
for PR 19272 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83863/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83863 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83863/testReport)**
for PR 19272 at commit
Github user ArtRand commented on the issue:
https://github.com/apache/spark/pull/19272
@vanzin PTAL.
I removed the awkward `mode` parameter from the token manager. Now we only
start the renewer thread when using a keytab/principal. The condition is logged
appropriately.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83863 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83863/testReport)**
for PR 19272 at commit
Github user ArtRand commented on the issue:
https://github.com/apache/spark/pull/19272
Hello @maverick2202, hopefully 2.3 (and maybe back ported?) but that's up
to the Committers.
---
-
To unsubscribe, e-mail:
Github user maverick2202 commented on the issue:
https://github.com/apache/spark/pull/19272
We want to use this feature and will be great if this can be merged. Any
idea which spark release will have it.
---
-
To
Github user ArtRand commented on the issue:
https://github.com/apache/spark/pull/19272
Hello @vanzin thanks for the continued help with this, anything else
needed?
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83661/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83661 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83661/testReport)**
for PR 19272 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83660/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83660 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83660/testReport)**
for PR 19272 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83661 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83661/testReport)**
for PR 19272 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83660 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83660/testReport)**
for PR 19272 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83607/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83607 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83607/testReport)**
for PR 19272 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83607 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83607/testReport)**
for PR 19272 at commit
Github user ArtRand commented on the issue:
https://github.com/apache/spark/pull/19272
Hello @vanzin thanks for continuing to help with this. Please take another
look at this refactor.
In this change, there is one place to interact with
`hadoopDelegationTokens` from
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83493/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83493 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83493/testReport)**
for PR 19272 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83493 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83493/testReport)**
for PR 19272 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83468 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83468/testReport)**
for PR 19272 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83468/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83468 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83468/testReport)**
for PR 19272 at commit
Github user ArtRand commented on the issue:
https://github.com/apache/spark/pull/19272
@vanzin Thanks for the continued review. I addressed the comments you left.
PTAL.
It seems simplest and more robust to keep the serialized `Credentials`
within
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83262/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83262 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83262/testReport)**
for PR 19272 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83262 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83262/testReport)**
for PR 19272 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83235/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83235 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83235/testReport)**
for PR 19272 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #83235 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83235/testReport)**
for PR 19272 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82955/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #82955 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82955/testReport)**
for PR 19272 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #82955 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82955/testReport)**
for PR 19272 at commit
Github user ArtRand commented on the issue:
https://github.com/apache/spark/pull/19272
Retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82941/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #82941 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82941/testReport)**
for PR 19272 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #82941 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82941/testReport)**
for PR 19272 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82919/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #82919 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82919/testReport)**
for PR 19272 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #82919 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82919/testReport)**
for PR 19272 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82870/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #82870 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82870/testReport)**
for PR 19272 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #82870 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82870/testReport)**
for PR 19272 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82777/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #82777 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82777/testReport)**
for PR 19272 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #82777 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82777/testReport)**
for PR 19272 at commit
Github user ArtRand commented on the issue:
https://github.com/apache/spark/pull/19272
@vanzin Thanks for the review. I'll address the comments ASAP.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82602/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19272
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #82602 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82602/testReport)**
for PR 19272 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19272
**[Test build #82602 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82602/testReport)**
for PR 19272 at commit
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19272
add to whitelist
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19272
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user ArtRand commented on the issue:
https://github.com/apache/spark/pull/19272
@kalvinnchau I'm running Hadoop 2.6 on a DC/OS cluster with Mesos 1.4.0
---
-
To unsubscribe, e-mail:
Github user kalvinnchau commented on the issue:
https://github.com/apache/spark/pull/19272
@ArtRand curious, what version of hadoop are you build spark against and
what version is the cluster that you're running?
---
Github user ArtRand commented on the issue:
https://github.com/apache/spark/pull/19272
Hello @vanzin
Thanks for taking a look at this. Good to know that there can be downstream
errors depending on the situation.
Would very much appreciate a proper review on this
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19272
What you wrote sounds correct. However, I've seen errors like the ones
above in the past, but haven't been able to fully debug them due to lack of
logs. Part of it is because the user running the
Github user ArtRand commented on the issue:
https://github.com/apache/spark/pull/19272
Hey @kalvinnchau thanks for having the patience to try this. This is a
curious error though.
If you look at the `addAll` method called by
`UserGroupInformation.addCredentials()` it should
Github user kalvinnchau commented on the issue:
https://github.com/apache/spark/pull/19272
@ArtRand thanks! I've been testing a local version of doing that, I'll pull
that change in and test it as well.
---
-
To
Github user ArtRand commented on the issue:
https://github.com/apache/spark/pull/19272
Hey @kalvinnchau good catch on the first renewal time. I believe I
addressed it. Have a look. Thanks again.
---
-
To
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/19272
When executor is started it asks from CoarseSchedulerBackend the spark
config which contains the hadoop credentials
80 matches
Mail list logo
