[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2016-05-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-218707783 **[Test build #58467 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58467/consoleFull)** for PR 9875 at commit

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2016-05-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-218707787 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2016-05-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-218707788 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2016-05-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-218706876 **[Test build #58467 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58467/consoleFull)** for PR 9875 at commit

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-30 Thread djdean
Github user djdean commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-160785941 After applying the provided patch things still do not work. I've been doing some debugging, I've found some additional information. When it works, it seems that two

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-24 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-159281467 If we are going to include the fix for the issue @SaintBacchus mentioned then I think the right thing is to only login from the keytab or get the tokens (not both).

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-24 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-159241477 Is the situation where the client can only have tokens need to be covered? As users may not have keytabs, only kinit-granted tickets, and they still have the

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-23 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-159085964 Also, to be clear..it would work fine in Cluster mode. In Client mode, #7394 should have taken care of the long-running app issue (though there was one where

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-23 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158958240 @harishreedharan I thought this issue existed even without reusing the jvm (going by other jira and prs that were filed)? For instance if you just have a long

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-23 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158988545 Yes, that is correct but this happens even without the tokens expiring. What do you think about doing the relogin in the YarnCLientSchedulerBackend?

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-20 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158563127 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158563415 **[Test build #46454 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46454/consoleFull)** for PR 9875 at commit

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158567864 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158567863 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158568193 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158568143 **[Test build #46454 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46454/consoleFull)** for PR 9875 at commit

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158568192 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-20 Thread harishreedharan
GitHub user harishreedharan opened a pull request: https://github.com/apache/spark/pull/9875 [SPARK-11662] [YARN]. In Client mode, make sure we re-login before at… …tempting to create new delegation tokens if a new SparkContext is created within the same application.

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158565442 **[Test build #46458 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46458/consoleFull)** for PR 9875 at commit

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158567789 **[Test build #46458 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46458/consoleFull)** for PR 9875 at commit

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-20 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158573009 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158573490 **[Test build #46466 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46466/consoleFull)** for PR 9875 at commit

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158576879 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158576880 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11662] [YARN]. In Client mode, make sur...

2015-11-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9875#issuecomment-158576831 **[Test build #46466 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46466/consoleFull)** for PR 9875 at commit