[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2016-02-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10475 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2016-02-24 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-188497081 I was going to merge into branch 1.6 but they are supposed to be starting 1.6.1 so I'll wait and get this in after that. --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2016-02-18 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-185734465 lgtm. leaving it open for a bit to see if anyone else has comments. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2016-02-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-185516229 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2016-02-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-185516233 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2016-02-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-185515876 **[Test build #51455 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51455/consoleFull)** for PR 10475 at commit

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2016-02-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-185511601 **[Test build #51455 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51455/consoleFull)** for PR 10475 at commit

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2016-02-17 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/10475#discussion_r53174906 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/ExecutorDelegationTokenUpdater.scala --- @@ -76,7 +76,8 @@ private[spark] class

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2016-02-17 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-185238025 Since the call to the executorUpdaterRunnable.run() is after we checked to see if new credentials were there I think this is ok to do. We just tried to update and

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2016-02-09 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-182108807 @SaintBacchus posting question here as well; you say "endless cycle call" do you mean the application master hangs? It seems like it should throw and if the

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2016-02-08 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-181398156 please see question in jira --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-178225888 @tgravescs @harishreedharan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2015-12-30 Thread SaintBacchus
Github user SaintBacchus commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-168105166 This only work in cluster, but this is easy to reproduce in cluster 1. Start-up a yarn-client spark application 2. Remove the staging dir when AM

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2015-12-28 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-167655015 CC: @harishreedharan @SaintBacchus could you add test cases for this change? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2015-12-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-167204565 **[Test build #48321 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48321/consoleFull)** for PR 10475 at commit

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2015-12-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-167205800 **[Test build #48321 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48321/consoleFull)** for PR 10475 at commit

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2015-12-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-167205989 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2015-12-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10475#issuecomment-167205992 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12316] Wait a minutes to avoid cycle ca...

2015-12-24 Thread SaintBacchus
GitHub user SaintBacchus opened a pull request: https://github.com/apache/spark/pull/10475 [SPARK-12316] Wait a minutes to avoid cycle calling. When application end, AM will clean the staging dir. But if the driver trigger to update the delegation token, it will can't find the