[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-150726097 @KaiXinXiaoLei could you please close this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user KaiXinXiaoLei closed the pull request at: https://github.com/apache/spark/pull/9129 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
GitHub user KaiXinXiaoLei opened a pull request: https://github.com/apache/spark/pull/9129 [YARN] When driver sends message "GetExecutorLossReason" to AM, there should have reture value I get lastest code form github, and just run "bin/spark-shell --master yarn --conf spark.dynamicAllocation.enabled=true --conf spark.dynamicAllocation.initialExecutors=1 --conf spark.shuffle.service.enabled=true". There is error infor: 15/10/13 10:20:06 ERROR TransportChannelHandler: Connection to /IP:45380 has been quiet for 12 ms while there are outstanding requests. Assuming connection is dead; please adjust spark.network.timeout if this is wrong. 15/10/13 10:20:06 ERROR TransportResponseHandler: Still have 1 requests outstanding when connection from HOSTNAME/IP:45380 is closedclosed. From log, when driver sends message "GetExecutorLossReason" to AM, the error appears. From code, i think AM gets this message, should reply. You can merge this pull request into a Git repository by running: $ git pull https://github.com/KaiXinXiaoLei/spark ExecutorLostReasonReturn Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/9129.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #9129 commit ec8d4f7561de1a73ca4195fd0b9883864784f5fd Author: KaiXinXiaoLei Date: 2015-10-15T02:28:51Z there should have reture value --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148264534 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148264466 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148266577 [Test build #43762 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43762/consoleFull) for PR 9129 at commit [`ec8d4f7`](https://github.com/apache/spark/commit/ec8d4f7561de1a73ca4195fd0b9883864784f5fd). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148270003 [Test build #43762 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43762/console) for PR 9129 at commit [`ec8d4f7`](https://github.com/apache/spark/commit/ec8d4f7561de1a73ca4195fd0b9883864784f5fd). * This patch **fails MiMa tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `case class HyperLogLogPlusPlus(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148270023 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148270024 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43762/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user KaiXinXiaoLei commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148273400 Jenkins failed is not caused by my code. Please retest please. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user KaiXinXiaoLei commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148287449 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148287554 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148287571 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148289864 [Test build #43766 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43766/consoleFull) for PR 9129 at commit [`ec8d4f7`](https://github.com/apache/spark/commit/ec8d4f7561de1a73ca4195fd0b9883864784f5fd). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148292465 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148292467 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43766/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148292403 [Test build #43766 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43766/console) for PR 9129 at commit [`ec8d4f7`](https://github.com/apache/spark/commit/ec8d4f7561de1a73ca4195fd0b9883864784f5fd). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148525127 This is not correct. (i) The return type of that RPC is `ExecutorLossReason` not `Boolean` (ii) The reply to that RPC is actually handled by `YarnAllocator::processCompletedContainers`. The reply does not need to be sent immediately by the `receiveAndReply` method. Could you please close this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/9129#issuecomment-148792900 @KaiXinXiaoLei can you close this PR? Also next time please open an accompanying JIRA and add it to the title of your PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org