[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-23 Thread KaiXinXiaoLei 
Github user KaiXinXiaoLei closed the pull request at:

https://github.com/apache/spark/pull/9129


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-23 Thread vanzin 
Github user vanzin commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-150726097
  
@KaiXinXiaoLei could you please close this PR?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-16 Thread andrewor14 
Github user andrewor14 commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148792900
  
@KaiXinXiaoLei can you close this PR? Also next time please open an 
accompanying JIRA and add it to the title of your PR.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-15 Thread AmplabJenkins 
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148292467
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43766/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-15 Thread SparkQA 
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148292403
  
  [Test build #43766 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43766/console)
 for   PR 9129 at commit 
[`ec8d4f7`](https://github.com/apache/spark/commit/ec8d4f7561de1a73ca4195fd0b9883864784f5fd).
 * This patch **passes all tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-15 Thread AmplabJenkins 
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148292465
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-15 Thread vanzin 
Github user vanzin commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148525127
  
This is not correct.

(i) The return type of that RPC is `ExecutorLossReason` not `Boolean`
(ii) The reply to that RPC is actually handled by 
`YarnAllocator::processCompletedContainers`. The reply does not need to be sent 
immediately by the `receiveAndReply` method.

Could you please close this PR?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-14 Thread KaiXinXiaoLei 
Github user KaiXinXiaoLei commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148273400
  
Jenkins failed is not caused by my code. Please retest please. Thanks. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-14 Thread KaiXinXiaoLei 
GitHub user KaiXinXiaoLei opened a pull request:

https://github.com/apache/spark/pull/9129

[YARN] When driver sends message "GetExecutorLossReason" to AM, there 
should have reture value

I get lastest code form github, and just run "bin/spark-shell  --master 
yarn --conf spark.dynamicAllocation.enabled=true --conf 
spark.dynamicAllocation.initialExecutors=1 --conf 
spark.shuffle.service.enabled=true". There is error infor:
15/10/13 10:20:06 ERROR TransportChannelHandler: Connection to /IP:45380 
has been quiet for 12 ms while there are outstanding requests. Assuming 
connection is dead; please adjust spark.network.timeout if this is wrong.
15/10/13 10:20:06 ERROR TransportResponseHandler: Still have 1 requests 
outstanding when connection from HOSTNAME/IP:45380 is closedclosed.

From log, when driver sends message "GetExecutorLossReason" to AM, the 
error appears. From code, i think AM  gets this message, should reply.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/KaiXinXiaoLei/spark ExecutorLostReasonReturn

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/9129.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #9129


commit ec8d4f7561de1a73ca4195fd0b9883864784f5fd
Author: KaiXinXiaoLei 
Date:   2015-10-15T02:28:51Z

there should have reture value




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-14 Thread AmplabJenkins 
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148264466
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-14 Thread AmplabJenkins 
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148264534
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-14 Thread SparkQA 
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148266577
  
  [Test build #43762 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43762/consoleFull)
 for   PR 9129 at commit 
[`ec8d4f7`](https://github.com/apache/spark/commit/ec8d4f7561de1a73ca4195fd0b9883864784f5fd).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-14 Thread AmplabJenkins 
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148270024
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43762/
Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-14 Thread SparkQA 
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148270003
  
  [Test build #43762 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43762/console)
 for   PR 9129 at commit 
[`ec8d4f7`](https://github.com/apache/spark/commit/ec8d4f7561de1a73ca4195fd0b9883864784f5fd).
 * This patch **fails MiMa tests**.
 * This patch merges cleanly.
 * This patch adds the following public classes _(experimental)_:
  * `case class HyperLogLogPlusPlus(`



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-14 Thread AmplabJenkins 
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148270023
  
Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-14 Thread AmplabJenkins 
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148287554
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-14 Thread AmplabJenkins 
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148287571
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-14 Thread KaiXinXiaoLei 
Github user KaiXinXiaoLei commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148287449
  
Jenkins, retest this please.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request: [YARN] When driver sends message "GetExecutorL...

2015-10-14 Thread SparkQA 
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/9129#issuecomment-148289864
  
  [Test build #43766 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43766/consoleFull)
 for   PR 9129 at commit 
[`ec8d4f7`](https://github.com/apache/spark/commit/ec8d4f7561de1a73ca4195fd0b9883864784f5fd).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org