[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-27 Thread vanzin
Github user vanzin commented on the pull request:

https://github.com/apache/spark/pull/9268#issuecomment-151415322
  
#8887 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-26 Thread KaiXinXiaoLei
Github user KaiXinXiaoLei commented on the pull request:

https://github.com/apache/spark/pull/9268#issuecomment-151341056
  
ok. Can you tell me the url of PR. thanks.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-26 Thread KaiXinXiaoLei
Github user KaiXinXiaoLei closed the pull request at:

https://github.com/apache/spark/pull/9268


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-26 Thread vanzin
Github user vanzin commented on the pull request:

https://github.com/apache/spark/pull/9268#issuecomment-151187351
  
I already have a PR with a fix for this problem out for review.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-26 Thread KaiXinXiaoLei
Github user KaiXinXiaoLei commented on the pull request:

https://github.com/apache/spark/pull/9268#issuecomment-151049814
  
@vanzin I add  a reply, the command is run ok. So i submit a PR. If the fix 
is wrong, can you give me a idea to fix this problem.  Thanks.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-26 Thread vanzin
Github user vanzin commented on the pull request:

https://github.com/apache/spark/pull/9268#issuecomment-151047372
  
Your command is not wrong and the usage is not wrong. The PR is wrong. It's 
the wrong fix for the problem.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-25 Thread KaiXinXiaoLei
Github user KaiXinXiaoLei commented on the pull request:

https://github.com/apache/spark/pull/9268#issuecomment-151044681
  
@vanzin  But i run :


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-25 Thread vanzin
Github user vanzin commented on the pull request:

https://github.com/apache/spark/pull/9268#issuecomment-150993281
  
This change is still not correct. I already have a fix for the issue you're 
trying to fix out for review. Please close this PR.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/9268#issuecomment-150900205
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44312/
Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/9268#issuecomment-150900204
  
Merged build finished. Test PASSed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-25 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/9268#issuecomment-150900188
  
**[Test build #44312 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44312/consoleFull)**
 for PR 9268 at commit 
[`cf661de`](https://github.com/apache/spark/commit/cf661ded1f864d9bb75293a63f758640c847010f).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds the following public classes _(experimental)_:\n  * `
logError(\"Sink class \" + classPath + \" cannot be instantiated\")`\n


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-25 Thread SparkQA
Github user SparkQA commented on the pull request:

https://github.com/apache/spark/pull/9268#issuecomment-150899445
  
**[Test build #44312 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44312/consoleFull)**
 for PR 9268 at commit 
[`cf661de`](https://github.com/apache/spark/commit/cf661ded1f864d9bb75293a63f758640c847010f).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/9268#issuecomment-150899253
  
Merged build started.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-24 Thread KaiXinXiaoLei
GitHub user KaiXinXiaoLei opened a pull request:

https://github.com/apache/spark/pull/9268

[SPARK-11298] When driver sends message "GetExecutorLossReason" to AM, the 
SparkContext may be stop

I get lastest code form github, and just run "bin/spark-shell --master yarn 
--conf spark.dynamicAllocation.enabled=true --conf 
spark.dynamicAllocation.initialExecutors=1 --conf 
spark.shuffle.service.enabled=true". There is error infor:
15/10/25 12:11:02 ERROR TransportChannelHandler: Connection to 
/9.96.1.113:35066 has been quiet for 12 ms while there are outstanding 
requests. Assuming connection is dead; please adjust spark.network.timeout if 
this is wrong.
15/10/25 12:11:02 ERROR TransportResponseHandler: Still have 1 requests 
outstanding when connection from vm113/9.96.1.113:35066 is closed
15/10/25 12:11:02 WARN NettyRpcEndpointRef: Ignore message 
Failure(java.io.IOException: Connection from vm113/9.96.1.113:35066 closed)
15/10/25 12:11:02 ERROR YarnScheduler: Lost executor 1 on vm111: Slave lost

From log, when driver sends message "GetExecutorLossReason" to AM, the 
error appears. From code, i think AM gets this message, should reply.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/KaiXinXiaoLei/spark replayAM

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/9268.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #9268


commit cf661ded1f864d9bb75293a63f758640c847010f
Author: KaiXinXiaoLei 
Date:   2015-10-25T06:33:01Z

reply




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request:

https://github.com/apache/spark/pull/9268#issuecomment-150896693
  
 Merged build triggered.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org