[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user xuchenCN commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-124298551 @SaintBacchus not so far , any idea for this ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user SaintBacchus commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-123997780 Meet this problem too, do you have any update informations @xuchenCN @darkcrawler01 ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user xuchenCN commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-120891504 Hi @darkcrawler01 I see the log and this patch looks good to you --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user darkcrawler01 commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-121131749 i see .. thanks .. just to get more insight .. is there any specific reason as to why this is happening ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user xuchenCN commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-121137474 I follow the code maybe is lazy declare actorRef value ? and akka internal problem? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user xuchenCN commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-121117560 @darkcrawler01 I mean this pull request will fix your issue --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user darkcrawler01 commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-120949465 @xuchenCN : sorry .. what PR ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user xuchenCN commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-120793051 Hi @darkcrawler01 Could you provide detail log? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user darkcrawler01 commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-12081 ```java 15/07/12 14:17:31 ERROR executor.CoarseGrainedExecutorBackend: Cannot register with driver: akka.tcp://sparkDriver@10.211.55.3:41698/user/CoarseGrainedScheduler java.lang.NullPointerException at org.apache.spark.rpc.akka.AkkaRpcEndpointRef.actorRef$lzycompute(AkkaRpcEnv.scala:273) at org.apache.spark.rpc.akka.AkkaRpcEndpointRef.actorRef(AkkaRpcEnv.scala:273) at org.apache.spark.rpc.akka.AkkaRpcEndpointRef.toString(AkkaRpcEnv.scala:313) at java.lang.String.valueOf(String.java:2981) at scala.collection.mutable.StringBuilder.append(StringBuilder.scala:197) at org.apache.spark.scheduler.cluster.CoarseGrainedSchedulerBackend$DriverEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$3.apply(CoarseGrainedSchedulerBackend.scala:125) at org.apache.spark.scheduler.cluster.CoarseGrainedSchedulerBackend$DriverEndpoint$$anonfun$receiveAndReply$1$$anonfun$applyOrElse$3.apply(CoarseGrainedSchedulerBackend.scala:125) at org.apache.spark.Logging$class.logInfo(Logging.scala:59) at org.apache.spark.scheduler.cluster.CoarseGrainedSchedulerBackend$DriverEndpoint.logInfo(CoarseGrainedSchedulerBackend.scala:69) at org.apache.spark.scheduler.cluster.CoarseGrainedSchedulerBackend$DriverEndpoint$$anonfun$receiveAndReply$1.applyOrElse(CoarseGrainedSchedulerBackend.scala:125) at org.apache.spark.rpc.akka.AkkaRpcEnv.org$apache$spark$rpc$akka$AkkaRpcEnv$$processMessage(AkkaRpcEnv.scala:178) at org.apache.spark.rpc.akka.AkkaRpcEnv$$anonfun$actorRef$lzycompute$1$1$$anon$1$$anonfun$receiveWithLogging$1$$anonfun$applyOrElse$4.apply$mcV$sp(AkkaRpcEnv.scala:127) at org.apache.spark.rpc.akka.AkkaRpcEnv.org$apache$spark$rpc$akka$AkkaRpcEnv$$safelyCall(AkkaRpcEnv.scala:198) at org.apache.spark.rpc.akka.AkkaRpcEnv$$anonfun$actorRef$lzycompute$1$1$$anon$1$$anonfun$receiveWithLogging$1.applyOrElse(AkkaRpcEnv.scala:126) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.spark.util.ActorLogReceive$$anon$1.apply(ActorLogReceive.scala:59) at org.apache.spark.util.ActorLogReceive$$anon$1.apply(ActorLogReceive.scala:42) at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118) at org.apache.spark.util.ActorLogReceive$$anon$1.applyOrElse(ActorLogReceive.scala:42) at akka.actor.Actor$class.aroundReceive(Actor.scala:465) at org.apache.spark.rpc.akka.AkkaRpcEnv$$anonfun$actorRef$lzycompute$1$1$$anon$1.aroundReceive(AkkaRpcEnv.scala:93) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) at akka.actor.ActorCell.invoke(ActorCell.scala:487) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238) at akka.dispatch.Mailbox.run(Mailbox.scala:220) at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:393) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) ``` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user darkcrawler01 commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-120751915 Hello .. I am consistently facing this issue. I am running a yarn cluster on my laptop. The executors fail with `executor.CoarseGrainedExecutorBackend: Cannot register with driver: akka.tcp://sparkDriver@10.211.55.3:45042/user/CoarseGrainedScheduler`. New executors are not getting created in the place of these failed executors and the Spark application stops processing any requests. Any solution for this issue ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user xuchenCN commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-117052889 Finally build success , thanks @JoshRosen care for this PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-117258529 Per my comment on the earlier PR, this looks good to me. I'm going to merge this into master but defer merging it into 1.4 for now since I don't want to cause the `--jars` test to fail in that branch. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7110 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-117005934 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-117005402 [Test build #36079 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36079/console) for PR 7110 at commit [`71e0077`](https://github.com/apache/spark/commit/71e0077d5c860d2d06b4265de9c21700be661d9b). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116742573 Jenkins, this is ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116761721 [Test build #35999 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35999/consoleFull) for PR 7077 at commit [`6dfdfbc`](https://github.com/apache/spark/commit/6dfdfbc0425985e9a512fb612be94eee0f743152). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116761771 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116743021 LGTM, since this is consistent with how we handle other errors in `CoarseGrainedExecutorBackend`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116744660 [Test build #35999 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35999/consoleFull) for PR 7077 at commit [`6dfdfbc`](https://github.com/apache/spark/commit/6dfdfbc0425985e9a512fb612be94eee0f743152). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116764897 [Test build #36004 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36004/consoleFull) for PR 7077 at commit [`6dfdfbc`](https://github.com/apache/spark/commit/6dfdfbc0425985e9a512fb612be94eee0f743152). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116744229 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116744260 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116764561 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116764517 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116763438 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116885584 [Test build #36055 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36055/consoleFull) for PR 7077 at commit [`6dfdfbc`](https://github.com/apache/spark/commit/6dfdfbc0425985e9a512fb612be94eee0f743152). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116795861 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116796224 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116796249 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116796499 [Test build #36014 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36014/consoleFull) for PR 7077 at commit [`6dfdfbc`](https://github.com/apache/spark/commit/6dfdfbc0425985e9a512fb612be94eee0f743152). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116791475 [Test build #36004 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36004/consoleFull) for PR 7077 at commit [`6dfdfbc`](https://github.com/apache/spark/commit/6dfdfbc0425985e9a512fb612be94eee0f743152). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116791603 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116832856 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116832797 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116834302 [Test build #36028 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36028/consoleFull) for PR 7077 at commit [`6dfdfbc`](https://github.com/apache/spark/commit/6dfdfbc0425985e9a512fb612be94eee0f743152). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116859209 [Test build #36028 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36028/consoleFull) for PR 7077 at commit [`6dfdfbc`](https://github.com/apache/spark/commit/6dfdfbc0425985e9a512fb612be94eee0f743152). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116832037 Wow, tests are really flaky today... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116832055 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116859295 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116867600 Looks like this is consistently failing SparkSubmitSuite: ``` [info] - includes jars passed in through --jars *** FAILED *** (1 minute) ``` I wonder if this can be reproduced locally. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116830955 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116830742 [Test build #36014 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36014/consoleFull) for PR 7077 at commit [`6dfdfbc`](https://github.com/apache/spark/commit/6dfdfbc0425985e9a512fb612be94eee0f743152). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
GitHub user xuchenCN opened a pull request: https://github.com/apache/spark/pull/7077 [SPARK-8592] [CORE] CoarseGrainedExecutorBackend: Cannot register with driver = NPE Look detail of this issue at [SPARK-8592](https://issues.apache.org/jira/browse/SPARK-8592) **CoarseGrainedExecutorBackend** should exit when **RegisterExecutor** failed You can merge this pull request into a Git repository by running: $ git pull https://github.com/xuchenCN/spark SPARK-8592 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/7077.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #7077 commit 6dfdfbc0425985e9a512fb612be94eee0f743152 Author: xuchenCN chenxu198...@gmail.com Date: 2015-06-29T05:43:10Z [SPARK-8592] [CORE] CoarseGrainedExecutorBackend: Cannot register with driver = NPE --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116461351 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116913687 Yeah, in this case it looks like a legitimate failure. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116913517 I'm not sure if this is flaky... this particular test has failed a bunch of times in a row for this PR, so unless we've been unusually unlucky I think that there might actually be a problem here. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-116934991 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-116935068 [Test build #36079 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36079/consoleFull) for PR 7110 at commit [`71e0077`](https://github.com/apache/spark/commit/71e0077d5c860d2d06b4265de9c21700be661d9b). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-116935000 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116885235 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116885208 retest this please. SparkSubmitSuite --jars is really flaky... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116885225 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7110#issuecomment-116934664 Jenkins, this is ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user xuchenCN commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116934136 PR changes to [https://github.com/apache/spark/pull/7110](https://github.com/apache/spark/pull/7110) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
GitHub user xuchenCN opened a pull request: https://github.com/apache/spark/pull/7110 [SPARK-8592] [CORE] CoarseGrainedExecutorBackend: Cannot register with driver = NPE Look detail of this issue at [SPARK-8592](https://issues.apache.org/jira/browse/SPARK-8592) **CoarseGrainedExecutorBackend** should exit when **RegisterExecutor** failed You can merge this pull request into a Git repository by running: $ git pull https://github.com/xuchenCN/spark SPARK-8592 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/7110.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #7110 commit 71e0077d5c860d2d06b4265de9c21700be661d9b Author: xuchenCN chenxu198...@gmail.com Date: 2015-06-30T03:29:19Z [SPARK-8592] [CORE] CoarseGrainedExecutorBackend: Cannot register with driver = NPE --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116910259 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116910243 [Test build #36055 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36055/consoleFull) for PR 7077 at commit [`6dfdfbc`](https://github.com/apache/spark/commit/6dfdfbc0425985e9a512fb612be94eee0f743152). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user xuchenCN closed the pull request at: https://github.com/apache/spark/pull/7077 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8592] [CORE] CoarseGrainedExecutorBacke...
Github user xuchenCN commented on the pull request: https://github.com/apache/spark/pull/7077#issuecomment-116932736 Have no idea for this test ,so I will pull request from master branch --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org