Can you try setting the following while creating the sparkContext and see
if the issue still exists?
.set("spark.core.connection.ack.wait.timeout","900")
.set("spark.akka.frameSize","50")
.set("spark.akka.timeout","900")
Looks like your executor is stuck on GC Pause.
Thanks
Best Regards
On Wed, Oct 29, 2014 at 9:20 PM, akhandeshi <ami.khande...@gmail.com> wrote:
> Thanks...hmm.... It is seems to be a timeout issue perhaps?? Not sure what
> is causing it? or how to debug?
>
> I see following error message...
>
> 4/10/29 13:26:04 ERROR ContextCleaner: Error cleaning broadcast 9
> akka.pattern.AskTimeoutException: Timed out
> at
> akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:334)
> at akka.actor.Scheduler$$anon$11.run(Scheduler.scala:118)
> at
>
> scala.concurrent.Future$InternalCallbackExecutor$.scala$concurrent$Future$InternalCallbackExecutor$
> $unbatchedExecute(Future.scala:694)
> at
> scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:691)
> at
>
> akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(Scheduler.scala:455)
> at
>
> akka.actor.LightArrayRevolverScheduler$$anon$12.executeBucket$1(Scheduler.scala:407)
> at
>
> akka.actor.LightArrayRevolverScheduler$$anon$12.nextTick(Scheduler.scala:411)
> at
> akka.actor.LightArrayRevolverScheduler$$anon$12.run(Scheduler.scala:363)
> at java.lang.Thread.run(Thread.java:745)
> 14/10/29 13:26:04 WARN BlockManagerMaster: Failed to remove broadcast 9
> with
> removeFromMaster = true - Timed o
> ut}
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/CANNOT-FIND-ADDRESS-tp17637p17646.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
>
