Re: One of the executor not getting StopExecutor message

2015-02-27 Thread Akhil Das
Mostly, that particular executor is stuck on GC Pause, what operation are you performing? You can try increasing the parallelism if you see only 1 executor is doing the task. Thanks Best Regards On Fri, Feb 27, 2015 at 11:39 AM, twinkle sachdeva < twinkle.sachd...@gmail.com> wrote: > Hi, > > I a

Re: One of the executor not getting StopExecutor message

2015-03-03 Thread twinkle sachdeva
Hi, Operations are not very extensive, as this scenario is not always reproducible. One of the executor start behaving in this manner. For this particular application, we are using 8 cores in one executors, and practically, 4 executors are launched on one machine. This machine has good config wit

Re: One of the executor not getting StopExecutor message

2015-03-03 Thread Akhil Das
Not quite sure, but you can try increasing the spark.akka.threads, most likely it can be a yarn related issue. Thanks Best Regards On Tue, Mar 3, 2015 at 3:38 PM, twinkle sachdeva wrote: > Hi, > > Operations are not very extensive, as this scenario is not always > reproducible. > One of the exe