Mostly, that particular executor is stuck on GC Pause, what operation are
you performing? You can try increasing the parallelism if you see only 1
executor is doing the task.
Thanks
Best Regards
On Fri, Feb 27, 2015 at 11:39 AM, twinkle sachdeva <
twinkle.sachd...@gmail.com> wrote:
> Hi,
>
> I a
Hi,
Operations are not very extensive, as this scenario is not always
reproducible.
One of the executor start behaving in this manner. For this particular
application, we are using 8 cores in one executors, and practically, 4
executors are launched on one machine.
This machine has good config wit
Not quite sure, but you can try increasing the spark.akka.threads, most
likely it can be a yarn related issue.
Thanks
Best Regards
On Tue, Mar 3, 2015 at 3:38 PM, twinkle sachdeva wrote:
> Hi,
>
> Operations are not very extensive, as this scenario is not always
> reproducible.
> One of the exe