Hi,
Operations are not very extensive, as this scenario is not always
reproducible.
One of the executor start behaving in this manner. For this particular
application, we are using 8 cores in one executors, and practically, 4
executors are launched on one machine.
This machine has good config
Not quite sure, but you can try increasing the spark.akka.threads, most
likely it can be a yarn related issue.
Thanks
Best Regards
On Tue, Mar 3, 2015 at 3:38 PM, twinkle sachdeva twinkle.sachd...@gmail.com
wrote:
Hi,
Operations are not very extensive, as this scenario is not always
Mostly, that particular executor is stuck on GC Pause, what operation are
you performing? You can try increasing the parallelism if you see only 1
executor is doing the task.
Thanks
Best Regards
On Fri, Feb 27, 2015 at 11:39 AM, twinkle sachdeva
twinkle.sachd...@gmail.com wrote:
Hi,
I am
Hi,
I am running a spark application on Yarn in cluster mode.
One of my executor appears to be in hang state, for a long time, and gets
finally killed by the driver.
As compared to other executors, It have not received StopExecutor message
from the driver.
Here are the logs at the end of this
