Re: Spark stalling during shuffle (maybe a memory issue)

2016-11-13 Thread bogdanbaraila
The issue was fixed for me by allocating just one core per executor. If I have executors with more then 1 core the issue appears again. I didn't yet understood why is this happening but for the ones having similar issue they can try this. -- View this message in context:

Re: Spark tasks blockes randomly on standalone cluster

2016-09-21 Thread bogdanbaraila
Does anyone has any ideas o what may be happening? Regards, Bogdan -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-tasks-blockes-randomly-on-standalone-cluster-tp27693p27769.html Sent from the Apache Spark User List mailing list archive at

Re: Spark stalling during shuffle (maybe a memory issue)

2016-09-14 Thread bogdanbaraila
Hello Jonathan Did you found any working solution for your issue? If yes could you please share it? Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-stalling-during-shuffle-maybe-a-memory-issue-tp6067p27716.html Sent from the Apache Spark User

Spark tasks blockes randomly on standalone cluster

2016-09-12 Thread bogdanbaraila
We are having a quite complex application that runs on Spark Standalone. In some cases the tasks from one of the workers blocks randomly for an infinite amount of time in the RUNNING state. Extra info: