Re: How to avoid Spark shuffle spill memory?

2015-10-06 Thread David Mitchell
gt; View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/How-to-avoid-Spark-shuffle-spill-memory-tp24960.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > -

How to avoid Spark shuffle spill memory?

2015-10-06 Thread unk1102
executor to timeout and then getting lost eventually. Please guide. Thanks in advance. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-avoid-Spark-shuffle-spill-memory-tp24960.html Sent from the Apache Spark User List mailing list archive at Nabble.com