hi: i am run a join operation in the spark-sql, But when i increase the executor-memory, the run time become long. In the spark UI, i can see that the shuffle becomes slowly when the memory becomes big. How can i to tune it?
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/how-to-tuning-spark-shuffle-tp27350.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
