Reading Shuffle Data from highly loaded nodes

2016-05-09 Thread alvarobrandon
ode2,node3 and node4]? Thanks in advance -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Reading-Shuffle-Data-from-highly-loaded-nodes-tp26901.html Sent from the Apache Spark User List mailing list archive at

Reading Shuffle Data from highly loaded nodes

2016-05-06 Thread Alvaro Brandon
Hello everyone: I'm running an experiment in a Spark cluster where some of the machines are highly loaded with CPU, memory and network consuming process ( let's call them straggler machines ). Obviously the tasks of these machines take longer to execute than in other nodes of the cluster.