Re: Are map tasks spilling data to disk?

2015-11-15 Thread Reynold Xin
View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/Are-map-tasks-spilling-data-to-disk-tp15216.html > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com. > > --

Are map tasks spilling data to disk?

2015-11-15 Thread gsvic
park will schedule a number of tasks for execution in order to perform the hash join operation. The results of these tasks will be written to each worker's disk? -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Are-map-tasks-spilling-data-to-disk-tp15