Re: Spark streaming job filling a lot of data in local spark nodes

2015-10-05 Thread Tathagata Das
- 1 369653284 Sep 17 18:52 shuffle_23103_6_0.data >>> -rw-r--r-- 1 371932812 Sep 17 18:52 shuffle_23125_6_0.data >>> -rw-r--r-- 1 19857974 Sep 17 18:53 shuffle_23291_19_0.data >>> -rw-r--r-- 1 55342005 Sep 17 18:53 shuffle_23305_8_0.data >>> -rw-r

Re: Spark streaming job filling a lot of data in local spark nodes

2015-10-01 Thread swetha kasireddy
-rw-r--r-- 1 371932812 Sep 17 18:52 shuffle_23125_6_0.data >> -rw-r--r-- 1 19857974 Sep 17 18:53 shuffle_23291_19_0.data >> -rw-r--r-- 1 55342005 Sep 17 18:53 shuffle_23305_8_0.data >> -rw-r--r-- 1 92920590 Sep 17 18:53 shuffle_23303_4_0.data >> >> >> Th

Spark streaming job filling a lot of data in local spark nodes

2015-09-28 Thread swetha
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-streaming-job-filling-a-lot-of-data-in-local-spark-nodes-tp24846.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: Spark streaming job filling a lot of data in local spark nodes

2015-09-28 Thread Shixiong Zhu
0.data > -rw-r--r-- 1 19857974 Sep 17 18:53 shuffle_23291_19_0.data > -rw-r--r-- 1 55342005 Sep 17 18:53 shuffle_23305_8_0.data > -rw-r--r-- 1 92920590 Sep 17 18:53 shuffle_23303_4_0.data > > > Thanks, > Swetha > > > > -- > View this message in context: > ht