Re: coalesce(1).saveAsTextfile() takes forever?

2016-01-05 Thread Andy Davidson
ot;).save("/path/hadoop") > > For small data above code works well but for large data it hangs forever > does not move on because of only one partitions has to shuffle data of GBs > please help me > > > > -- > View this message in context: > http://ap

Re: coalesce(1).saveAsTextfile() takes forever?

2016-01-05 Thread Umesh Kacha
") >> >> For small data above code works well but for large data it hangs forever >> does not move on because of only one partitions has to shuffle data of GBs >> please help me >> >> >> >> -- >> View this message in context: >> http:/

Re: coalesce(1).saveAsTextfile() takes forever?

2016-01-05 Thread Igor Berman
t;> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/coalesce-1-saveAsTextfile-takes-forever-tp25886.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> -

Re: coalesce(1).saveAsTextfile() takes forever?

2016-01-05 Thread Alexander Pivovarov
n context: > http://apache-spark-user-list.1001560.n3.nabble.com/coalesce-1-saveAsTextfile-takes-forever-tp25886.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubs

coalesce(1).saveAsTextfile() takes forever?

2016-01-05 Thread unk1102
ll but for large data it hangs forever does not move on because of only one partitions has to shuffle data of GBs please help me -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/coalesce-1-saveAsTextfile-takes-forever-tp25886.html Sent from the Apache Spark Use