Re: Combining Spark Files with saveAsTextFile

Hi,Try using coalesce(1) before calling saveAsTextFile() Thanks & Regards, Meethu M On Wednesday, 5 August 2015 7:53 AM, Brandon White wrote: What is the best way to make saveAsTextFile save as only a single file?

Re: Combining Spark Files with saveAsTextFile

her clarify, you can first call coalesce with argument 1 and >> then call saveAsTextFile. For example, >> >> >> >> rdd.coalesce(1).saveAsTextFile(...) >> >> >> >> >> >> >> >> Mohammed >> >> >> >

Re: Combining Spark Files with saveAsTextFile

rom:* Mohammed Guller > *Sent:* Tuesday, August 4, 2015 9:39 PM > *To:* 'Brandon White'; user > *Subject:* RE: Combining Spark Files with saveAsTextFile > > > > One options is to use the coalesce method in the RDD class. > > > > Mohammed > > > >

RE: Combining Spark Files with saveAsTextFile

Just to further clarify, you can first call coalesce with argument 1 and then call saveAsTextFile. For example, rdd.coalesce(1).saveAsTextFile(...) Mohammed From: Mohammed Guller Sent: Tuesday, August 4, 2015 9:39 PM To: 'Brandon White'; user Subject: RE: Combining Spark

RE: Combining Spark Files with saveAsTextFile

One options is to use the coalesce method in the RDD class. Mohammed From: Brandon White [mailto:bwwintheho...@gmail.com] Sent: Tuesday, August 4, 2015 7:23 PM To: user Subject: Combining Spark Files with saveAsTextFile What is the best way to make saveAsTextFile save as only a single file?