Hi,Try using coalesce(1) before calling saveAsTextFile() Thanks Regards,
Meethu M
On Wednesday, 5 August 2015 7:53 AM, Brandon White
bwwintheho...@gmail.com wrote:
What is the best way to make saveAsTextFile save as only a single file?
*To:* 'Brandon White'; user
*Subject:* RE: Combining Spark Files with saveAsTextFile
One options is to use the coalesce method in the RDD class.
Mohammed
*From:* Brandon White [mailto:bwwintheho...@gmail.com
bwwintheho...@gmail.com]
*Sent:* Tuesday, August 4, 2015 7:23 PM
*To:* user
coalesce with argument 1 and
then call saveAsTextFile. For example,
rdd.coalesce(1).saveAsTextFile(...)
Mohammed
*From:* Mohammed Guller
*Sent:* Tuesday, August 4, 2015 9:39 PM
*To:* 'Brandon White'; user
*Subject:* RE: Combining Spark Files with saveAsTextFile
One options
One options is to use the coalesce method in the RDD class.
Mohammed
From: Brandon White [mailto:bwwintheho...@gmail.com]
Sent: Tuesday, August 4, 2015 7:23 PM
To: user
Subject: Combining Spark Files with saveAsTextFile
What is the best way to make saveAsTextFile save as only a single file?
with saveAsTextFile
One options is to use the coalesce method in the RDD class.
Mohammed
From: Brandon White [mailto:bwwintheho...@gmail.com]
Sent: Tuesday, August 4, 2015 7:23 PM
To: user
Subject: Combining Spark Files with saveAsTextFile
What is the best way to make saveAsTextFile save as only a single
What is the best way to make saveAsTextFile save as only a single file?
