Re: Best way to merge final output part files created by Spark job

2016-07-01 Thread kali.tumm...@gmail.com
://apache-spark-user-list.1001560.n3.nabble.com/Best-way-to-merge-final-output-part-files-created-by-Spark-job-tp24681p27263.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail

Re: Best way to merge final output part files created by Spark job

2015-09-17 Thread MEETHU MATHEW
he head or at tail part of the file. You have to use the format specified API to merge the data. Yong Date: Mon, 14 Sep 2015 09:10:33 +0200 Subject: Re: Best way to merge final output part files created by Spark job From: gmu...@stratio.com To: umesh.ka...@gmail.com CC: user@spark.apache.org Hi

RE: Best way to merge final output part files created by Spark job

2015-09-14 Thread java8964
ve to use the format specified API to merge the data. Yong Date: Mon, 14 Sep 2015 09:10:33 +0200 Subject: Re: Best way to merge final output part files created by Spark job From: gmu...@stratio.com To: umesh.ka...@gmail.com CC: user@spark.apache.org Hi, check out FileUtil.copyMerge function in

Re: Best way to merge final output part files created by Spark job

2015-09-14 Thread Gaspar Muñoz
way to merge files created by Spark job in hdfs please guide. Thanks much. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Best-way-to-merge-final-output-part-files-created-by-Spark-job-tp24681.html > Sent from the

Best way to merge final output part files created by Spark job

2015-09-13 Thread unk1102
files in Spark if not please suggest the best way to merge files created by Spark job in hdfs please guide. Thanks much. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Best-way-to-merge-final-output-part-files-created-by-Spark-job-tp24681.html Sent from