Resending to right list ---------- Forwarded message ---------- From: "Divya Gehlot" <divya.htco...@gmail.com> Date: Jul 26, 2016 6:51 PM Subject: FileUtil.fullyDelete does ? To: "user @spark" <u...@spark.apache.org> Cc:
Hi, When I am doing the using theFileUtil.copymerge function val file = "/tmp/primaryTypes.csv" FileUtil.fullyDelete(new File(file)) val destinationFile= "/tmp/singlePrimaryTypes.csv" FileUtil.fullyDelete(new File(destinationFile)) val counts = partitions. reduceByKey {case (x,y) => x + y}. sortBy {case (key, value) => -value}. map { case (key, value) => Array(key, value).mkString(",") } counts.saveAsTextFile(file) merge(file, destinationFile) I am wondering here what does FileUtil.fullyDelete(new File(destinationFile)) do ? does it delete the merged file ....If yes,then how will we access the merged file ..? Confused here ... Thanks, Divya