Hi, While saving in Spark2 as text file - I see encoded/hash value attached in the part files along with part number. I am curious to know what is that value is about ?
Example: ds.write.save(SaveMode.Overwrite).option("compression","gzip").text(path) Produces, part-00001-1e4c5369-6694-4012-894a-73b971fe1ab1-c000.txt.gz 1e4c5369-6694-4012-894a-73b971fe1ab1-c000 => what is this value ? Is there any options available to remove this part or is it attached for some reason ? Thanks, Subash