Hi,
While saving in Spark2 as text file - I see encoded/hash value attached in
the part files along with part number. I am curious to know what is that
value is about ?

Example:
ds.write.save(SaveMode.Overwrite).option("compression","gzip").text(path)

Produces,
part-00001-1e4c5369-6694-4012-894a-73b971fe1ab1-c000.txt.gz


1e4c5369-6694-4012-894a-73b971fe1ab1-c000 => what is this value ?

Is there any options available to remove this part or is it attached for
some reason ?

Thanks,
Subash

Reply via email to