I am using Spark Streaming where during each micro-batch I output data to S3 using saveAsTextFile. Right now each batch of data is put into its own directory containing 2 objects, "_SUCCESS" and "part-00000."
How do I output each batch into a common directory? Thanks, Vadim ᐧ
