How to use HDFS >3.1.1 with spark 2.3.3 to output parquet files to S3?

As the subject suggest I want to output an parquet to S3. I know this was rather troublesome in the past because of S3 not having a move but needed to do a copy+delete. This issues has been discussed before see: http://apache-spark-user-list.1001560.n3.nabble.com/Writing-files-to-s3-with-out-tempor

Re: unsubscribe

unsubscribe On Sun, Jul 14, 2019 at 6:34 PM Raj Adyanthaya wrote: > unsubscribe > > On Fri, Jul 5, 2019 at 6:04 AM Paras Bansal wrote: > >> >>