Re: unsubscribe

2019-07-14 Thread Raj Adyanthaya
unsubscribe On Sun, Jul 14, 2019 at 6:34 PM Raj Adyanthaya wrote: > unsubscribe > > On Fri, Jul 5, 2019 at 6:04 AM Paras Bansal wrote: > >> >>

How to use HDFS >3.1.1 with spark 2.3.3 to output parquet files to S3?

2019-07-14 Thread Alexander Czech
As the subject suggest I want to output an parquet to S3. I know this was rather troublesome in the past because of S3 not having a move but needed to do a copy+delete. This issues has been discussed before see: