spark writeStream not working with custom S3 endpoint

2019-12-03 Thread Aniruddha P Tekade
Hello, While working with Spark Structured Streaming (v2.4.3) I am trying to write my streaming dataframe to a custom S3. I have made sure that I am able to login, upload data to s3 buckets manually using UI and have also setup ACCESS_KEY and SECRET_KEY for it. val sc = spark.sparkContext

Custom s3 endpoint

2014-10-21 Thread bobrik
-spark-user-list.1001560.n3.nabble.com/Custom-s3-endpoint-tp16911.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e