S3 server side encryption using FileSink

2022-01-04 Thread James Timotiwu
We are trying to write objects with encryption at rest. To enable this, the request containing the payload we intend to upload must include a x-amz-server-side-encryption header. [1]. I would imagine this is a common use case, but after some digging, I cannot find any article that covers this. Has

Re: S3 server side encryption using FileSink

2022-01-05 Thread David Morávek
Hi James, I'm not an expert on s3, but in general this should be a matter of configuring the s3 filesystem implementation that Flink is using (that's what ends up writing the actual files to s3). Flink currently comes with the Hadoop & Presto (also kind of Hadoop based) based implementations. Loo