Re: Use different S3 access key for different S3 bucket

2024-01-18 Thread Josh Mahonin via user
Oops my syntax was a bit off there, as shown in the Hadoop docs, it looks like: fs.s3a.bucket.. Josh >

Re: Use different S3 access key for different S3 bucket

2024-01-18 Thread Josh Mahonin via user
Hi Qing, You may have some luck with using per-bucket S3 configuration. Assuming you're using the flink-s3-fs-hadoop plugin, you should be able to apply different access keys to different buckets, eg: https://hadoop.apache.org/docs/stable/hadoop-aws/tools/hadoop-aws/index.html#Configuring_differen