Re: [External Sender] Re: [Question] Apache Beam Pipeline AWS Credentials

2024-01-10 Thread Ramya Prasad via user
Hi Sachin, Thanks for the response. I'm trying to figure out a way to set the AwsCredentialsProvider using PipelineOptions, not the arguments. Thanks though! Ramya On Wed, Jan 10, 2024 at 1:04 PM Sachin Mittal wrote: > Hi, > Check this class org.apache.beam.sdk.io.aws2.options.AwsOptions >

Re: [External Sender] Re: [Question] Apache Beam Pipeline AWS Credentials

2024-01-10 Thread Sachin Mittal
Hi, Check this class org.apache.beam.sdk.io.aws2.options.AwsOptions It tells you how to set AwsCredentialsProvider used to configure AWS service clients. For example you can run beam application with following application properties: --awsCredentialsProvider={"@type":

Re: [External Sender] Re: [Question] Apache Beam Pipeline AWS Credentials

2024-01-10 Thread Ramya Prasad via user
Hi Alexey, Thanks for the quick response! Apologies for using the dev list, I was unsure which list to be using! So I did try to create my own AwsCredentialsProvider class, but I'm running into a Serializable issue, as the error I'm getting is "Failed to serialize PipelineOptions". This is roughly