[
https://issues.apache.org/jira/browse/BEAM-5062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kirill Kozlov updated BEAM-5062:
--------------------------------
Affects Version/s: (was: 2.5.0)
Description:
It would be very useful to have an ability to configure
[S3ClientOptions|https://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/services/s3/S3ClientOptions.html]
for Apache Beam jobs.
For example, there are some implementations of S3, that does not support
virtual-hosted-style URLs for buckets, only path-style. Currently it's
impossible to enable path style access for amazon s3 client, which is used by
an apache-beam job.
was:
There are some implementations of S3, that does not support
virtual-hosted-style URLs for buckets, only path-style.
It would be useful to add one more option into S3Options to enable path-style
access for buckets.
[withPathStyleAccessEnabled|https://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/services/s3/AmazonS3Builder.html#withPathStyleAccessEnabled-java.lang.Boolean-]
method could be used for it when building client.
Summary: Add ability to configure S3ClientOptions (was: Add
S3Options to enable path style access)
After a discussion in github PR, we decided to generalize this improvement to
have an ability to configure all Amazon S3 client options.
> Add ability to configure S3ClientOptions
> ----------------------------------------
>
> Key: BEAM-5062
> URL: https://issues.apache.org/jira/browse/BEAM-5062
> Project: Beam
> Issue Type: Improvement
> Components: io-java-aws
> Reporter: Kirill Kozlov
> Assignee: Kirill Kozlov
> Priority: Minor
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> It would be very useful to have an ability to configure
> [S3ClientOptions|https://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/services/s3/S3ClientOptions.html]
> for Apache Beam jobs.
> For example, there are some implementations of S3, that does not support
> virtual-hosted-style URLs for buckets, only path-style. Currently it's
> impossible to enable path style access for amazon s3 client, which is used by
> an apache-beam job.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
