[
https://issues.apache.org/jira/browse/HADOOP-19588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17983671#comment-17983671
]
Steve Loughran commented on HADOOP-19588:
-----------------------------------------
I agree with it being hard, but I want them to do a best effort of testing
whole stack against s3 express before their changes, and against gcs for
testing third party. No need to check logs, command line etc.
once through the hadoop-aws tests, then they can do their work atop it
* they'll know any test failures against s3 express are not from their code
* we'll know that third party support does appear to be back, so it is actually
worthwhile having them do the work, rather than it be blocked later
> S3A: Support for S3express Access Points
> ----------------------------------------
>
> Key: HADOOP-19588
> URL: https://issues.apache.org/jira/browse/HADOOP-19588
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/s3
> Affects Versions: 3.4.2
> Reporter: Revathi Vijay
> Priority: Minor
> Original Estimate: 336h
> Remaining Estimate: 336h
>
> * Currently, the endpoint for using S3 accesspoint is resolved for S3 and S3
> on outposts:
> https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/ArnResource.java#L29-L30.
> However, for s3express, the endpoint is
> "s3express-<zoneId>.<region>.amazonaws.com".
> (https://docs.aws.amazon.com/AmazonS3/latest/userguide/directory-bucket-az-networking.html).
> This ticket adds support for s3express endpoint.
> * Additionally, for access objects using s3express in the `S3AFileSystem`, we
> need to parse the access point ARN for an S3express access point into the
> access point name, since ARNs aren't supported on S3express other than in IAM
> policies.
> (https://docs.aws.amazon.com/AmazonS3/latest/userguide/access-points-directory-buckets-restrictions-limitations-naming-rules.html).
> This ticket also addresses this change.
> * This ticket also updates the SDK version used by the changes to `2.31.12`,
> which is the version (at minimum) needed to use s3express access points. It
> does not do the SDK upgrade, but only the version of the dependency.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
