Aaron Fabbri created HADOOP-14391:
-------------------------------------

             Summary: s3a: auto-detect region for bucket and use right endpoint
                 Key: HADOOP-14391
                 URL: https://issues.apache.org/jira/browse/HADOOP-14391
             Project: Hadoop Common
          Issue Type: Improvement
          Components: s3
    Affects Versions: 3.0.0-alpha2
            Reporter: Aaron Fabbri


Specifying the S3A endpoint ({{fs.s3a.endpoint}}) is

- *required* for regions which only support v4 authentication
- A good practice for all regions.

The user experience of having to configure endpoints is not great.  Often it is 
neglected and leads to additional cost, reduced performance, or failures for v4 
auth regions.

I want to explore an option which, when enabled, auto-detects the region for an 
s3 bucket and uses the proper endpoint.  Not sure if this is possible or anyone 
has looked into it yet.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Reply via email to