[ https://issues.apache.org/jira/browse/HADOOP-16711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566341#comment-17566341 ]
Steve Loughran commented on HADOOP-16711: ----------------------------------------- if cherrypicking, pull in HADOOP-17801 > S3A bucket existence checks to support v2 API and "no checks at all" > -------------------------------------------------------------------- > > Key: HADOOP-16711 > URL: https://issues.apache.org/jira/browse/HADOOP-16711 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/s3 > Affects Versions: 3.2.1 > Reporter: Rajesh Balamohan > Assignee: Mukund Thakur > Priority: Minor > Labels: performance > Fix For: 3.3.0 > > Attachments: HADOOP-16711.prelim.1.patch > > > 1. in S3AFileSystem.initialize(), we check for the bucket existing with > verifyBucketExists(), which calls s3.doesBucketExist(). But that doesn't > check for auth issues. > s3. doesBucketExistV2() does at validate credentials, and should be switched > to. This will help things fail faster > 2. For performance it would be good to skip verifyBuckets call during S3A > filesystem init(). This would save a call to S3 during init method. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org