[ https://issues.apache.org/jira/browse/HADOOP-18073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645348#comment-17645348 ]
Ahmar Suhail commented on HADOOP-18073: --------------------------------------- [~ste...@apache.org] I've rebased our branch, [https://github.com/ahmarsuhail/hadoop/tree/feature-HADOOP-18073-s3a-sdk-upgrade.] The only notable conflict was in S3AInputStream with new code that was added for https://issues.apache.org/jira/browse/HADOOP-18460. We've made a couple of small changes to fix conflict [here|https://github.com/ahmarsuhail/hadoop/pull/35/files#diff-f84380cfce48a9682320d596f593808fe16d81a71dcc5cfcf10842f932d0ff13R1030]. [~mthakur] could you check if this look ok? and if there's anything else we should do to verify that this issue does not resurface > Upgrade AWS SDK to v2 > --------------------- > > Key: HADOOP-18073 > URL: https://issues.apache.org/jira/browse/HADOOP-18073 > Project: Hadoop Common > Issue Type: Task > Components: auth, fs/s3 > Affects Versions: 3.3.1 > Reporter: xiaowei sun > Assignee: Ahmar Suhail > Priority: Major > Labels: pull-request-available > Attachments: Upgrading S3A to SDKV2.pdf > > > This task tracks upgrading Hadoop's AWS connector S3A from AWS SDK for Java > V1 to AWS SDK for Java V2. > Original use case: > {quote}We would like to access s3 with AWS SSO, which is supported in > software.amazon.awssdk:sdk-core:2.*. > In particular, from > [https://hadoop.apache.org/docs/stable/hadoop-aws/tools/hadoop-aws/index.html], > when to set 'fs.s3a.aws.credentials.provider', it must be > "com.amazonaws.auth.AWSCredentialsProvider". We would like to support > "software.amazon.awssdk.auth.credentials.ProfileCredentialsProvider" which > supports AWS SSO, so users only need to authenticate once. > {quote} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org