This is an automated email from the ASF dual-hosted git repository. stevel pushed a change to branch branch-3.3.5 in repository https://gitbox.apache.org/repos/asf/hadoop.git
from 7b607b8b120 HADOOP-18292. Fix s3 select tests when running against unsupported storage class (#4489) new c2bbff9ea13 HADOOP-18382. AWS SDK v2 upgrade prerequisites (#4698) new 860c79192ad HADOOP-18481. AWS v2 SDK upgrade log to not about standard AWS Credential Providers. (#4973) The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../hadoop/fs/s3a/AWSCredentialProviderList.java | 2 +- .../fs/s3a/AnonymousAWSCredentialsProvider.java | 4 + .../java/org/apache/hadoop/fs/s3a/Constants.java | 7 ++ .../hadoop/fs/s3a/DefaultS3ClientFactory.java | 1 + .../org/apache/hadoop/fs/s3a/S3AFileSystem.java | 33 +++++++- .../java/org/apache/hadoop/fs/s3a/S3AUtils.java | 9 ++ .../org/apache/hadoop/fs/s3a/S3ClientFactory.java | 3 + .../fs/s3a/SharedInstanceCredentialProvider.java | 4 +- .../fs/s3a/SimpleAWSCredentialsProvider.java | 4 + .../fs/s3a/TemporaryAWSCredentialsProvider.java | 7 +- .../apache/hadoop/fs/s3a/WriteOperationHelper.java | 37 ++++++-- .../fs/s3a/auth/AbstractAWSCredentialProvider.java | 4 + .../auth/AbstractSessionCredentialsProvider.java | 4 + .../fs/s3a/auth/AssumedRoleCredentialProvider.java | 4 + .../s3a/auth/IAMInstanceCredentialsProvider.java | 4 + .../fs/s3a/auth/MarshalledCredentialProvider.java | 1 + .../apache/hadoop/fs/s3a/auth/SignerManager.java | 3 + .../hadoop/fs/s3a/impl/InternalConstants.java | 6 ++ .../org/apache/hadoop/fs/s3a/impl/V2Migration.java | 98 ++++++++++++++++++++++ .../markdown/tools/hadoop-aws/aws_sdk_upgrade.md | 76 +++++++++++++++++ .../src/site/markdown/tools/hadoop-aws/index.md | 4 + .../tools/hadoop-aws/troubleshooting_s3a.md | 61 ++++++++++++-- .../apache/hadoop/fs/s3a/AbstractS3AMockTest.java | 1 + .../fs/s3a/ITestS3AAWSCredentialsProvider.java | 1 + .../hadoop/fs/s3a/ITestS3AConfiguration.java | 1 + .../hadoop/fs/s3a/ITestS3AEndpointRegion.java | 1 + .../fs/s3a/ITestS3ATemporaryCredentials.java | 3 + .../apache/hadoop/fs/s3a/MockS3AFileSystem.java | 4 +- .../apache/hadoop/fs/s3a/MockS3ClientFactory.java | 1 + .../org/apache/hadoop/fs/s3a/S3ATestUtils.java | 1 + .../fs/s3a/TestS3AAWSCredentialsProvider.java | 5 ++ .../hadoop/fs/s3a/TestS3ABlockOutputStream.java | 4 +- .../apache/hadoop/fs/s3a/auth/ITestAssumeRole.java | 17 +++- .../apache/hadoop/fs/s3a/auth/RoleTestUtils.java | 1 + .../ITestSessionDelegationInFileystem.java | 2 + .../delegation/ITestSessionDelegationTokens.java | 5 +- .../test/MinimalWriteOperationHelperCallbacks.java | 38 ++++----- .../hadoop-aws/src/test/resources/log4j.properties | 1 + 38 files changed, 414 insertions(+), 48 deletions(-) create mode 100644 hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/V2Migration.java create mode 100644 hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/aws_sdk_upgrade.md copy hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/EmptyStorageStatistics.java => hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/test/MinimalWriteOperationHelperCallbacks.java (52%) --------------------------------------------------------------------- To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org