This is an automated email from the ASF dual-hosted git repository. cnauroth pushed a change to branch HADOOP-19343 in repository https://gitbox.apache.org/repos/asf/hadoop.git
omit 1b12f77c8a2 HADOOP-19343: Add support for open() and rename() omit 3d29867a625 HADOOP-19343: Add instruction for running tests omit d90291a6efd HADOOP-19343: Add support for mkdir() and getFileStatus() omit 49354056abb HADOOP-19343: GCS / Add implementation for create() API add c8ea305ae40 HADOOP-18562: S3A: support custom S3 and STS headers (#7379) add d52b0f93df0 HADOOP-8865. Log warning message when loading deprecated properties add ad7aa0e3c18 HADOOP-18562. Followup: TestAwsClientConfig compilation (#7751) add 7acb89cb157 HADOOP-18568. magic committer optional cleanup add 91839093abc HADOOP-18568: Add JUnit 5 Test import add bf244eab30e HADOOP-19431. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-distcp Part2. (#7747) add 02a9190af5f YARN-11263. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-nodemanager Part3. (#7748) add e0e87162ba9 YARN-11262. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-resourcemanager Part7. (#7745) add 6eae1589aee HDFS-12431. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-hdfs Part6. (#7739) new 61a12f7661e HADOOP-19343: GCS / Add implementation for create() API new 32c9cfcc125 HADOOP-19343: Add support for mkdir() and getFileStatus() new 4b3f6a440ea HADOOP-19343: Add instruction for running tests new 7f51dd79853 HADOOP-19343: Add support for open() and rename() new 16eb182bb97 HADOOP-19343. Add support for hflush() This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (1b12f77c8a2) \ N -- N -- N refs/heads/HADOOP-19343 (16eb182bb97) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 5 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../java/org/apache/hadoop/conf/Configuration.java | 1 + .../org/apache/hadoop/conf/TestConfiguration.java | 33 +- .../java/org/apache/hadoop/hdfs/TestDFSRemove.java | 10 +- .../java/org/apache/hadoop/hdfs/TestDFSRename.java | 18 +- .../org/apache/hadoop/hdfs/TestDFSRollback.java | 18 +- .../java/org/apache/hadoop/hdfs/TestDFSShell.java | 699 +++++++++++---------- .../hadoop/hdfs/TestDFSShellGenericOptions.java | 8 +- .../org/apache/hadoop/hdfs/TestDFSShellTouch.java | 10 +- .../apache/hadoop/hdfs/TestDFSStartupVersions.java | 14 +- .../hadoop/hdfs/TestDFSStorageStateRecovery.java | 18 +- .../hadoop/hdfs/TestDFSStripedInputStream.java | 42 +- .../hadoop/hdfs/TestDFSStripedOutputStream.java | 48 +- .../TestDFSStripedOutputStreamUpdatePipeline.java | 6 +- .../org/apache/hadoop/hdfs/TestDFSUpgrade.java | 55 +- .../hadoop/hdfs/TestDFSUpgradeFromImage.java | 33 +- .../java/org/apache/hadoop/hdfs/TestDFSUtil.java | 386 ++++++------ .../apache/hadoop/hdfs/TestDisableConnCache.java | 4 +- .../hadoop/hdfs/TestDistributedFileSystem.java | 112 ++-- .../hdfs/TestDistributedFileSystemWithECFile.java | 34 +- .../apache/hadoop/hdfs/TestEncryptedTransfer.java | 134 ++-- .../hadoop/hdfs/TestEncryptionZonesWithHA.java | 29 +- .../hdfs/TestErasureCodeBenchmarkThroughput.java | 29 +- .../hadoop/hdfs/TestErasureCodingAddConfig.java | 10 +- .../hadoop/hdfs/TestErasureCodingExerciseAPIs.java | 23 +- .../hdfs/TestErasureCodingMultipleRacks.java | 21 +- .../hadoop/hdfs/TestErasureCodingPolicies.java | 180 +++--- .../hdfs/TestErasureCodingPolicyWithSnapshot.java | 111 ++-- .../org/apache/hadoop/hdfs/TestExtendedAcls.java | 16 +- .../hadoop/hdfs/TestExternalBlockReader.java | 50 +- .../org/apache/hadoop/hdfs/TestFSInputChecker.java | 15 +- .../org/apache/hadoop/hdfs/TestFetchImage.java | 20 +- .../org/apache/hadoop/hdfs/TestFileAppend.java | 75 +-- .../org/apache/hadoop/hdfs/TestFileAppend2.java | 24 +- .../org/apache/hadoop/hdfs/TestFileAppend3.java | 31 +- .../org/apache/hadoop/hdfs/TestFileAppend4.java | 27 +- .../apache/hadoop/hdfs/TestFileAppendRestart.java | 4 +- .../org/apache/hadoop/hdfs/TestFileChecksum.java | 318 ++++++---- .../hadoop/hdfs/TestFileConcurrentReader.java | 55 +- .../org/apache/hadoop/hdfs/TestFileCorruption.java | 24 +- .../org/apache/hadoop/hdfs/TestFileCreation.java | 124 ++-- .../apache/hadoop/hdfs/TestFileCreationClient.java | 4 +- .../apache/hadoop/hdfs/TestFileCreationDelete.java | 4 +- .../apache/hadoop/hdfs/TestFileCreationEmpty.java | 4 +- .../hdfs/TestFileLengthOnClusterRestart.java | 17 +- .../org/apache/hadoop/hdfs/TestFileStatus.java | 82 +-- .../hadoop/hdfs/TestFileStatusSerialization.java | 4 +- .../hdfs/TestFileStatusWithDefaultECPolicy.java | 28 +- .../java/org/apache/hadoop/fs/s3a/Constants.java | 32 + .../hadoop/fs/s3a/commit/CommitConstants.java | 12 + .../s3a/commit/magic/MagicCommitTrackerUtils.java | 12 + .../fs/s3a/commit/magic/MagicS3GuardCommitter.java | 23 +- .../apache/hadoop/fs/s3a/impl/AWSClientConfig.java | 46 ++ .../site/markdown/tools/hadoop-aws/committers.md | 18 + .../src/site/markdown/tools/hadoop-aws/index.md | 25 + .../s3a/commit/magic/ITestMagicCommitProtocol.java | 29 + .../hadoop/fs/s3a/impl/TestAwsClientConfig.java | 125 ++++ .../hadoop/tools/mapred/TestCopyCommitter.java | 46 +- .../{CreateOptions.java => CreateFileOptions.java} | 28 +- .../apache/hadoop/fs/gs/ErrorTypeExtractor.java | 27 +- .../apache/hadoop/fs/gs/GoogleCloudStorage.java | 82 ++- .../gs/GoogleCloudStorageClientWriteChannel.java | 14 +- .../hadoop/fs/gs/GoogleCloudStorageFileSystem.java | 115 +++- .../hadoop/fs/gs/GoogleHadoopFileSystem.java | 14 +- .../fs/gs/GoogleHadoopFileSystemConfiguration.java | 44 +- .../hadoop/fs/gs/GoogleHadoopOutputStream.java | 273 +++++++- .../hadoop/fs/gs/HadoopConfigurationProperty.java | 10 + ...tDelete.java => ITestGoogleContractCreate.java} | 9 +- .../fs/gs/contract/ITestGoogleContractMkdir.java | 24 - .../fs/gs/contract/ITestGoogleContractRename.java | 6 - .../hadoop-gcp/src/test/resources/contract/gs.xml | 100 ++- .../resources/TestCompareResourceCalculators.java | 55 +- .../yarn/server/resourcemanager/RMHATestBase.java | 21 +- .../TestKillApplicationWithRMHA.java | 37 +- .../resourcemanager/TestRMEmbeddedElector.java | 18 +- .../resourcemanager/TestRMHAForAsyncScheduler.java | 30 +- .../TestReservationSystemWithRMHA.java | 127 ++-- .../TestSubmitApplicationWithRMHA.java | 41 +- 77 files changed, 2764 insertions(+), 1691 deletions(-) rename hadoop-tools/hadoop-gcp/src/main/java/org/apache/hadoop/fs/gs/{CreateOptions.java => CreateFileOptions.java} (81%) copy hadoop-tools/hadoop-gcp/src/test/java/org/apache/hadoop/fs/gs/contract/{ITestGoogleContractDelete.java => ITestGoogleContractCreate.java} (78%) --------------------------------------------------------------------- To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org