This is an automated email from the ASF dual-hosted git repository.
zanderxu pushed a change to branch HDFS-17384
in repository https://gitbox.apache.org/repos/asf/hadoop.git
omit d32bc502fca2 HADOOP-19090. Use protobuf-java 3.23.4. (#6593).
Contributed by PJ Fanning. (#6663)
omit dc2114b61d89 HDFS-17414. [FGL] RPCs in DatanodeProtocol support
fine-grained lock (#6649)
omit 8a3eeca112f9 HDFS-17422. Enhance the stability of the unit test
TestDFSAdmin (#6621). Contributed by lei w and Hualong Zhang. (#6657)
omit 74e29720c504 HDFS-17413. [FGL] CacheReplicationMonitor supports
fine-grained lock (#6641)
omit fde64373cee5 HDFS-17395. [FGL] Use FSLock to protect
ErasureCodingPolicy related operations (#6579)
omit ae19ede35fcf HDFS-17390. [FGL] FSDirectory supports this fine-grained
locking (#6573)
omit 8a97eaef5523 HDFS-17405. [FGL] Using different metric name to trace
performance for FGL and Global lock (#6600)
omit c19db051839f HDFS-17398. [FGL] Implement the FGL lock for
FSNLockManager (#6599)
omit 1f146ec75393 HDFS-17387. [FGL] Abstract the configuration locking mode
(#6572)
omit f42e4ca3483e Revert "HADOOP-19071. Update maven-surefire-plugin from
3.0.0 to 3.2.5. (#6537)" (#6578)
omit d58260a0988e HDFS-17394. [FGL] Remove unused WriteHoldCount of
FSNamesystemLock (#6571)
omit f530e154ac84 HDFS-17393. Remove unused FSNamesytemLock cond in
FSNamesystem (#6588)
add 1336c362e5b6 Hadoop-18759: [ABFS][Backoff-Optimization] Have a Static
retry policy for connection timeout. (#5881)
add d1daf26b853d Fixes HDFS-17181 by routing all CREATE requests to the
BlockManager (#6108)
add 6dfebdbce40e HADOOP-19065. Update Protocol Buffers installation to
3.21.12 (#6526)
add 99b9e7fb43b5 HADOOP-18910: [ABFS] Adding Support for MD5 Hash based
integrity verification of the request content during transport (#6069)
add 10ab8abccd7e Revert "HADOOP-19071. Update maven-surefire-plugin from
3.0.0 to 3.2.5. (#6537)" (#6578)
add a897e745f598 HDFS-17393. Remove unused FSNamesytemLock cond in
FSNamesystem (#6567)
add 15af52954f32 HDFS-17358. EC: infinite lease recovery caused by the
length of RWR equals to zero or datanode does not have the replica. (#6509).
Contributed by farmmamba.
add 34bb28649c7b HDFS-17406. Suppress UnresolvedPathException in hdfs
router log (#6603)
add a0ce2170db20 HADOOP-19084. Prune hadoop-common transitive dependencies
(#6574) (#6582)
add a6aa2925fb64 HDFS-17333. DFSClient supports lazy resolution from
hostname to IP. (#6430)
add 095229fefb4d HADOOP-19097. S3A: Set
fs.s3a.connection.establish.timeout to 30s (#6601)
add d974a12f3987 HADOOP-19082: S3A: Update AWS SDK V2 to 2.24.6 (#6568)
add dae871e3e078 YARN-11657. Remove protobuf-2.5 from hadoop-yarn-api
module (#6575) (#6580)
add a2d72411905e HDFS-17404. Add NN Socket Address to log when processing
command from active NN (#6598)
add 5584efd8d418 HDFS-17396. BootstrapStandby should download rollback
image during RollingUpgrade (#6583)
add 7012986fc3d2 HDFS-17345. Add a metrics to record block report
generating cost time. (#6475). Contributed by farmmamba.
add 58afe4376933 HDFS-17299. Adding rack failure tolerance when creating a
new file (#6566)
add fc166d3aec7c HADOOP-19090. Use protobuf-java 3.23.4. (#6593).
Contributed by PJ Fanning.
add bb32aec88ecf HADOOP-19043. S3A: Regression: ITestS3AOpenCost fails on
prefetch test runs (#6465)
add dbf08c872acf HDFS-17422. Enhance the stability of the unit test
TestDFSAdmin (#6621). Contributed by lei w and Hualong Zhang.
add e211f6f83d1a HDFS-17391. Adjust the checkpoint io buffer size to the
chunk size (#6594). Contributed by lei w.
add 44c14edac781 HADOOP-19066. S3A: AWS SDK V2 - Enabling FIPS should be
allowed with central endpoint (#6539)
add e28c78f9a23a HADOOP-19088. Use jersey-json 1.22.0 (#6585)
add a325876feca2 HADOOP-19066. Run FIPS test for valid bucket locations
(ADDENDUM) (#6624)
add 783cc3eda0a9 YARN-11660. Fix performance regression for
SingleConstraintAppPlacementAllocator (#6623) Contributed by Junfan Zhang.
add 4d88f9892a9b HADOOP-19085. Compatibility Benchmark over HCFS
Implementations
add b25b28e5bbda HDFS-17380. FsImageValidation: remove inaccessible nodes.
(#6549). Contributed by Tsz-wo Sze.
add 0f51d2a4ec17 HADOOP-14451. Deadlock in NativeIO (#6632)
add ff3f2255d206 HADOOP-19112. Hadoop 3.4.0 release wrap-up. (#6640)
Contributed by Shilun Fan.
add 705fb8323b4a HADOOP-19119. Spotbugs: possible NPE in
org.apache.hadoop.crypto.key.kms.ValueQueue.getSize() (#6642)
add 8b2058a4e755 HADOOP-19050. S3A: Support S3 Access Grants (#6544)
add 12a26d8b1987 HDFS-17431. Fix log format for
BlockRecoveryWorker#recoverBlocks (#6643)
add a957cd504932 YARN-5305. Allow log aggregation to discard expired
delegation tokens (#6625)
add 77c600d769fe HDFS-17426. Remove Invalid FileSystemECReadStats logic in
DFSInputStream (#6628)
add 2eb7246ea754 HDFS-17433. metrics sumOfActorCommandQueueLength should
only record valid commands. (#6644)
add adab3a22aab3 HDFS-17432. Fix junit dependency to enable JUnit4 tests
to run in hadoop-hdfs-rbf (#6639)
add a375ef8cfa62 YARN-11626. Optimize ResourceManager's operations on
Zookeeper metadata (#6616)
add 062836c020cf HDFS-17436. Supplement log information for
AccessControlException (#6651)
add 8cd4704e0a1a HDFS-17430. RecoveringBlock will skip no live replicas
when get block recovery command. (#6635)
add a60b5e2de307 MAPREDUCE-7469. NNBench createControlFiles should use
thread pool to improve performance. (#6463) Contributed by liuguanghua.
add 55dca911cc67 HADOOP-19052.Hadoop use Shell command to get the count of
the hard link which takes a lot of time (#6587) Contributed by liangyu.
add 5c7e40f91098 HADOOP-19111. Removing redundant debug message about
client info (#6666). Contributed by Zhongkun Wu.
new 551683d4bd55 HDFS-17394. [FGL] Remove unused WriteHoldCount of
FSNamesystemLock (#6571)
new 9b9ac73b431e HDFS-17387. [FGL] Abstract the configuration locking mode
(#6572)
new b688ac8c185c HDFS-17398. [FGL] Implement the FGL lock for
FSNLockManager (#6599)
new 794b5aa57836 HDFS-17405. [FGL] Using different metric name to trace
performance for FGL and Global lock (#6600)
new a60b05b3fbf8 HDFS-17390. [FGL] FSDirectory supports this fine-grained
locking (#6573)
new 3214795bce19 HDFS-17395. [FGL] Use FSLock to protect
ErasureCodingPolicy related operations (#6579)
new 213f478f58cb HDFS-17413. [FGL] CacheReplicationMonitor supports
fine-grained lock (#6641)
new 46dda50b49a9 HDFS-17414. [FGL] RPCs in DatanodeProtocol support
fine-grained lock (#6649)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (d32bc502fca2)
\
N -- N -- N refs/heads/HDFS-17384 (46dda50b49a9)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 8 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
BUILDING.txt | 39 +-
LICENSE-binary | 9 +-
dev-support/docker/Dockerfile | 2 +-
dev-support/docker/Dockerfile_aarch64 | 2 +-
dev-support/docker/Dockerfile_centos_7 | 2 +-
dev-support/docker/Dockerfile_centos_8 | 2 +-
dev-support/docker/Dockerfile_debian_10 | 2 +-
.../docker/pkg-resolver/install-protobuf.sh | 9 +-
.../apache/hadoop/crypto/key/kms/ValueQueue.java | 10 +-
.../main/java/org/apache/hadoop/fs/HardLink.java | 28 +
.../org/apache/hadoop/io/nativeio/NativeIO.java | 26 +-
.../main/java/org/apache/hadoop/ipc/Client.java | 3 +-
.../main/java/org/apache/hadoop/net/NetUtils.java | 15 +-
.../org/apache/hadoop/security/Credentials.java | 8 +
.../hadoop/security/UserGroupInformation.java | 13 +-
.../src/org/apache/hadoop/io/nativeio/NativeIO.c | 126 +-
.../src/main/resources/core-default.xml | 2 +-
.../hadoop-common/src/site/markdown/Metrics.md | 2 +
.../site/markdown/release/3.4.0/CHANGELOG.3.4.0.md | 2954 ++
.../markdown/release/3.4.0/RELEASENOTES.3.4.0.md | 652 +
.../java/org/apache/hadoop/fs/TestHardLink.java | 10 +
.../hadoop/io/nativeio/TestNativeIoInit.java | 87 +
.../org/apache/hadoop/hdfs/DFSInputStream.java | 7 -
.../java/org/apache/hadoop/hdfs/DFSUtilClient.java | 19 +-
.../java/org/apache/hadoop/hdfs/DataStreamer.java | 68 +-
.../apache/hadoop/hdfs/StripedDataStreamer.java | 12 +-
.../hadoop/hdfs/client/HdfsClientConfigKeys.java | 2 +
.../ha/AbstractNNFailoverProxyProvider.java | 26 +
.../ha/TestConfiguredFailoverProxyProvider.java | 82 +-
hadoop-hdfs-project/hadoop-hdfs-rbf/pom.xml | 5 +
.../federation/router/RouterNamenodeProtocol.java | 12 +
.../server/federation/router/RouterRpcServer.java | 10 +-
.../dev-support/jdiff/Apache_Hadoop_HDFS_3.4.0.xml | 888 +
.../NamenodeProtocolServerSideTranslatorPB.java | 17 +
.../protocolPB/NamenodeProtocolTranslatorPB.java | 10 +
.../server/blockmanagement/DatanodeManager.java | 30 +-
.../hdfs/server/datanode/BPOfferService.java | 2 +-
.../hdfs/server/datanode/BPServiceActor.java | 7 +-
.../hadoop/hdfs/server/datanode/BlockReceiver.java | 5 +-
.../hdfs/server/datanode/BlockRecoveryWorker.java | 46 +-
.../datanode/erasurecode/StripedBlockReader.java | 4 +-
.../server/datanode/fsdataset/FsDatasetSpi.java | 12 +-
.../datanode/fsdataset/impl/FsDatasetImpl.java | 20 +-
.../server/datanode/metrics/DataNodeMetrics.java | 5 +
.../hadoop/hdfs/server/namenode/FSImage.java | 36 +
.../hdfs/server/namenode/FSPermissionChecker.java | 1 +
.../hdfs/server/namenode/FsImageValidation.java | 68 +-
.../hdfs/server/namenode/NameNodeRpcServer.java | 8 +
.../hdfs/server/namenode/TransferFsImage.java | 28 +-
.../hdfs/server/namenode/ha/BootstrapStandby.java | 24 +-
.../web/resources/NamenodeWebHdfsMethods.java | 52 +-
.../hdfs/server/protocol/NamenodeProtocol.java | 7 +
.../src/main/proto/NamenodeProtocol.proto | 14 +
.../src/main/resources/hdfs-default.xml | 9 +
.../java/org/apache/hadoop/hdfs/TestDFSUtil.java | 47 +
.../hadoop/hdfs/TestDistributedFileSystem.java | 129 +-
.../hadoop/hdfs/TestLeaseRecoveryStriped.java | 29 +
.../hdfs/server/datanode/SimulatedFSDataset.java | 6 +
.../datanode/extdataset/ExternalDatasetImpl.java | 6 +
.../hdfs/server/namenode/FSImageTestUtil.java | 17 +
.../server/namenode/ha/TestBootstrapStandby.java | 25 +-
.../jdiff/Apache_Hadoop_MapReduce_Common_3.4.0.xml | 113 +
.../jdiff/Apache_Hadoop_MapReduce_Core_3.4.0.xml | 29013 +++++++++++++++++++
.../Apache_Hadoop_MapReduce_JobClient_3.4.0.xml | 16 +
.../test/java/org/apache/hadoop/hdfs/NNBench.java | 45 +-
.../java/org/apache/hadoop/hdfs/TestNNBench.java | 20 +
hadoop-project-dist/pom.xml | 2 +-
hadoop-project/pom.xml | 52 +-
.../java/org/apache/hadoop/fs/s3a/Constants.java | 17 +
.../hadoop/fs/s3a/DefaultS3ClientFactory.java | 36 +-
.../org/apache/hadoop/fs/s3a/S3AFileSystem.java | 10 +
.../hadoop/fs/s3a/impl/InternalConstants.java | 2 +
.../markdown/tools/hadoop-aws/authentication.md | 433 +
.../site/markdown/tools/hadoop-aws/connecting.md | 15 +-
.../src/site/markdown/tools/hadoop-aws/index.md | 383 +-
.../hadoop/fs/s3a/ITestS3AEndpointRegion.java | 125 +-
.../fs/s3a/TestS3AccessGrantConfiguration.java | 126 +
.../fs/s3a/performance/AbstractS3ACostTest.java | 8 +
.../fs/s3a/performance/ITestS3AOpenCost.java | 100 +-
.../hadoop/fs/azurebfs/AbfsConfiguration.java | 46 +-
.../fs/azurebfs/AzureBlobFileSystemStore.java | 3 +
.../fs/azurebfs/constants/AbfsHttpConstants.java | 1 +
.../fs/azurebfs/constants/ConfigurationKeys.java | 16 +
.../constants/FileSystemConfigurations.java | 22 +-
.../constants/HttpHeaderConfigurations.java | 1 +
.../contracts/exceptions/AbfsDriverException.java | 54 +
.../exceptions/AbfsInvalidChecksumException.java | 56 +
.../contracts/services/AzureServiceErrorCode.java | 2 +
.../hadoop/fs/azurebfs/services/AbfsClient.java | 174 +-
.../fs/azurebfs/services/AbfsClientContext.java | 8 +
.../services/AbfsClientContextBuilder.java | 12 +-
.../fs/azurebfs/services/AbfsHttpOperation.java | 14 +-
.../fs/azurebfs/services/AbfsRestOperation.java | 65 +-
.../fs/azurebfs/services/AbfsRetryPolicy.java | 98 +
.../azurebfs/services/ExponentialRetryPolicy.java | 44 +-
.../fs/azurebfs/services/RetryPolicyConstants.java | 35 +
.../fs/azurebfs/services/StaticRetryPolicy.java | 52 +
.../hadoop/fs/azurebfs/utils/TracingContext.java | 14 +-
.../hadoop-azure/src/site/markdown/abfs.md | 21 +-
.../fs/azurebfs/AbstractAbfsIntegrationTest.java | 3 +
.../azurebfs/ITestAzureBlobFileSystemChecksum.java | 261 +
.../fs/azurebfs/ITestAzureBlobFileSystemE2E.java | 47 +
.../ITestAzureBlobFileSystemListStatus.java | 2 +-
.../TestAbfsConfigurationFieldsValidation.java | 94 +-
.../hadoop/fs/azurebfs/TestTracingContext.java | 77 +-
.../extensions/MockDelegationSASTokenProvider.java | 6 +-
.../fs/azurebfs/services/AbfsClientTestUtil.java | 61 +-
.../fs/azurebfs/services/ITestAbfsClient.java | 8 +-
.../fs/azurebfs/services/ITestAbfsInputStream.java | 6 +-
.../azurebfs/services/ITestAbfsRestOperation.java | 5 +-
...olicy.java => ITestExponentialRetryPolicy.java} | 44 +-
.../azurebfs/services/ITestStaticRetryPolicy.java | 142 +
.../fs/azurebfs/services/TestAbfsPerfTracker.java | 29 +-
.../services/TestAbfsRenameRetryRecovery.java | 11 +-
.../TestAbfsRestOperationMockFailures.java | 152 +-
.../services/TestAzureADAuthenticator.java | 4 +-
hadoop-tools/hadoop-compat-bench/pom.xml | 118 +
.../hadoop-compat-bench/shell/cases/attr.t | 58 +
.../hadoop-compat-bench/shell/cases/concat.t | 36 +
.../hadoop-compat-bench/shell/cases/copy.t | 33 +
.../hadoop-compat-bench/shell/cases/directory.t | 47 +
.../hadoop-compat-bench/shell/cases/fileinfo.t | 29 +
.../hadoop-compat-bench/shell/cases/move.t | 33 +
.../hadoop-compat-bench/shell/cases/read.t | 39 +
.../hadoop-compat-bench/shell/cases/remove.t | 40 +
.../hadoop-compat-bench/shell/cases/snapshot.t | 29 +
.../shell/cases/storagePolicy.t | 38 +
.../hadoop-compat-bench/shell/cases/write.t | 31 +
hadoop-tools/hadoop-compat-bench/shell/misc.sh | 181 +
.../apache/hadoop/fs/compat/HdfsCompatTool.java | 250 +
.../hadoop/fs/compat/cases/HdfsCompatAcl.java | 120 +
.../hadoop/fs/compat/cases/HdfsCompatBasics.java | 733 +
.../hadoop/fs/compat/cases/HdfsCompatCreate.java | 153 +
.../fs/compat/cases/HdfsCompatDirectory.java | 145 +
.../hadoop/fs/compat/cases/HdfsCompatFile.java | 241 +
.../hadoop/fs/compat/cases/HdfsCompatLocal.java | 111 +
.../hadoop/fs/compat/cases/HdfsCompatServer.java | 223 +
.../hadoop/fs/compat/cases/HdfsCompatSnapshot.java | 137 +
.../fs/compat/cases/HdfsCompatStoragePolicy.java | 106 +
.../hadoop/fs/compat/cases/HdfsCompatSymlink.java | 70 +
.../hadoop/fs/compat/cases/HdfsCompatTpcds.java | 121 +
.../hadoop/fs/compat/cases/HdfsCompatXAttr.java | 100 +
.../hadoop/fs/compat/cases/package-info.java | 23 +
.../fs/compat/common/AbstractHdfsCompatCase.java | 84 +
.../fs/compat/common/HdfsCompatApiScope.java | 358 +
.../hadoop/fs/compat/common/HdfsCompatCase.java | 31 +
.../fs/compat/common/HdfsCompatCaseCleanup.java | 28 +
.../fs/compat/common/HdfsCompatCaseGroup.java | 29 +
.../fs/compat/common/HdfsCompatCasePrepare.java | 28 +
.../fs/compat/common/HdfsCompatCaseSetUp.java | 28 +
.../fs/compat/common/HdfsCompatCaseTearDown.java | 28 +
.../hadoop/fs/compat/common/HdfsCompatCommand.java | 127 +
.../fs/compat/common/HdfsCompatEnvironment.java | 155 +
.../common/HdfsCompatIllegalArgumentException.java | 25 +
.../common/HdfsCompatIllegalCaseException.java | 31 +
.../hadoop/fs/compat/common/HdfsCompatReport.java | 79 +
.../fs/compat/common/HdfsCompatShellScope.java | 406 +
.../hadoop/fs/compat/common/HdfsCompatSuite.java | 27 +
.../hadoop/fs/compat/common/HdfsCompatUtil.java | 120 +
.../hadoop/fs/compat/common/package-info.java | 23 +
.../org/apache/hadoop/fs/compat/package-info.java | 24 +
.../fs/compat/suites/HdfsCompatSuiteForAll.java | 63 +
.../fs/compat/suites/HdfsCompatSuiteForShell.java | 50 +
.../fs/compat/suites/HdfsCompatSuiteForTpcds.java | 41 +
.../hadoop/fs/compat/suites/package-info.java | 23 +
.../resources/hadoop-compat-bench-log4j.properties | 24 +
.../src/site/markdown/HdfsCompatBench.md | 101 +
.../src/site/resources/css/site.css | 0
.../fs/compat/cases/HdfsCompatAclTestCases.java | 68 +
.../fs/compat/cases/HdfsCompatMkdirTestCases.java | 31 +
.../compat/common/TestHdfsCompatDefaultSuites.java | 61 +
.../fs/compat/common/TestHdfsCompatFsCommand.java | 180 +
.../common/TestHdfsCompatInterfaceCoverage.java | 57 +
.../compat/common/TestHdfsCompatShellCommand.java | 128 +
.../fs/compat/hdfs/HdfsCompatMiniCluster.java | 114 +
.../fs/compat/hdfs/HdfsCompatTestCommand.java | 54 +
.../fs/compat/hdfs/HdfsCompatTestShellScope.java | 113 +
.../hadoop-compat-bench-test-shell-hadoop.sh | 29 +
.../hadoop-compat-bench-test-shell-hdfs.sh | 33 +
.../src/test/resources/test-case-simple.t | 26 +
.../src/test/resources/test-case-skip.t | 24 +
hadoop-tools/pom.xml | 1 +
.../jdiff/Apache_Hadoop_YARN_API_3.4.0.xml | 27860 ++++++++++++++++++
.../jdiff/Apache_Hadoop_YARN_Client_3.4.0.xml | 3090 ++
.../jdiff/Apache_Hadoop_YARN_Common_3.4.0.xml | 4150 +++
.../Apache_Hadoop_YARN_Server_Common_3.4.0.xml | 1524 +
.../hadoop-yarn/hadoop-yarn-api/pom.xml | 5 -
.../hadoop-yarn-applications-mawo-core/pom.xml | 19 -
.../pom.xml | 1 +
.../hadoop-yarn-server-nodemanager/pom.xml | 4 -
.../logaggregation/AppLogAggregatorImpl.java | 37 +-
.../security/NMDelegationTokenManager.java | 49 +
.../logaggregation/TestLogAggregationService.java | 68 +
.../hadoop-yarn-server-resourcemanager/pom.xml | 6 +
.../resourcemanager/recovery/ZKRMStateStore.java | 37 +-
.../SingleConstraintAppPlacementAllocator.java | 2 +
.../TestCheckRemoveZKNodeRMStateStore.java | 405 +
197 files changed, 80462 insertions(+), 896 deletions(-)
create mode 100644
hadoop-common-project/hadoop-common/src/site/markdown/release/3.4.0/CHANGELOG.3.4.0.md
create mode 100644
hadoop-common-project/hadoop-common/src/site/markdown/release/3.4.0/RELEASENOTES.3.4.0.md
create mode 100644
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/nativeio/TestNativeIoInit.java
create mode 100644
hadoop-hdfs-project/hadoop-hdfs/dev-support/jdiff/Apache_Hadoop_HDFS_3.4.0.xml
create mode 100644
hadoop-mapreduce-project/dev-support/jdiff/Apache_Hadoop_MapReduce_Common_3.4.0.xml
create mode 100644
hadoop-mapreduce-project/dev-support/jdiff/Apache_Hadoop_MapReduce_Core_3.4.0.xml
create mode 100644
hadoop-mapreduce-project/dev-support/jdiff/Apache_Hadoop_MapReduce_JobClient_3.4.0.xml
create mode 100644
hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/authentication.md
create mode 100644
hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/TestS3AccessGrantConfiguration.java
create mode 100644
hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/contracts/exceptions/AbfsDriverException.java
create mode 100644
hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/contracts/exceptions/AbfsInvalidChecksumException.java
create mode 100644
hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsRetryPolicy.java
create mode 100644
hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/RetryPolicyConstants.java
create mode 100644
hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/StaticRetryPolicy.java
create mode 100644
hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemChecksum.java
rename
hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/{TestExponentialRetryPolicy.java
=> ITestExponentialRetryPolicy.java} (89%)
create mode 100644
hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/ITestStaticRetryPolicy.java
create mode 100644 hadoop-tools/hadoop-compat-bench/pom.xml
create mode 100644 hadoop-tools/hadoop-compat-bench/shell/cases/attr.t
create mode 100644 hadoop-tools/hadoop-compat-bench/shell/cases/concat.t
create mode 100644 hadoop-tools/hadoop-compat-bench/shell/cases/copy.t
create mode 100644 hadoop-tools/hadoop-compat-bench/shell/cases/directory.t
create mode 100644 hadoop-tools/hadoop-compat-bench/shell/cases/fileinfo.t
create mode 100644 hadoop-tools/hadoop-compat-bench/shell/cases/move.t
create mode 100644 hadoop-tools/hadoop-compat-bench/shell/cases/read.t
create mode 100644 hadoop-tools/hadoop-compat-bench/shell/cases/remove.t
create mode 100644 hadoop-tools/hadoop-compat-bench/shell/cases/snapshot.t
create mode 100644 hadoop-tools/hadoop-compat-bench/shell/cases/storagePolicy.t
create mode 100644 hadoop-tools/hadoop-compat-bench/shell/cases/write.t
create mode 100644 hadoop-tools/hadoop-compat-bench/shell/misc.sh
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/HdfsCompatTool.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/cases/HdfsCompatAcl.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/cases/HdfsCompatBasics.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/cases/HdfsCompatCreate.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/cases/HdfsCompatDirectory.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/cases/HdfsCompatFile.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/cases/HdfsCompatLocal.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/cases/HdfsCompatServer.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/cases/HdfsCompatSnapshot.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/cases/HdfsCompatStoragePolicy.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/cases/HdfsCompatSymlink.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/cases/HdfsCompatTpcds.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/cases/HdfsCompatXAttr.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/cases/package-info.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/AbstractHdfsCompatCase.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/HdfsCompatApiScope.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/HdfsCompatCase.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/HdfsCompatCaseCleanup.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/HdfsCompatCaseGroup.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/HdfsCompatCasePrepare.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/HdfsCompatCaseSetUp.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/HdfsCompatCaseTearDown.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/HdfsCompatCommand.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/HdfsCompatEnvironment.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/HdfsCompatIllegalArgumentException.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/HdfsCompatIllegalCaseException.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/HdfsCompatReport.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/HdfsCompatShellScope.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/HdfsCompatSuite.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/HdfsCompatUtil.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/common/package-info.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/package-info.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/suites/HdfsCompatSuiteForAll.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/suites/HdfsCompatSuiteForShell.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/suites/HdfsCompatSuiteForTpcds.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/java/org/apache/hadoop/fs/compat/suites/package-info.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/main/resources/hadoop-compat-bench-log4j.properties
create mode 100644
hadoop-tools/hadoop-compat-bench/src/site/markdown/HdfsCompatBench.md
copy {hadoop-common-project/hadoop-auth =>
hadoop-tools/hadoop-compat-bench}/src/site/resources/css/site.css (100%)
create mode 100644
hadoop-tools/hadoop-compat-bench/src/test/java/org/apache/hadoop/fs/compat/cases/HdfsCompatAclTestCases.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/test/java/org/apache/hadoop/fs/compat/cases/HdfsCompatMkdirTestCases.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/test/java/org/apache/hadoop/fs/compat/common/TestHdfsCompatDefaultSuites.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/test/java/org/apache/hadoop/fs/compat/common/TestHdfsCompatFsCommand.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/test/java/org/apache/hadoop/fs/compat/common/TestHdfsCompatInterfaceCoverage.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/test/java/org/apache/hadoop/fs/compat/common/TestHdfsCompatShellCommand.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/test/java/org/apache/hadoop/fs/compat/hdfs/HdfsCompatMiniCluster.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/test/java/org/apache/hadoop/fs/compat/hdfs/HdfsCompatTestCommand.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/test/java/org/apache/hadoop/fs/compat/hdfs/HdfsCompatTestShellScope.java
create mode 100644
hadoop-tools/hadoop-compat-bench/src/test/resources/hadoop-compat-bench-test-shell-hadoop.sh
create mode 100644
hadoop-tools/hadoop-compat-bench/src/test/resources/hadoop-compat-bench-test-shell-hdfs.sh
create mode 100644
hadoop-tools/hadoop-compat-bench/src/test/resources/test-case-simple.t
create mode 100644
hadoop-tools/hadoop-compat-bench/src/test/resources/test-case-skip.t
create mode 100644
hadoop-yarn-project/hadoop-yarn/dev-support/jdiff/Apache_Hadoop_YARN_API_3.4.0.xml
create mode 100644
hadoop-yarn-project/hadoop-yarn/dev-support/jdiff/Apache_Hadoop_YARN_Client_3.4.0.xml
create mode 100644
hadoop-yarn-project/hadoop-yarn/dev-support/jdiff/Apache_Hadoop_YARN_Common_3.4.0.xml
create mode 100644
hadoop-yarn-project/hadoop-yarn/dev-support/jdiff/Apache_Hadoop_YARN_Server_Common_3.4.0.xml
create mode 100644
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/security/NMDelegationTokenManager.java
create mode 100644
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/recovery/TestCheckRemoveZKNodeRMStateStore.java
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
