This is an automated email from the ASF dual-hosted git repository. rakeshr pushed a change to branch HDDS-2939 in repository https://gitbox.apache.org/repos/asf/hadoop-ozone.git.
discard 5519cc0 HDDS-2949: mkdir : store directory entries in a separate table (#1404) add 0eceb4c HDDS-2766. security/SecuringDataNodes.md (#1175) add a78a4b7 HDDS-4254. Bucket space: add usedBytes and update it when create and delete key. (#1431) add 8ca694a HDDS-4236. Move "Om*Codec.java" to new project hadoop-ozone/interface-storage (#1424) add 8899ff7 HDDS-4324. Add important comment to ListVolumes logic (#1417) add 261d34d HDDS-3297. Enable TestOzoneClientKeyGenerator. (#1442) add 64026dd HDDS-2660. Create insight point for datanode container protocol (#1272) add 5f1900a HDDS-4270. Add more reusable byteman scripts to debug ofs/o3fs performance (#1443) add c955729 HDDS-4194. Create a script to check AWS S3 compatibility (#1383) add 7d0d330 HDDS-4282. Improve the emptyDir syntax (#1450) add f1cdbe7 HDDS-4263. ReplicatiomManager shouldn't consider origin node Id for CLOSED containers. (#1438) add 004dd3f HDDS-4102. Normalize Keypath for lookupKey. (#1328) add 525ecbb HDDS-3727. Volume space: check quotaUsageInBytes when write key. (#1434) add 6267a39 HDDS-4231. Background Service blocks on task results. (#1414) add 34f3b91 HDDS-4232. Use single thread for KeyDeletingService. (#1415) add 68642c2 HDDS-4023. Delete closed container after all blocks have been deleted. (#1338) add 3ad1034 HDDS-4215. Update Freon doc in source tree. (#1403) add 2420ee8 HDDS-4288. the icon of hadoop-ozone is bigger than ever (#1452) add fdcc696 HDDS-4287: Exclude protobuff classes from ozone-filesystem-hadoop3 jars (#1455). Contributed by Uma Maheswara Rao G. add d1ac423 HDDS-3751. Ozone sh client support bucket quota option. (#1412) add be25991 HDDS-4292. Ozone Client not working with Hadoop Version < 3.2 (#1463) add d6a1836 HDDS-4251. Update Ratis version to latest snapshot (#1462) add 275653e HDDS-3869. Use different column families for datanode block and metadata (#1298) add 819b455 HDDS-4302 : Shade the org.apache.common.lang3 package as this is coming from other hadoop packages as well. (#1469). Contributed by Uma Maheswara Rao G. add 7216e3c HDDS-3966. Enable TestOMRatisSnapshots. (#1441) new e32552b HDDS-2949: mkdir : store directory entries in a separate table (#1404) This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (5519cc0) \ N -- N -- N refs/heads/HDDS-2939 (e32552b) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../byteman/appendlog.btm | 21 +- dev-support/byteman/hcfs-read.btm | 67 +++ .../byteman/ratis-flush.btm | 39 +- .../byteman/ratis-no-flush.btm | 18 +- .../byteman/watchforcommit.btm | 30 +- dev-support/byteman/watchforcommit_all.btm | 47 ++ .../apache/hadoop/hdds/scm/XceiverClientRatis.java | 4 +- .../hadoop/hdds/scm/client/HddsClientUtils.java | 8 +- .../RequestTypeDependentRetryPolicyCreator.java | 8 +- .../hadoop/hdds/utils/BackgroundService.java | 73 +-- .../apache/hadoop/hdds/utils/BackgroundTask.java | 4 +- .../hadoop/hdds/utils/BackgroundTaskQueue.java | 5 +- .../java/org/apache/hadoop/ozone/OzoneConsts.java | 34 +- .../container/common/helpers/ChunkInfoList.java | 56 ++ .../container/common/impl/ContainerDataYaml.java | 3 + .../container/common/impl/HddsDispatcher.java | 59 +- .../container/common/interfaces/BlockIterator.java | 5 +- .../container/common/interfaces/Container.java | 7 - .../CloseContainerCommandHandler.java | 2 +- .../CreatePipelineCommandHandler.java | 2 +- .../commandhandler/DeleteBlocksCommandHandler.java | 69 ++- .../server/ratis/ContainerStateMachine.java | 2 +- .../transport/server/ratis/XceiverServerRatis.java | 4 +- .../container/common/utils/ContainerCache.java | 34 +- .../container/common/utils/ReferenceCountedDB.java | 10 +- .../container/keyvalue/KeyValueBlockIterator.java | 156 ----- .../container/keyvalue/KeyValueContainer.java | 26 +- .../container/keyvalue/KeyValueContainerCheck.java | 12 +- .../container/keyvalue/KeyValueContainerData.java | 48 +- .../container/keyvalue/helpers/BlockUtils.java | 2 +- .../keyvalue/helpers/KeyValueContainerUtil.java | 194 ++++--- .../container/keyvalue/impl/BlockManagerImpl.java | 65 ++- .../background/BlockDeletingService.java | 56 +- .../metadata/AbstractDatanodeDBDefinition.java | 74 +++ .../container/metadata/AbstractDatanodeStore.java | 297 ++++++++++ .../ozone/container/metadata/BlockDataCodec.java} | 40 +- .../container/metadata/ChunkInfoListCodec.java} | 38 +- .../metadata/DatanodeSchemaOneDBDefinition.java | 91 +++ .../metadata/DatanodeSchemaTwoDBDefinition.java | 81 +++ .../ozone/container/metadata/DatanodeStore.java | 94 ++++ .../metadata/DatanodeStoreSchemaOneImpl.java | 49 ++ .../metadata/DatanodeStoreSchemaTwoImpl.java | 47 +- .../ozone/container/metadata/DatanodeTable.java | 130 +++++ .../metadata/SchemaOneChunkInfoListCodec.java | 68 +++ .../metadata/SchemaOneDeletedBlocksTable.java | 180 ++++++ .../container/metadata/SchemaOneKeyCodec.java | 106 ++++ .../ozone/container/metadata}/package-info.java | 9 +- ...inerDatanodeProtocolServerSideTranslatorPB.java | 2 +- .../container/common/TestBlockDeletingService.java | 113 +++- .../ozone/container/common/TestContainerCache.java | 25 +- .../common/TestKeyValueContainerData.java | 3 + .../TestSchemaOneBackwardsCompatibility.java | 626 +++++++++++++++++++++ .../common/impl/TestContainerDataYaml.java | 3 + .../keyvalue/TestKeyValueBlockIterator.java | 340 +++++++---- .../container/keyvalue/TestKeyValueContainer.java | 75 +-- .../keyvalue/TestKeyValueContainerCheck.java | 18 +- .../container/ozoneimpl/TestContainerReader.java | 43 +- .../container/ozoneimpl/TestOzoneContainer.java | 14 +- .../test/resources/123-dn-container.db/000024.sst | Bin 0 -> 1022 bytes .../test/resources/123-dn-container.db/000026.sst | Bin 0 -> 827 bytes .../test/resources/123-dn-container.db/000032.sst | Bin 0 -> 896 bytes .../test/resources/123-dn-container.db/000034.log | 0 .../src/test/resources/123-dn-container.db/CURRENT | 1 + .../test/resources/123-dn-container.db/IDENTITY | 1 + .../resources/123-dn-container.db/MANIFEST-000033 | Bin 0 -> 297 bytes .../resources/123-dn-container.db/OPTIONS-000033 | 165 ++++++ .../resources/123-dn-container.db/OPTIONS-000036 | 165 ++++++ .../src/test/resources/123.container | 10 + .../docs/content/security/SecuringDatanodes.md | 34 +- .../docs/content/security/SecuringDatanodes.zh.md | 53 ++ hadoop-hdds/docs/content/tools/TestTools.md | 12 +- hadoop-hdds/docs/content/tools/TestTools.zh.md | 12 +- .../themes/ozonedoc/layouts/partials/navbar.html | 4 +- .../docs/themes/ozonedoc/static/css/ozonedoc.css | 11 + .../server/OzoneProtocolMessageDispatcher.java | 9 +- .../hadoop/hdds/utils/MetadataKeyFilters.java | 42 +- .../apache/hadoop/hdds/utils/db/DBDefinition.java | 14 +- .../org/apache/hadoop/hdds/utils/db/DBStore.java | 8 +- .../hadoop/hdds/utils/db/DBStoreBuilder.java | 41 +- .../org/apache/hadoop/hdds/utils/db/RDBStore.java | 17 +- .../org/apache/hadoop/hdds/utils/db/RDBTable.java | 92 +++ .../org/apache/hadoop/hdds/utils/db/Table.java | 56 ++ .../apache/hadoop/hdds/utils/db/TypedTable.java | 46 ++ .../src/main/proto/DatanodeClientProtocol.proto | 4 + hadoop-hdds/pom.xml | 2 + .../hdds/scm/block/SCMBlockDeletingService.java | 3 +- .../container/AbstractContainerReportHandler.java | 51 +- .../hdds/scm/container/ContainerReportHandler.java | 12 +- .../IncrementalContainerReportHandler.java | 2 +- .../hdds/scm/container/ReplicationManager.java | 113 +++- .../hdds/scm/container/SCMContainerManager.java | 6 +- .../SCMSecurityProtocolServerSideTranslatorPB.java | 17 +- ...lockLocationProtocolServerSideTranslatorPB.java | 2 +- ...inerLocationProtocolServerSideTranslatorPB.java | 17 +- .../hdds/scm/safemode/ContainerSafeModeRule.java | 4 +- .../java/org/apache/hadoop/hdds/scm/TestUtils.java | 1 + .../scm/container/TestContainerReportHandler.java | 33 ++ .../hdds/scm/container/TestReplicationManager.java | 2 +- .../org/apache/hadoop/ozone/client/BucketArgs.java | 43 +- .../apache/hadoop/ozone/client/ObjectStore.java | 3 + .../apache/hadoop/ozone/client/OzoneBucket.java | 93 +++ .../apache/hadoop/ozone/client/OzoneVolume.java | 26 + .../org/apache/hadoop/ozone/client/VolumeArgs.java | 10 +- .../hadoop/ozone/client/io/KeyOutputStream.java | 4 +- .../ozone/client/protocol/ClientProtocol.java | 15 +- .../apache/hadoop/ozone/client/rpc/RpcClient.java | 74 ++- .../hadoop/ozone/om/exceptions/OMException.java | 4 +- .../ozone/om/exceptions/OMNotLeaderException.java | 2 +- .../ozone/om/ha/OMFailoverProxyProvider.java | 54 +- .../hadoop/ozone/om/helpers/OmBucketArgs.java | 50 +- .../hadoop/ozone/om/helpers/OmBucketInfo.java | 78 ++- .../hadoop/ozone/om/helpers/TestOmVolumeArgs.java | 4 +- .../ozone-dev/csi/csi-provisioner-deployment.yaml | 2 +- .../ozone/csi/csi-provisioner-deployment.yaml | 2 +- .../src/main/smoketest/basic/ozone-shell-lib.robot | 49 +- .../main/smoketest/basic/ozone-shell-single.robot | 2 +- .../src/main/smoketest/basic/ozone-shell.robot | 2 +- .../dist/src/main/smoketest/createbucketenv.robot | 2 +- .../dist/src/main/smoketest/createmrenv.robot | 2 +- .../src/main/smoketest/debug/ozone-debug.robot | 2 +- .../dist/src/main/smoketest/gdpr/gdpr.robot | 2 +- .../dist/src/main/smoketest/ozonefs/setup.robot | 8 +- .../src/main/smoketest/s3/MultipartUpload.robot | 130 ++--- .../dist/src/main/smoketest/s3/commonawslib.robot | 5 + .../dist/src/main/smoketest/s3/objectcopy.robot | 23 +- .../dist/src/main/smoketest/s3/objectdelete.robot | 28 +- .../src/main/smoketest/s3/objectmultidelete.robot | 24 +- .../dist/src/main/smoketest/s3/objectputget.robot | 40 +- .../src/main/smoketest/s3/s3_compatbility_check.sh | 47 ++ .../hadoop/ozone/insight/BaseInsightPoint.java | 34 +- .../ozone/insight/BaseInsightSubCommand.java | 3 + .../apache/hadoop/ozone/insight/InsightPoint.java | 4 +- .../hadoop/ozone/insight/MetricGroupDisplay.java | 4 +- .../hadoop/ozone/insight/MetricsSubCommand.java | 33 +- .../datanode/DatanodeDispatcherInsight.java | 107 ++++ .../insight/datanode/PipelineComponentUtil.java | 78 +++ .../ozone/insight/datanode/RatisInsight.java | 45 +- .../hadoop/ozone/insight/om/KeyManagerInsight.java | 2 +- .../hadoop/ozone/insight/om/OmProtocolInsight.java | 2 +- .../ozone/insight/scm/NodeManagerInsight.java | 2 +- .../ozone/insight/scm/ReplicaManagerInsight.java | 2 +- .../scm/ScmProtocolBlockLocationInsight.java | 2 +- .../scm/ScmProtocolContainerLocationInsight.java | 2 +- .../insight/scm/ScmProtocolDatanodeInsight.java | 2 +- .../insight/scm/ScmProtocolSecurityInsight.java | 2 +- .../fs/ozone/TestOzoneFSWithObjectStoreCreate.java | 40 ++ .../hadoop/fs/ozone/TestOzoneFileSystem.java | 6 +- .../hadoop/fs/ozone/TestRootedOzoneFileSystem.java | 4 +- .../ozone/TestStorageContainerManagerHelper.java | 31 +- .../rpc/TestBlockOutputStreamWithFailures.java | 4 +- ...estBlockOutputStreamWithFailuresFlushDelay.java | 4 +- .../hadoop/ozone/client/rpc/TestCommitWatcher.java | 8 +- .../rpc/TestContainerStateMachineFailures.java | 2 +- .../rpc/TestOzoneClientRetriesOnException.java | 2 +- ...estOzoneClientRetriesOnExceptionFlushDelay.java | 2 +- .../client/rpc/TestOzoneRpcClientAbstract.java | 250 +++++++- .../client/rpc/TestValidateBCSIDOnRestart.java | 8 +- .../ozone/client/rpc/TestWatchForCommit.java | 2 +- .../commandhandler/TestBlockDeletion.java | 92 ++- .../ozone/freon/TestOzoneClientKeyGenerator.java | 2 - .../hadoop/ozone/om/TestOMRatisSnapshots.java | 2 - .../src/main/proto/OmClientProtocol.proto | 7 + .../interface-storage}/pom.xml | 46 +- .../apache/hadoop/ozone/om/OMMetadataManager.java | 0 .../ozone/om/codec/OMTransactionInfoCodec.java | 0 .../hadoop/ozone/om/codec/OmBucketInfoCodec.java | 0 .../hadoop/ozone/om/codec/OmKeyInfoCodec.java | 0 .../ozone/om/codec/OmMultipartKeyInfoCodec.java | 0 .../hadoop/ozone/om/codec/OmPrefixInfoCodec.java | 0 .../hadoop/ozone/om/codec/OmVolumeArgsCodec.java | 0 .../ozone/om/codec/RepeatedOmKeyInfoCodec.java | 0 .../hadoop/ozone/om/codec/S3SecretValueCodec.java | 0 .../ozone/om/codec/TokenIdentifierCodec.java | 0 .../hadoop/ozone/om/codec/UserVolumeInfoCodec.java | 0 .../apache/hadoop/ozone/om/codec/package-info.java | 2 +- .../org/apache/hadoop/ozone/om}/package-info.java | 4 +- .../hadoop/ozone/om/ratis/OMTransactionInfo.java | 2 +- .../hadoop/ozone/om/ratis}/package-info.java | 4 +- .../ozone/om/codec/TestOMTransactionInfoCodec.java | 0 .../hadoop/ozone/om/codec/TestOmKeyInfoCodec.java | 0 .../om/codec/TestOmMultipartKeyInfoCodec.java | 0 .../ozone/om/codec/TestOmPrefixInfoCodec.java | 0 .../ozone/om/codec/TestRepeatedOmKeyInfoCodec.java | 0 .../ozone/om/codec/TestS3SecretValueCodec.java | 0 .../apache/hadoop/ozone/om/codec/package-info.java | 0 hadoop-ozone/ozone-manager/pom.xml | 5 + .../apache/hadoop/ozone/om/KeyDeletingService.java | 9 +- .../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 9 +- .../hadoop/ozone/om/OpenKeyCleanupService.java | 3 +- .../apache/hadoop/ozone/om/codec/package-info.java | 3 + .../ozone/om/ratis/OzoneManagerRatisServer.java | 6 +- .../ozone/om/ratis/OzoneManagerStateMachine.java | 2 +- .../om/request/bucket/OMBucketCreateRequest.java | 38 ++ .../request/bucket/OMBucketSetPropertyRequest.java | 64 +++ .../ozone/om/request/file/OMFileCreateRequest.java | 17 +- .../om/request/key/OMAllocateBlockRequest.java | 23 +- .../ozone/om/request/key/OMKeyCommitRequest.java | 11 +- .../ozone/om/request/key/OMKeyCreateRequest.java | 30 +- .../ozone/om/request/key/OMKeyDeleteRequest.java | 6 +- .../hadoop/ozone/om/request/key/OMKeyRequest.java | 37 ++ .../ozone/om/request/key/OMKeysDeleteRequest.java | 6 +- .../multipart/S3MultipartUploadAbortRequest.java | 6 +- .../S3MultipartUploadCommitPartRequest.java | 13 +- .../om/request/volume/OMVolumeSetQuotaRequest.java | 54 +- .../om/response/file/OMFileCreateResponse.java | 6 +- .../om/response/key/OMAllocateBlockResponse.java | 10 +- .../ozone/om/response/key/OMKeyCommitResponse.java | 9 +- .../ozone/om/response/key/OMKeyCreateResponse.java | 10 +- .../ozone/om/response/key/OMKeyDeleteResponse.java | 9 +- .../om/response/key/OMKeysDeleteResponse.java | 10 +- .../multipart/S3MultipartUploadAbortResponse.java | 10 +- .../S3MultipartUploadCommitPartResponse.java | 10 +- ...OzoneManagerProtocolServerSideTranslatorPB.java | 4 +- .../hadoop/ozone/om/failover/TestOMFailovers.java | 13 +- .../ozone/om/request/TestOMRequestUtils.java | 48 +- .../bucket/TestOMBucketSetPropertyRequest.java | 41 +- .../volume/TestOMVolumeSetQuotaRequest.java | 33 ++ .../response/key/TestOMAllocateBlockResponse.java | 17 +- .../om/response/key/TestOMKeyCommitResponse.java | 11 +- .../om/response/key/TestOMKeyCreateResponse.java | 11 +- .../om/response/key/TestOMKeyDeleteResponse.java | 16 +- .../om/response/key/TestOMKeysDeleteResponse.java | 11 +- .../s3/multipart/TestS3MultipartResponse.java | 6 +- .../TestS3MultipartUploadAbortResponse.java | 11 +- hadoop-ozone/ozonefs-shaded/pom.xml | 5 + hadoop-ozone/pom.xml | 6 + .../ReconIncrementalContainerReportHandler.java | 2 +- .../hadoop/ozone/client/ObjectStoreStub.java | 4 +- ...ketHandler.java => ClearSpaceQuotaOptions.java} | 26 +- ...reTypeOption.java => SetSpaceQuotaOptions.java} | 32 +- .../hadoop/ozone/shell/bucket/BucketCommands.java | 4 +- ...teBucketHandler.java => ClearQuotaHandler.java} | 30 +- .../ozone/shell/bucket/CreateBucketHandler.java | 13 + ...ListBucketHandler.java => SetQuotaHandler.java} | 54 +- .../ClearQuotaHandler.java} | 30 +- .../ozone/shell/volume/CreateVolumeHandler.java | 21 +- .../SetQuotaHandler.java} | 49 +- .../ozone/shell/volume/UpdateVolumeHandler.java | 23 - .../hadoop/ozone/shell/volume/VolumeCommands.java | 4 +- pom.xml | 2 +- 240 files changed, 5808 insertions(+), 1611 deletions(-) copy hadoop-ozone/dist/src/main/smoketest/basic/ozone-shell-single.robot => dev-support/byteman/appendlog.btm (66%) create mode 100644 dev-support/byteman/hcfs-read.btm copy hadoop-hdds/docs/config.yaml => dev-support/byteman/ratis-flush.btm (58%) copy hadoop-ozone/dist/src/main/compose/common/docker-image/docker-krb5/launcher.sh => dev-support/byteman/ratis-no-flush.btm (78%) copy hadoop-hdds/docs/dev-support/bin/generate-site.sh => dev-support/byteman/watchforcommit.btm (56%) mode change 100755 => 100644 create mode 100644 dev-support/byteman/watchforcommit_all.btm create mode 100644 hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/container/common/helpers/ChunkInfoList.java delete mode 100644 hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/KeyValueBlockIterator.java create mode 100644 hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/AbstractDatanodeDBDefinition.java create mode 100644 hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/AbstractDatanodeStore.java copy hadoop-hdds/{framework/src/main/java/org/apache/hadoop/hdds/security/token/TokenVerifier.java => container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/BlockDataCodec.java} (52%) copy hadoop-hdds/{framework/src/main/java/org/apache/hadoop/hdds/security/token/TokenVerifier.java => container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/ChunkInfoListCodec.java} (53%) create mode 100644 hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/DatanodeSchemaOneDBDefinition.java create mode 100644 hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/DatanodeSchemaTwoDBDefinition.java create mode 100644 hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/DatanodeStore.java create mode 100644 hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/DatanodeStoreSchemaOneImpl.java copy hadoop-ozone/client/src/test/java/org/apache/hadoop/ozone/client/rpc/TestOzoneKMSUtil.java => hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/DatanodeStoreSchemaTwoImpl.java (52%) create mode 100644 hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/DatanodeTable.java create mode 100644 hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/SchemaOneChunkInfoListCodec.java create mode 100644 hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/SchemaOneDeletedBlocksTable.java create mode 100644 hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/metadata/SchemaOneKeyCodec.java copy hadoop-hdds/{client/src/main/java/org/apache/hadoop/hdds/scm/client => container-service/src/main/java/org/apache/hadoop/ozone/container/metadata}/package-info.java (81%) create mode 100644 hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/common/TestSchemaOneBackwardsCompatibility.java create mode 100644 hadoop-hdds/container-service/src/test/resources/123-dn-container.db/000024.sst create mode 100644 hadoop-hdds/container-service/src/test/resources/123-dn-container.db/000026.sst create mode 100644 hadoop-hdds/container-service/src/test/resources/123-dn-container.db/000032.sst create mode 100644 hadoop-hdds/container-service/src/test/resources/123-dn-container.db/000034.log create mode 100644 hadoop-hdds/container-service/src/test/resources/123-dn-container.db/CURRENT create mode 100644 hadoop-hdds/container-service/src/test/resources/123-dn-container.db/IDENTITY create mode 100644 hadoop-hdds/container-service/src/test/resources/123-dn-container.db/MANIFEST-000033 create mode 100644 hadoop-hdds/container-service/src/test/resources/123-dn-container.db/OPTIONS-000033 create mode 100644 hadoop-hdds/container-service/src/test/resources/123-dn-container.db/OPTIONS-000036 create mode 100644 hadoop-hdds/container-service/src/test/resources/123.container create mode 100644 hadoop-hdds/docs/content/security/SecuringDatanodes.zh.md create mode 100755 hadoop-ozone/dist/src/main/smoketest/s3/s3_compatbility_check.sh create mode 100644 hadoop-ozone/insight/src/main/java/org/apache/hadoop/ozone/insight/datanode/DatanodeDispatcherInsight.java create mode 100644 hadoop-ozone/insight/src/main/java/org/apache/hadoop/ozone/insight/datanode/PipelineComponentUtil.java copy {hadoop-hdds/client => hadoop-ozone/interface-storage}/pom.xml (66%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/main/java/org/apache/hadoop/ozone/om/OMMetadataManager.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/OMTransactionInfoCodec.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/OmBucketInfoCodec.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/OmKeyInfoCodec.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/OmMultipartKeyInfoCodec.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/OmPrefixInfoCodec.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/OmVolumeArgsCodec.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/RepeatedOmKeyInfoCodec.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/S3SecretValueCodec.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/TokenIdentifierCodec.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/UserVolumeInfoCodec.java (100%) copy hadoop-ozone/{ozone-manager => interface-storage}/src/main/java/org/apache/hadoop/ozone/om/codec/package-info.java (95%) copy hadoop-ozone/{ozone-manager/src/test/java/org/apache/hadoop/ozone/om/codec => interface-storage/src/main/java/org/apache/hadoop/ozone/om}/package-info.java (92%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/main/java/org/apache/hadoop/ozone/om/ratis/OMTransactionInfo.java (100%) copy hadoop-ozone/{ozone-manager/src/test/java/org/apache/hadoop/ozone/om/codec => interface-storage/src/main/java/org/apache/hadoop/ozone/om/ratis}/package-info.java (92%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/test/java/org/apache/hadoop/ozone/om/codec/TestOMTransactionInfoCodec.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/test/java/org/apache/hadoop/ozone/om/codec/TestOmKeyInfoCodec.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/test/java/org/apache/hadoop/ozone/om/codec/TestOmMultipartKeyInfoCodec.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/test/java/org/apache/hadoop/ozone/om/codec/TestOmPrefixInfoCodec.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/test/java/org/apache/hadoop/ozone/om/codec/TestRepeatedOmKeyInfoCodec.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/test/java/org/apache/hadoop/ozone/om/codec/TestS3SecretValueCodec.java (100%) rename hadoop-ozone/{ozone-manager => interface-storage}/src/test/java/org/apache/hadoop/ozone/om/codec/package-info.java (100%) copy hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/{bucket/BucketHandler.java => ClearSpaceQuotaOptions.java} (63%) copy hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/{StoreTypeOption.java => SetSpaceQuotaOptions.java} (59%) copy hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/bucket/{DeleteBucketHandler.java => ClearQuotaHandler.java} (66%) copy hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/bucket/{ListBucketHandler.java => SetQuotaHandler.java} (54%) copy hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/{bucket/DeleteBucketHandler.java => volume/ClearQuotaHandler.java} (66%) copy hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/{bucket/ListBucketHandler.java => volume/SetQuotaHandler.java} (57%) --------------------------------------------------------------------- To unsubscribe, e-mail: ozone-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: ozone-commits-h...@hadoop.apache.org