This is an automated email from the ASF dual-hosted git repository.
siyao pushed a change to branch HDDS-6517-Snapshot
in repository https://gitbox.apache.org/repos/asf/ozone.git
from aea5edfe99 HDDS-7845. [Snapshot] Wait for RocksDB checkpoint directory
creation (#4214)
add de53086f13 HDDS-5541. Namespace summary endpoint can carry basic
information on the entity as well. (#4042)
add 7229b35958 HDDS-6447. Refine SCM handling of unhealthy container
replicas. (#3920)
add d56acae8c8 HDDS-7760. Let ContainerDataConstructor extend
SafeConstructor (#4162)
add 9d5cfd6934 HDDS-7083. Spread container-copy directories (#3648)
add 5f54cc60ba HDDS-5934. Add OM NodeID to VERSION file. (#4138)
add 2bd13c3737 HDDS-7751. Volume quota must have all bucket quota set
(#4165)
add 80f544b704 HDDS-7570. Provide a shareable ofs://temp directory (#4027)
add 1a63207add HDDS-7775. EC: Exception encountered while deleting
UNHEALTHY replica in Datanode (#4173)
add f9dfd73e99 HDDS-7761. EC: ReplicationManager - Use
placementPolicy.replicasToRemoveToFixOverreplication in EC Over replication
handler (#4166)
add 253e97c218 HDDS-7774. Update outdated Trash documentation (#4172)
add c00d3af98a HDDS-7722. FSO buckets fail to invalidate open file table
cache when committing a key (#4156)
add 7923e25be4 HDDS-7441. Rename function names of retrieving metadata
keys (#3918)
add 59938f90bf HDDS-7455. ClassCastException: OzoneTokenIdentifier cannot
be cast to String (#4159)
add 8b9aad6a45 HDDS-7754. Download of container is failing with SSL/TLS
error during re-replication (#4174)
add c61ee3ea3e HDDS-7787. GetChecksum for EC files can fail intermittently
with IndexOutOfBounds exception (#4180)
add b405f84621 HDDS-7542. Refactor DefaultReplicationConfig (#4005)
add 0c32c60257 HDDS-7718. Bump Netty to 4.1.86 and gRPC to 1.51.1 (#4139)
add 3bc2b79764 HDDS-7788. Ratis OverReplicationHandler should exclude
stale replicas (#4183)
add dbe9abc670 HDDS-7723. Refresh Keys and Certificate used in
OzoneSecretManager after certificate renewed (#4179)
add d3f232396a HDDS-7748. Rename OMFileRequest.addToOpenFileTable() to
avoid misuse. (#4176)
add be408031e3 HDDS-7804. UNHEALTHY replicas will not contribute to
sufficient replication in RatisContainerReplicaCount (#4192)
add 6ff310eedd HDDS-7755. Ensure that acquired locks are always released.
(#4191)
add 099cd1d680 HDDS-7807. TarContainerPacker closes streams multiple times
(#4193)
add c6c36d4bcb HDDS-7801. Bucket not found when calling getKeyInfo with
tenant context (#4189)
add 23a91637ff HDDS-7625. Do not compress OM/SCM checkpoints (#4130)
add 5ea64550b5 HDDS-7813. Handle Mismatched Replicas (OPEN or CLOSING) of
QUASI-CLOSED containers in RM (#4195)
add 61a2e6e4b8 HDDS-7097. Container scanner log output lacks useful
information (#4169)
add c25d38faf8 HDDS-7792. Fix package name typos in
o.a.h.hdds.security.x509 (#4184)
add aed64de760 HDDS-7777. Implement container replication in push model
(#4197)
add 151ee0afd8 HDDS-7820. Store container descriptor at start of tar
archive (#4200)
add f1e94fc801 HDDS-7825. Warn when EC write exception occurs (#4201)
add 43b01d1bc5 HDDS-7833. EC: Refactor ReplicationSupervisor to allow
Replication and ECReconstruction tasks (#4202)
add 08d8521060 HDDS-7822. Allow multiple commands per datanode in
UnhealthyReplicationHandler (#4203)
add 0217fa4e8e HDDS-7834. Remove unnecessary streams (#4208)
add 4c6c1218a7 HDDS-7818. Modify Ratis Replication Handling in the new RM
(#4204)
add e806fd6ce8 HDDS-7496. Make default bucket layout FSO in a backwards
compatible way. (#3966)
add 17549db4a1 HDDS-7841. EC: Remove ECReconstructionSupervisor and send
reconstruction commands to ReplicationSupervisor (#4210)
add ec3813fada HDDS-7808. Intermittent failure in
TestReplicationManager#testUnderReplicationQueuePopulated (#4213)
add ec1e098694 HDDS-7372. Fix missing jars in classpath by specifying jar
versions (#4097)
add 75a28b2e4c HDDS-7806. Add unit tests for push replication (#4216)
add 38733cfff1 HDDS-7770. Recon namespace summary endpoint to carry basic
entity information as well (#4170)
add 9d4d358654 HDDS-7778. Add metrics for push replication (#4217)
add 4eddb9d2ac HDDS-6847. Audit for ALLOCATE_BLOCK should indicate number
of allocated blocks (#3518)
add 3393354472 HDDS-7856. Disable flaky TestPushReplicator until fixed
add b16342af26 HDDS-7844. EC: Add normal and low priority to replication
supervisor and commands (#4220)
add 6389d01605 HDDS-7856. Fix timeout in TestPushReplicator (#4225)
new 106b193c2a Merge remote-tracking branch 'asf/master' into
HDDS-6517-Snapshot
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../hadoop/ozone/client/io/ECStreamTestUtil.java | 3 +-
.../org/apache/hadoop/hdds/client/BlockID.java | 5 +
.../hadoop/hdds/client/ContainerBlockID.java | 3 +
.../hdds/client/DefaultReplicationConfig.java | 94 +-
.../hadoop/hdds/conf/OzoneConfiguration.java | 5 +-
.../java/org/apache/hadoop/hdds/utils/IOUtils.java | 17 +
.../common/src/main/resources/ozone-default.xml | 16 +-
.../apache/hadoop/ozone/HddsDatanodeService.java | 2 +-
.../container/common/helpers/ContainerUtils.java | 20 +
.../container/common/impl/ContainerDataYaml.java | 8 +-
.../common/interfaces/ContainerPacker.java | 3 +-
.../common/statemachine/DatanodeStateMachine.java | 65 +-
.../commandhandler/DeleteBlocksCommandHandler.java | 13 +-
.../ReconstructECContainersCommandHandler.java | 19 +-
.../ReplicateContainerCommandHandler.java | 24 +-
.../container/common/volume/StorageVolume.java | 4 +
.../ECReconstructionCoordinatorTask.java | 66 +-
.../reconstruction/ECReconstructionSupervisor.java | 111 -
.../container/ec/reconstruction/TokenHelper.java | 16 +-
.../container/keyvalue/KeyValueContainer.java | 86 +-
.../container/keyvalue/KeyValueContainerCheck.java | 10 +-
.../container/keyvalue/KeyValueContainerData.java | 27 +-
.../KeyValueContainerMetadataInspector.java | 14 +-
.../ozone/container/keyvalue/KeyValueHandler.java | 15 +-
.../container/keyvalue/TarContainerPacker.java | 146 +-
.../helpers/KeyValueContainerLocationUtil.java | 41 +-
.../keyvalue/helpers/KeyValueContainerUtil.java | 10 +-
.../container/keyvalue/impl/BlockManagerImpl.java | 14 +-
.../background/BlockDeletingService.java | 7 +-
.../container/ozoneimpl/ContainerController.java | 3 +-
.../ozone/container/ozoneimpl/OzoneContainer.java | 6 +-
.../replication/AbstractReplicationTask.java | 123 +
.../container/replication/ContainerDownloader.java | 2 +-
.../container/replication/ContainerImporter.java | 126 +
...ainerReplicator.java => ContainerUploader.java} | 17 +-
.../replication/CopyContainerResponseStream.java | 47 +
.../replication/DownloadAndImportReplicator.java | 101 +-
.../replication/GrpcContainerUploader.java | 100 +
.../container/replication/GrpcOutputStream.java | 41 +-
.../replication/GrpcReplicationClient.java | 21 +-
.../replication/GrpcReplicationService.java | 20 +-
.../container/replication/MeasuredReplicator.java | 23 +-
.../container/replication/PushReplicator.java | 76 +
.../container/replication/ReplicationServer.java | 7 +-
.../replication/ReplicationSupervisor.java | 170 +-
.../replication/ReplicationSupervisorMetrics.java | 7 +-
.../container/replication/ReplicationTask.java | 88 +-
.../replication/SendContainerOutputStream.java} | 38 +-
.../replication/SendContainerRequestHandler.java | 131 +
.../replication/SimpleContainerDownloader.java | 34 +-
.../commands/ReplicateContainerCommand.java | 76 +-
.../hadoop/ozone/TestHddsSecureDatanodeInit.java | 2 +-
.../container/common/TestBlockDeletingService.java | 19 +-
.../TestSchemaOneBackwardsCompatibility.java | 27 +-
.../TestSchemaTwoBackwardsCompatibility.java | 4 +-
.../common/helpers/TestContainerUtils.java | 10 +
.../common/statemachine/TestStateContext.java | 9 +-
.../TestECReconstructionSupervisor.java | 158 -
.../container/keyvalue/TestKeyValueContainer.java | 10 +-
.../TestKeyValueContainerIntegrityChecks.java | 4 +-
.../TestKeyValueContainerMetadataInspector.java | 8 +-
.../container/keyvalue/TestTarContainerPacker.java | 77 +-
.../container/ozoneimpl/TestContainerReader.java | 13 +-
.../container/ozoneimpl/TestOzoneContainer.java | 7 +-
...OutputStream.java => GrpcOutputStreamTest.java} | 46 +-
.../ReplicationSupervisorScheduling.java | 85 +-
.../TestCopyContainerResponseStream.java | 50 +
.../replication/TestMeasuredReplicator.java | 32 +-
.../container/replication/TestPushReplicator.java | 140 +
.../replication/TestReplicationSupervisor.java | 242 +-
.../TestSendContainerOutputStream.java} | 39 +-
.../replication/TestSimpleContainerDownloader.java | 50 +-
.../upgrade/TestDatanodeUpgradeToScmHA.java | 17 +-
hadoop-hdds/docs/content/design/trash.md | 5 -
hadoop-hdds/docs/content/feature/PrefixFSO.md | 4 +-
hadoop-hdds/docs/content/feature/PrefixFSO.zh.md | 4 +-
.../hadoop/hdds/security/OzoneSecretKey.java | 9 +-
.../hadoop/hdds/security/OzoneSecretManager.java | 54 +-
.../security/ssl/PemFileBasedKeyStoresFactory.java | 2 +-
.../token/ContainerTokenSecretManager.java | 5 +-
.../token/OzoneBlockTokenSecretManager.java | 5 +-
.../token/ShortLivedTokenSecretManager.java | 9 +-
.../x509/certificate/authority/BaseApprover.java | 4 +-
.../certificate/authority/DefaultApprover.java | 2 +-
.../certificate/authority/DefaultCAServer.java | 10 +-
.../{PKIProfiles => profile}/DefaultCAProfile.java | 2 +-
.../{PKIProfiles => profile}/DefaultProfile.java | 2 +-
.../{PKIProfiles => profile}/PKIProfile.java | 2 +-
.../{PKIProfiles => profile}/package-info.java | 2 +-
.../x509/certificate/client/CertificateClient.java | 10 +-
.../client/CertificateNotification.java} | 19 +-
.../client/CommonCertificateClient.java | 4 +-
.../certificate/client/DNCertificateClient.java | 8 +-
.../client/DefaultCertificateClient.java | 44 +-
.../certificate/client/ReconCertificateClient.java | 8 +-
.../certificate/client/SCMCertificateClient.java | 4 +-
.../utils/CertificateSignRequest.java | 4 +-
.../utils/SelfSignedCertificate.java | 4 +-
.../CertificateException.java | 2 +-
.../{exceptions => exception}/package-info.java | 2 +-
.../hdds/security/x509/keys/SecurityUtil.java | 2 +-
.../hadoop/hdds/utils/DBCheckpointServlet.java | 69 +-
.../apache/hadoop/hdds/utils/HddsServerUtil.java | 18 +-
.../token/TestOzoneBlockTokenSecretManager.java | 2 +-
.../hdds/security/token/TokenVerifierTests.java | 2 +-
.../hdds/security/x509/CertificateClientTest.java | 9 +-
.../x509/certificate/authority/MockApprover.java | 2 +-
.../certificate/authority/TestDefaultCAServer.java | 10 +-
.../certificate/authority/TestDefaultProfile.java | 4 +-
.../client/TestDefaultCertificateClient.java | 4 +-
.../x509/certificate/utils/TestCRLCodec.java | 1 -
.../certificate/utils/TestCertificateCodec.java | 1 -
.../utils}/TestCertificateSignRequest.java | 3 +-
.../utils}/TestRootCertificate.java | 8 +-
.../security/x509/certificates/package-info.java | 22 -
.../src/main/proto/DatanodeClientProtocol.proto | 11 +
.../proto/ScmServerDatanodeHeartbeatProtocol.proto | 7 +
hadoop-hdds/rocksdb-checkpoint-differ/pom.xml | 20 -
.../hdds/scm/container/ContainerReportHandler.java | 6 +-
.../AbstractOverReplicationHandler.java | 34 +-
.../replication/ContainerHealthResult.java | 21 +-
.../replication/ContainerReplicaCount.java | 4 +-
.../replication/ECContainerReplicaCount.java | 15 +-
.../replication/ECMisReplicationHandler.java | 16 +-
.../replication/ECOverReplicationHandler.java | 132 +-
.../replication/ECUnderReplicationHandler.java | 60 +-
.../LegacyRatisContainerReplicaCount.java | 51 +
.../replication/LegacyReplicationManager.java | 831 +++--
.../replication/MisReplicationHandler.java | 36 +-
.../replication/OverReplicatedProcessor.java | 5 +-
.../replication/RatisContainerReplicaCount.java | 170 +-
.../replication/RatisMisReplicationHandler.java | 12 +-
.../replication/RatisOverReplicationHandler.java | 66 +-
.../replication/RatisUnderReplicationHandler.java | 58 +-
.../container/replication/ReplicationManager.java | 51 +-
.../replication/UnderReplicatedProcessor.java | 5 +-
.../replication/UnhealthyReplicationHandler.java | 5 +-
.../replication/UnhealthyReplicationProcessor.java | 13 +-
.../health/ClosedWithUnhealthyReplicasHandler.java | 2 +-
.../health/DeletingContainerHandler.java | 3 +-
.../replication/health/EmptyContainerHandler.java | 2 +-
...Handler.java => MismatchedReplicasHandler.java} | 44 +-
.../health/RatisReplicationCheckHandler.java | 82 +-
.../apache/hadoop/hdds/scm/ha/HASecurityUtils.java | 8 +-
.../hadoop/hdds/scm/ha/SCMSnapshotProvider.java | 8 +-
.../hdds/scm/node/DatanodeAdminMonitorImpl.java | 3 +-
.../hdds/scm/server/SCMBlockProtocolServer.java | 14 +-
.../hdds/scm/server/StorageContainerManager.java | 28 +-
.../container/replication/ReplicationTestUtil.java | 10 +
.../replication/TestECMisReplicationHandler.java | 3 +-
.../replication/TestECOverReplicationHandler.java | 130 +-
.../replication/TestECUnderReplicationHandler.java | 62 +-
.../replication/TestLegacyReplicationManager.java | 3586 +++++++++++---------
.../replication/TestMisReplicationHandler.java | 14 +-
.../replication/TestOverReplicatedProcessor.java | 9 +-
.../TestRatisContainerReplicaCount.java | 46 +
.../TestRatisMisReplicationHandler.java | 3 +-
.../TestRatisOverReplicationHandler.java | 76 +-
.../TestRatisUnderReplicationHandler.java | 14 +-
.../replication/TestReplicationManager.java | 69 +-
.../replication/TestUnderReplicatedProcessor.java | 17 +-
.../TestClosedWithUnhealthyReplicasHandler.java | 2 +-
.../health/TestDeletingContainerHandler.java | 2 +-
.../health/TestEmptyContainerHandler.java | 2 +-
...ler.java => TestMismatchedReplicasHandler.java} | 56 +-
.../health/TestRatisReplicationCheckHandler.java | 131 +
.../java/org/apache/ozone/test/SpyInputStream.java | 32 +-
.../org/apache/ozone/test/SpyOutputStream.java | 32 +-
.../apache/hadoop/ozone/client/OzoneBucket.java | 7 +-
.../client/checksum/ECFileChecksumHelper.java | 19 +-
.../hadoop/ozone/client/io/ECKeyOutputStream.java | 12 +-
.../hadoop/ozone/client/MockOmTransport.java | 22 +-
.../hadoop/ozone/client/TestOzoneECClient.java | 11 +-
.../main/java/org/apache/hadoop/ozone/OFSPath.java | 20 +-
.../org/apache/hadoop/ozone/om/OMConfigKeys.java | 7 +-
.../hadoop/ozone/om/helpers/OmBucketArgs.java | 4 +-
.../hadoop/ozone/om/helpers/OmBucketInfo.java | 18 +-
.../apache/hadoop/ozone/protocolPB/OMPBHelper.java | 54 -
.../ozone/security/OzoneTokenIdentifier.java | 3 +-
.../hadoop/ozone/om/helpers/TestOmBucketArgs.java | 2 +-
.../hadoop/ozone/om/helpers/TestOmBucketInfo.java | 11 +-
.../src/main/compose/ozonesecure/docker-config | 7 +
hadoop-ozone/dist/src/main/license/bin/LICENSE.txt | 3 -
hadoop-ozone/dist/src/main/license/jar-report.txt | 5 -
.../dist/src/main/smoketest/createbucketenv.robot | 2 +-
.../dist/src/main/smoketest/createmrenv.robot | 2 +-
.../main/smoketest/debug/ozone-debug-tests.robot | 2 +-
.../dist/src/main/smoketest/gdpr/gdpr.robot | 8 +-
.../dist/src/main/smoketest/ozonefs/setup.robot | 12 +-
.../dist/src/main/smoketest/recon/recon-api.robot | 8 +-
.../src/main/smoketest/s3/MultipartUpload.robot | 1 +
.../main/smoketest/security/ozone-secure-fs.robot | 51 +
.../smoketest/security/ozone-secure-tenant.robot | 7 +
hadoop-ozone/integration-test/pom.xml | 5 -
.../hadoop/fs/ozone/TestOzoneFSInputStream.java | 3 +-
.../hadoop/fs/ozone/TestOzoneFileChecksum.java | 2 +-
.../hadoop/fs/ozone/TestRootedOzoneFileSystem.java | 156 +-
.../hdds/scm/TestSCMDatanodeProtocolServer.java | 4 +-
.../hdds/scm/TestSCMDbCheckpointServlet.java | 2 +-
.../hdds/scm/storage/TestContainerCommandsEC.java | 8 +-
.../apache/hadoop/ozone/MiniOzoneClusterImpl.java | 2 -
.../hadoop/ozone/TestSecureOzoneCluster.java | 187 +-
.../ozone/TestStorageContainerManagerHelper.java | 2 +-
.../ozone/client/CertificateClientTestImpl.java | 104 +-
.../ozone/client/rpc/TestECKeyOutputStream.java | 5 +-
.../client/rpc/TestFailureHandlingByClient.java | 4 +-
.../rpc/TestOzoneClientMultipartUploadWithFSO.java | 2 +-
.../client/rpc/TestOzoneRpcClientAbstract.java | 74 +-
.../client/rpc/TestOzoneRpcClientWithRatis.java | 3 +-
.../ozone/client/rpc/TestSecureOzoneRpcClient.java | 9 +-
.../client/rpc/TestValidateBCSIDOnRestart.java | 2 +-
.../ozone/container/TestECContainerRecovery.java | 30 +-
.../commandhandler/TestBlockDeletion.java | 7 +-
.../ozoneimpl/TestOzoneContainerWithTLS.java | 9 +-
.../ozoneimpl/TestSecureOzoneContainer.java | 4 +-
.../server/TestSecureContainerServer.java | 6 +-
.../hadoop/ozone/fsck/TestContainerMapper.java | 8 +-
.../hadoop/ozone/om/TestOMDbCheckpointServlet.java | 58 +-
.../hadoop/ozone/om/TestOMRatisSnapshots.java | 24 +-
.../apache/hadoop/ozone/om/TestObjectStore.java | 4 +-
.../apache/hadoop/ozone/om/TestOzoneManagerHA.java | 6 +
.../hadoop/ozone/om/TestOzoneManagerRestart.java | 4 +
.../ozone/recon/TestReconWithOzoneManagerFSO.java | 14 +-
.../ozone/recon/TestReconWithOzoneManagerHA.java | 8 +-
.../hadoop/ozone/shell/TestOzoneShellHA.java | 58 +-
.../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 64 +-
.../java/org/apache/hadoop/ozone/om/OMStorage.java | 184 +-
.../apache/hadoop/ozone/om/OmMetadataReader.java | 2 +-
.../apache/hadoop/ozone/om/OzoneConfigUtil.java | 25 +-
.../hadoop/ozone/om/OzoneListStatusHelper.java | 49 +-
.../org/apache/hadoop/ozone/om/OzoneManager.java | 76 +-
.../hadoop/ozone/om/TrashOzoneFileSystem.java | 22 +-
.../apache/hadoop/ozone/om/TrashPolicyOzone.java | 6 +-
.../ozone/om/lock/OBSKeyPathLockStrategy.java | 14 +-
.../ozone/om/lock/RegularBucketLockStrategy.java | 20 +-
.../BucketLayoutAwareOMKeyRequestFactory.java | 2 +-
.../om/request/bucket/OMBucketCreateRequest.java | 123 +-
.../request/bucket/OMBucketSetPropertyRequest.java | 10 +-
.../ozone/om/request/file/OMFileRequest.java | 15 +-
.../om/request/key/OMKeyCommitRequestWithFSO.java | 2 +-
.../hadoop/ozone/om/request/key/OMKeyRequest.java | 34 -
.../om/request/volume/OMVolumeSetQuotaRequest.java | 16 +
.../S3InitiateMultipartUploadResponseWithFSO.java | 3 +-
.../om/snapshot/OzoneManagerSnapshotProvider.java | 2 +-
.../hadoop/ozone/security/OMCertificateClient.java | 6 +-
.../OzoneDelegationTokenSecretManager.java | 17 +-
.../org/apache/hadoop/ozone/om/TestOMStorage.java | 315 +-
.../hadoop/ozone/om/TestOzoneConfigUtil.java | 14 +-
.../ozone/om/request/bucket/TestBucketRequest.java | 4 +
.../request/bucket/TestOMBucketCreateRequest.java | 26 +-
.../bucket/TestOMBucketCreateRequestWithFSO.java | 4 +-
.../bucket/TestOMBucketSetPropertyRequest.java | 53 +-
.../om/request/file/TestOMFileCreateRequest.java | 23 -
.../om/request/key/TestOMAllocateBlockRequest.java | 24 -
.../om/request/key/TestOMKeyCommitRequest.java | 71 +-
.../request/key/TestOMKeyCommitRequestWithFSO.java | 11 +-
.../om/request/key/TestOMKeyCreateRequest.java | 23 -
.../volume/TestOMVolumeSetQuotaRequest.java | 23 +
.../fs/ozone/BasicOzoneClientAdapterImpl.java | 2 +-
.../ozone/BasicRootedOzoneClientAdapterImpl.java | 44 +-
.../fs/ozone/BasicRootedOzoneFileSystem.java | 35 +-
.../org/apache/hadoop/fs/ozone/TestOFSPath.java | 26 +-
hadoop-ozone/ozonefs-hadoop2/pom.xml | 20 +
hadoop-ozone/pom.xml | 6 +-
.../org/apache/hadoop/ozone/recon/ReconUtils.java | 24 +-
.../hadoop/ozone/recon/api/NSSummaryEndpoint.java | 6 +-
.../recon/api/handlers/BucketEntityHandler.java | 36 +-
.../ozone/recon/api/handlers/BucketHandler.java | 4 +
.../recon/api/handlers/DirectoryEntityHandler.java | 26 +-
.../ozone/recon/api/handlers/FSOBucketHandler.java | 20 +
.../ozone/recon/api/handlers/KeyEntityHandler.java | 23 +-
.../recon/api/handlers/LegacyBucketHandler.java | 14 +
.../recon/api/handlers/RootEntityHandler.java | 30 +-
.../recon/api/handlers/UnknownEntityHandler.java | 8 +-
.../recon/api/handlers/VolumeEntityHandler.java | 32 +-
.../ozone/recon/api/types/BucketObjectDBInfo.java | 168 +
...mespaceSummaryResponse.java => CountStats.java} | 70 +-
.../ozone/recon/api/types/KeyObjectDBInfo.java | 154 +
.../recon/api/types/NamespaceSummaryResponse.java | 138 +-
.../hadoop/ozone/recon/api/types/ObjectDBInfo.java | 140 +
.../ozone/recon/api/types/VolumeObjectDBInfo.java | 78 +
.../spi/impl/OzoneManagerServiceProviderImpl.java | 2 +-
.../impl/StorageContainerServiceProviderImpl.java | 2 +-
.../ozone/recon/tasks/OMDBUpdatesHandler.java | 15 +-
.../webapps/recon/ozone-recon-web/api/db.json | 135 +-
.../src/views/diskUsage/diskUsage.tsx | 131 +-
.../recon/api/TestNSSummaryEndpointWithFSO.java | 61 +-
.../recon/api/TestNSSummaryEndpointWithLegacy.java | 62 +-
.../hadoop/ozone/recon/common/CommonUtils.java | 225 ++
.../ozone/recon/tasks/TestOMDBUpdatesHandler.java | 12 +-
hadoop-ozone/tools/pom.xml | 5 +-
.../ozone/admin/nssummary/NSSummaryAdmin.java | 9 +-
.../ozone/debug/container/ExportSubcommand.java | 2 +-
.../ozone/freon/ClosedContainerReplicator.java | 20 +-
pom.xml | 139 +-
295 files changed, 9206 insertions(+), 4789 deletions(-)
delete mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/ec/reconstruction/ECReconstructionSupervisor.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/replication/AbstractReplicationTask.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/replication/ContainerImporter.java
copy
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/replication/{ContainerReplicator.java
=> ContainerUploader.java} (68%)
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/replication/CopyContainerResponseStream.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/replication/GrpcContainerUploader.java
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/replication/PushReplicator.java
copy
hadoop-hdds/{framework/src/main/java/org/apache/hadoop/hdds/security/token/CompositeTokenVerifier.java
=>
container-service/src/main/java/org/apache/hadoop/ozone/container/replication/SendContainerOutputStream.java}
(52%)
create mode 100644
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/replication/SendContainerRequestHandler.java
delete mode 100644
hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/ec/reconstruction/TestECReconstructionSupervisor.java
rename
hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/replication/{TestGrpcOutputStream.java
=> GrpcOutputStreamTest.java} (88%)
create mode 100644
hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/replication/TestCopyContainerResponseStream.java
create mode 100644
hadoop-hdds/container-service/src/test/java/org/apache/hadoop/ozone/container/replication/TestPushReplicator.java
copy
hadoop-hdds/{framework/src/main/java/org/apache/hadoop/hdds/security/token/CompositeTokenVerifier.java
=>
container-service/src/test/java/org/apache/hadoop/ozone/container/replication/TestSendContainerOutputStream.java}
(50%)
rename
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/certificate/authority/{PKIProfiles
=> profile}/DefaultCAProfile.java (99%)
rename
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/certificate/authority/{PKIProfiles
=> profile}/DefaultProfile.java (99%)
rename
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/certificate/authority/{PKIProfiles
=> profile}/PKIProfile.java (99%)
rename
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/certificate/authority/{PKIProfiles
=> profile}/package-info.java (98%)
rename
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/{certificates/utils/package-info.java
=> certificate/client/CertificateNotification.java} (59%)
rename
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/{certificates
=> certificate}/utils/CertificateSignRequest.java (98%)
rename
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/{certificates
=> certificate}/utils/SelfSignedCertificate.java (98%)
rename
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/{exceptions
=> exception}/CertificateException.java (97%)
rename
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/{exceptions
=> exception}/package-info.java (93%)
rename
hadoop-hdds/framework/src/test/java/org/apache/hadoop/hdds/security/x509/{certificates
=> certificate/utils}/TestCertificateSignRequest.java (98%)
rename
hadoop-hdds/framework/src/test/java/org/apache/hadoop/hdds/security/x509/{certificates
=> certificate/utils}/TestRootCertificate.java (96%)
delete mode 100644
hadoop-hdds/framework/src/test/java/org/apache/hadoop/hdds/security/x509/certificates/package-info.java
create mode 100644
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/LegacyRatisContainerReplicaCount.java
rename
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/health/{ClosedWithMismatchedReplicasHandler.java
=> MismatchedReplicasHandler.java} (64%)
rename
hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/health/{TestClosedWithMismatchedReplicasHandler.java
=> TestMismatchedReplicasHandler.java} (79%)
copy
hadoop-ozone/common/src/test/java/org/apache/hadoop/ozone/om/helpers/TestOmKeyArgs.java
=>
hadoop-hdds/test-utils/src/main/java/org/apache/ozone/test/SpyInputStream.java
(60%)
copy
hadoop-ozone/common/src/test/java/org/apache/hadoop/ozone/om/helpers/TestOmKeyArgs.java
=>
hadoop-hdds/test-utils/src/main/java/org/apache/ozone/test/SpyOutputStream.java
(59%)
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/api/types/BucketObjectDBInfo.java
copy
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/api/types/{NamespaceSummaryResponse.java
=> CountStats.java} (59%)
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/api/types/KeyObjectDBInfo.java
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/api/types/ObjectDBInfo.java
create mode 100644
hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/api/types/VolumeObjectDBInfo.java
create mode 100644
hadoop-ozone/recon/src/test/java/org/apache/hadoop/ozone/recon/common/CommonUtils.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
