ChenSammi opened a new pull request, #8845: URL: https://github.com/apache/ozone/pull/8845
## What changes were proposed in this pull request? ### Highlights * **Enhanced Deleted Block Transactions**: The `DeletedBlocksTransaction` protobuf message now includes `totalBlockSize` and `totalBlockReplicatedSize` fields. This ensures that block size information is persisted with each deletion transaction, enabling SCM to track the actual space occupied by blocks awaiting deletion. * **SCM-side Block Size Aggregation**: The `DeletedBlockLogStateManager` is enhanced to aggregate these block sizes in-memory, providing a `DeletedBlocksTransactionSummary` that includes total transaction count, total block count, total block size, and total replicated block size for pending deletions. This summary is rebuilt from persisted transaction data upon SCM startup or leader election. * **New API for Deletion Summary**: A new `getDeletedBlockSummary()` method has been added to the `ScmClient` and `StorageContainerLocationProtocol` interfaces, along with its server-side implementation. This allows clients to programmatically retrieve the aggregated deletion statistics from SCM. * **Improved Metrics for Deletion Service**: New metrics are introduced in `ScmBlockDeletingServiceMetrics` to expose the aggregated deletion statistics (transaction count, block count, total size, total replicated size). This provides better operational visibility into the SCM's block deletion queue. * **Upgrade Path for Data Distribution Feature**: A new SCM upgrade action (`ScmOnFinalizeActionForDataDistribution`) is introduced. This action is part of the finalization process for the `DATA_DISTRIBUTION` layout feature, which enables the new block size tracking capabilities. * **CLI Tooling for Deletion Summary**: A new `scm deletedblocks txn summary` command has been added to the `ozone admin` CLI tool, providing a convenient way for users to view the aggregated deleted block transaction summary directly. ## What is the link to the Apache JIRA https://issues.apache.org/jira/browse/HDDS-13184 ## How was this patch tested? New unit tests added. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
