ChenSammi opened a new pull request, #8845:
URL: https://github.com/apache/ozone/pull/8845

   ## What changes were proposed in this pull request?
   
   
   ### Highlights
   
   * **Enhanced Deleted Block Transactions**: The `DeletedBlocksTransaction` 
protobuf message now includes `totalBlockSize` and `totalBlockReplicatedSize` 
fields. This ensures that block size information is persisted with each 
deletion transaction, enabling SCM to track the actual space occupied by blocks 
awaiting deletion.
   * **SCM-side Block Size Aggregation**: The `DeletedBlockLogStateManager` is 
enhanced to aggregate these block sizes in-memory, providing a 
`DeletedBlocksTransactionSummary` that includes total transaction count, total 
block count, total block size, and total replicated block size for pending 
deletions. This summary is rebuilt from persisted transaction data upon SCM 
startup or leader election.
   * **New API for Deletion Summary**: A new `getDeletedBlockSummary()` method 
has been added to the `ScmClient` and `StorageContainerLocationProtocol` 
interfaces, along with its server-side implementation. This allows clients to 
programmatically retrieve the aggregated deletion statistics from SCM.
   * **Improved Metrics for Deletion Service**: New metrics are introduced in 
`ScmBlockDeletingServiceMetrics` to expose the aggregated deletion statistics 
(transaction count, block count, total size, total replicated size). This 
provides better operational visibility into the SCM's block deletion queue.
   * **Upgrade Path for Data Distribution Feature**: A new SCM upgrade action 
(`ScmOnFinalizeActionForDataDistribution`) is introduced. This action is part 
of the finalization process for the `DATA_DISTRIBUTION` layout feature, which 
enables the new block size tracking capabilities.
   * **CLI Tooling for Deletion Summary**: A new `scm deletedblocks txn 
summary` command has been added to the `ozone admin` CLI tool, providing a 
convenient way for users to view the aggregated deleted block transaction 
summary directly.
   
   
   
   
   ## What is the link to the Apache JIRA
   
   https://issues.apache.org/jira/browse/HDDS-13184
   
   ## How was this patch tested?
   
   New unit tests added. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to