[
https://issues.apache.org/jira/browse/HDDS-15563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Donal Magennis updated HDDS-15563:
----------------------------------
Description:
The initial implementation had no pruning strategy so the ledger grows
unbounded. We should implement some retention strategy which is pragmatic but
not too complex.
Suggested Strategy:
- Soft Limit (Default 100,000): Prunes records safely behind the active
consumer's checkpoint.
-Hard Limit (Default 1,000,000): Protects the OM disk by unconditionally
purging records older than 1,000,000 behind the latest transaction in OM, even
if the consumer is offline.
was:The initial implementation had no pruning strategy so the ledger grows
unbounded. We should implement some retention strategy which is pragmatic but
not too complex. Suggested Strategy: - Soft Limit (Default 100,000): Prunes
records safely behind the active consumer's checkpoint. - Hard Limit (Default
1,000,000): Protects the OM disk by unconditionally purging records older than
1,000,000 behind the latest transaction in OM, even if the consumer is offline.
> Implement a retention / purging strategy for OMCompletedRequestInfo ledger
> records
> ----------------------------------------------------------------------------------
>
> Key: HDDS-15563
> URL: https://issues.apache.org/jira/browse/HDDS-15563
> Project: Apache Ozone
> Issue Type: New Feature
> Reporter: Donal Magennis
> Priority: Major
> Labels: EventNotification
>
> The initial implementation had no pruning strategy so the ledger grows
> unbounded. We should implement some retention strategy which is pragmatic but
> not too complex.
> Suggested Strategy:
> - Soft Limit (Default 100,000): Prunes records safely behind the active
> consumer's checkpoint.
> -Hard Limit (Default 1,000,000): Protects the OM disk by unconditionally
> purging records older than 1,000,000 behind the latest transaction in OM,
> even if the consumer is offline.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
