[
https://issues.apache.org/jira/browse/HDDS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saketa Chalamchala updated HDDS-15313:
--------------------------------------
Description:
Most snapshot diffs at large scale clients are observed to run into the
`ozone.om.snapshot.diff.max.allowed.keys.changed.per.job=10M` limit very soon.
As this limit only verifies the estimated number of keys to iterate and not the
actual diff need to increase it and issue a warning to the client to either
continue or cancel instead of rejecting the snapshot diff.
Another threshold, we need to increase is the
`ozone.om.snapshot.diff.max.page.size=1000(default)`. Both the default page
size and max page size are set to 0. It makes sense to have the max limit be
higher than the default so that the default page size can be increased
gradually without having to increase max page size too often.
was:
Most snapshot diffs at large scale clients are observed to run into the
`ozone.om.snapshot.diff.max.allowed.keys.changed.per.job=10M` limit very soon.
As this limit only verifies the estimated number of keys to iterate and not the
actual diff need to increase it and issue a warning to the client to either
continue or cancel instead of rejecting the snapshot diff.
> Increase snapshot diff defaults
> -------------------------------
>
> Key: HDDS-15313
> URL: https://issues.apache.org/jira/browse/HDDS-15313
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Saketa Chalamchala
> Assignee: Saketa Chalamchala
> Priority: Major
>
> Most snapshot diffs at large scale clients are observed to run into the
> `ozone.om.snapshot.diff.max.allowed.keys.changed.per.job=10M` limit very
> soon.
> As this limit only verifies the estimated number of keys to iterate and not
> the actual diff need to increase it and issue a warning to the client to
> either continue or cancel instead of rejecting the snapshot diff.
> Another threshold, we need to increase is the
> `ozone.om.snapshot.diff.max.page.size=1000(default)`. Both the default page
> size and max page size are set to 0. It makes sense to have the max limit be
> higher than the default so that the default page size can be increased
> gradually without having to increase max page size too often.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
