[
https://issues.apache.org/jira/browse/SLING-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothee Maret reassigned SLING-8965:
-------------------------------------
Assignee: Christian Schneider
> Avoid committing for each skipped package
> ------------------------------------------
>
> Key: SLING-8965
> URL: https://issues.apache.org/jira/browse/SLING-8965
> Project: Sling
> Issue Type: Bug
> Components: Content Distribution
> Reporter: Timothee Maret
> Assignee: Christian Schneider
> Priority: Major
>
> With the SLING-8908 change, we ensure that all package messages (even skipped
> ones) are marked as processed. By design, we mark processed package by
> committing to the local repository. Committing to the repository is not cheap
> and we should minimise it. For setups that generate a lot of skipped packages
> such as A) multiple farms support with multiple consumer agents or B)
> multi-region deployments with varying latencies, the amount of commits will
> increase even more.
> To reduce the commits, we should either redo SLING-8908 such that skipped
> offsets are kept in memory or simply only commit skipped packages as
> aggregates (e.g. 1 commits for 10 skipped packages).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
