[
https://issues.apache.org/jira/browse/IGNITE-22758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roman Puchkovskiy updated IGNITE-22758:
---------------------------------------
Description:
Raft groups for volatile partitions store Raft logs in memory. Currently, it's
stored on heap. They are kept until log gets truncated, which does not seem to
happen too often. We need to do something to reclaim the memory.
# We could restrict in-memory budget and make logs spill on disk when the
budget is exceeded. To do this, we could switch from the default 'unlimited
budget, no spilling' to a different strategy. Maybe, a strategy looking at an
overall size of entries kept in memory could be used (needs to be implemented).
# We could refuse accepting writes if 'too much memory' is used
# We could truncate logs more often (especially, given that even an idle
partition actually constantly receives safe time sync commands)
> In-memory Raft stores logs on heap for too long
> -----------------------------------------------
>
> Key: IGNITE-22758
> URL: https://issues.apache.org/jira/browse/IGNITE-22758
> Project: Ignite
> Issue Type: Improvement
> Reporter: Roman Puchkovskiy
> Priority: Major
> Labels: ignite-3
>
> Raft groups for volatile partitions store Raft logs in memory. Currently,
> it's stored on heap. They are kept until log gets truncated, which does not
> seem to happen too often. We need to do something to reclaim the memory.
> # We could restrict in-memory budget and make logs spill on disk when the
> budget is exceeded. To do this, we could switch from the default 'unlimited
> budget, no spilling' to a different strategy. Maybe, a strategy looking at an
> overall size of entries kept in memory could be used (needs to be
> implemented).
> # We could refuse accepting writes if 'too much memory' is used
> # We could truncate logs more often (especially, given that even an idle
> partition actually constantly receives safe time sync commands)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
