[
https://issues.apache.org/jira/browse/HBASE-28840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wellington Chevreuil resolved HBASE-28840.
------------------------------------------
Resolution: Fixed
Thanks for the contribution, [~janardhan.hungund]!
> Optimise memory utilisation retrieval of bucket-cache from persistence.
> -----------------------------------------------------------------------
>
> Key: HBASE-28840
> URL: https://issues.apache.org/jira/browse/HBASE-28840
> Project: HBase
> Issue Type: Bug
> Components: BucketCache
> Affects Versions: 3.0.0-beta-1, 4.0.0-alpha-1, 2.7.0
> Reporter: Janardhan Hungund
> Assignee: Janardhan Hungund
> Priority: Major
> Labels: pull-request-available
> Fix For: 2.7.0, 3.0.0-beta-2
>
>
> During the persistence of bucket-cache backing map to a file, the backing map
> is divided into multiple smaller chunks and persisted to the file. This
> chunking avoids the high memory utilisation of during persistence, since only
> a small subset of backing map entries need to persisted in one chunk.
> However, during the retrieval of the backing map during the server startup,
> we accumulate all these chunks into a list and then process each chunk to
> recreate the in-memory backing map. Since, all the chunks are fetched from
> the persistence file and then processed, the memory requirement is higher.
> The retrieval of bucket-cache from persistence file can be optimised to
> enable the processing of one chunk at a time to avoid high memory utilisation.
> Thanks,
> JanardhanÂ
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
