[jira] [Created] (HBASE-28840) Optimise memory utilisation retrieval of bucket-cache from persistence.

[Janardhan Hungund (Jira)]

Janardhan Hungund created HBASE-28840:
-----------------------------------------

             Summary: Optimise memory utilisation retrieval of bucket-cache 
from persistence.
                 Key: HBASE-28840
                 URL: https://issues.apache.org/jira/browse/HBASE-28840
             Project: HBase
          Issue Type: Bug
          Components: BucketCache
            Reporter: Janardhan Hungund
            Assignee: Janardhan Hungund


During the persistence of bucket-cache backing map to a file, the backing map 
is divided into multiple smaller chunks and persisted to the file. This 
chunking avoids the high memory utilisation of during persistence, since only a 
small subset of backing map entries need to persisted in one chunk.

However, during the retrieval of the backing map during the server startup, we 
accumulate all these chunks into a list and then process each chunk to recreate 
the in-memory backing map. Since, all the chunks are fetched from the 
persistence file and then processed, the memory requirement is higher.

The retrieval of bucket-cache from persistence file can be optimised to enable 
the processing of one chunk at a time to avoid high memory utilisation.

Thanks,

Janardhan 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)