Janardhan Hungund created HBASE-28772:
-----------------------------------------

             Summary: Implement asynchronous bucket-cache recovery from 
persistence.
                 Key: HBASE-28772
                 URL: https://issues.apache.org/jira/browse/HBASE-28772
             Project: HBase
          Issue Type: Task
          Components: BucketCache
            Reporter: Janardhan Hungund
            Assignee: Janardhan Hungund


During the recovery of bucket cache from persistence, we need to rebuild a 
transient in-memory structure (blockByHfile) which has the blocks sorted 
according to their filenames.

This transient structure population is done during the server start-up during 
the recreation of bucket cache from persistence. This process can be 
time-consuming if bucket-cache has large number of blocks. (in millions). This 
population is executed inline with the server restart and this blocks the 
server from being available for several minutes. This makes the server restart 
inconvenient for the external users.

The need is to make the cache retrieval asynchronous to server restart by 
spawning a new thread that rebuilds cache from the persistence, while the 
server continues with its restart. This prevents an unnecessary delay in the 
server restart.

Note that the bucket cache may not available immediately for usage and will 
only be ready to use after the data is repopulated from persistence into memory.

Thanks,
Janardhan



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to