[
https://issues.apache.org/jira/browse/HBASE-27686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wellington Chevreuil updated HBASE-27686:
-----------------------------------------
Release Note: This adds a background thread into the RS process, that
periodically checks if there were updates in the bucket cache. If the bucket
cache has been updated since the last check, it saves the bucket cache index to
the file path defined by "hbase.bucketcache.persistent.path", as well as the
list of completed prefetched files into the path defined by
"hbase.prefetch.file.list.path" property. The thread is named as
"bucket-cache-persister", and the check interval is defined by the
"hbase.bucketcache.persist.intervalinmillis" property, and it defaults to 1000
(1 second). This thread is only enabled if "hbase.bucketcache.persistent.path"
is set in the configuration. (was: This adds a background thread into RS
process, that periodically checks if there were updates in the bucket cache. If
the bucket cache has been updated since the last check, it saves the bucket
cache index to the file path defined by "hbase.bucketcache.persistent.path", as
well as the list of completed prefetched files into the path defined by
"hbase.prefetch.file.list.path" property. The thread is named as
"bucket-cache-persister", and the check interval is defined by the
"hbase.bucketcache.persist.intervalinmillis" property, and it defaults to 1000
(1 second). This thread is only enabled if "hbase.bucketcache.persistent.path"
is set in the configuration.)
> Recovery of BucketCache and Prefetched data after RS Crash
> ----------------------------------------------------------
>
> Key: HBASE-27686
> URL: https://issues.apache.org/jira/browse/HBASE-27686
> Project: HBase
> Issue Type: Improvement
> Components: BucketCache
> Reporter: Shanmukha Haripriya Kota
> Assignee: Shanmukha Haripriya Kota
> Priority: Major
>
> HBASE-27313 introduced the ability to persist a list of hfiles for which
> prefetch has already been completed, so the we can avoid prefetching those
> files again in the event of a graceful restart, but it doesn't cover crash
> scenarios, as if the RS is killed or abnormally stopped, the list wouldn't be
> saved.
> This change aims to persist the list of already prefetched from a background
> thread that periodically checks cache state and persists the list if updates
> have happened.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
