[
https://issues.apache.org/jira/browse/HBASE-20401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tak Lon (Stephen) Wu updated HBASE-20401:
-----------------------------------------
Release Note:
Add thread-level timeout and check interval configurations in LogCleaner and
HFileCleaner, such that one can tune the file cleaners to match their
environment.
1. hbase.oldwals.cleaner.thread.timeout.msec
2. hbase.oldwals.cleaner.thread.check.interval.msec
3. hbase.regionserver.hfilecleaner.thread.timeout.msec
4. hbase.regionserver.hfilecleaner.thread.check.interval.msec
For example in the LogCleaner scenario, one might consider tuning
hbase.oldwals.cleaner.thread.timeout.msec and
hbase.oldwals.cleaner.thread.check.interval.msec
1. fs.delete never complete (strange but possible), then we need to wait for a
max of 60 seconds. here, 60 seconds might be too long. or the opposite way is
to increase more than 60 seconds in the use cases of slow oldwals delete.
2. getResult is waiting in the period of 500 milliseconds, but the fs.delete
has completed and setFromCleaner is set but yet notify(). one might want to
tune this 500 milliseconds to 200 or less .
was:
Add thread-level timeout and check interval configurations in LogCleaner and
HFileCleaner, such that one can tune the file cleaners to match their
environment.
1. hbase.oldwals.cleaner.thread.timeout.msec
2. hbase.oldwals.cleaner.thread.check.interval.msec
3. hbase.regionserver.hfilecleaner.thread.timeout.msec
4. hbase.regionserver.hfilecleaner.thread.check.interval.msec
For example in the LogCleaner scenario, one might consider tuning
hbase.oldwals.cleaner.thread.timeout.msec and
hbase.oldwals.cleaner.thread.check.interval.msec
1. fs.delete never complete (strange but possible), then we need to wait for a
max of 60 seconds. here, 60 seconds might be too long. or the opposite way is
to increase more than 60 seconds in the use cases of slow oldwals delete.
2. getResult is waiting in the period of 500 milliseconds, but the fs.delete
has completed and setFromClear is set but yet notify(). one might want to tune
this 500 milliseconds to 200 or less .
> Make `MAX_WAIT` and `waitIfNotFinished` in CleanerContext configurable
> ----------------------------------------------------------------------
>
> Key: HBASE-20401
> URL: https://issues.apache.org/jira/browse/HBASE-20401
> Project: HBase
> Issue Type: Improvement
> Components: master
> Affects Versions: 3.0.0, 1.5.0, 2.0.0-beta-1, 1.4.4, 2.0.0
> Reporter: Tak Lon (Stephen) Wu
> Assignee: Tak Lon (Stephen) Wu
> Priority: Minor
> Labels: beginner
> Attachments: HBASE-20401.branch-1.001.patch,
> HBASE-20401.master.001.patch, HBASE-20401.master.002.patch,
> HBASE-20401.master.003.patch, HBASE-20401.master.004.patch,
> HBASE-20401.master.005.patch
>
>
> When backporting HBASE-18309 in HBASE-20352, the deleteFiles calls
> CleanerContext.java#getResult with a waitIfNotFinished timeout to wait for
> notification (notify) from the fs.delete file thread. there might be two
> situation need to tune the MAX_WAIT in CleanerContext or waitIfNotFinished
> when LogClearner call getResult.
> # fs.delete never complete (strange but possible), then we need to wait for
> a max of 60 seconds. here, 60 seconds might be too long
> # getResult is waiting in the period of 500 milliseconds, but the fs.delete
> has completed and setFromClear is set but yet notify(). one might want to
> tune this 500 milliseconds to 200 or less .
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
