[ 
https://issues.apache.org/jira/browse/HBASE-23680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013349#comment-17013349
 ] 

Duo Zhang commented on HBASE-23680:
-----------------------------------

OK, things here are a bit different. All the files are stored on the WAL 
filesystem for procedures, for speed, and usually it will not cost too much as 
the procedures will be deleted soon. So this introduce a problem, that, the 
HFile archive directory is on the HFile filesystem, by design, it could be 
different from the WAL fileysystem.

So for now, I prefer we just delete the HFile archives directly, as we can 
rebuild the procedure data once we have enough WAL files. Introducing a 
separated cleaner chore looks overkill, and introduces more configs, which is 
not convenience to users.

Shout if you have other good choices.

Thanks.

> RegionProcedureStore missing cleaning of hfile archive
> ------------------------------------------------------
>
>                 Key: HBASE-23680
>                 URL: https://issues.apache.org/jira/browse/HBASE-23680
>             Project: HBase
>          Issue Type: Sub-task
>    Affects Versions: 2.3.0
>            Reporter: Michael Stack
>            Assignee: Duo Zhang
>            Priority: Major
>             Fix For: 2.3.0
>
>
> See tail of parent issue. The new RegionProcedureStore accumulates deleted 
> hfiles in its local archive dir. Needs a cleaner like the one that watches 
> over /hbase/archive.
> Is there a problem clearning the new $masterproc$ files from the oldWALs too? 
> These seem to stick around also.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to