[ 
https://issues.apache.org/jira/browse/HBASE-8060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sergey Shelukhin updated HBASE-8060:
------------------------------------

    Attachment: HBASE-8060-v0.patch

This patch does two things.
First, it adds more correct entry count getters for HalfStoreFileReader. 
HalfStoreFileReader inherits the parent methods that give total for the file, 
resulting in inaccurate total estimate after split. If estimate is split in 
half, it will be less inaccurate.

Then, given that all these totals are speculative even in normal case, and 
moreso after split, I am adding the artificial reconciliation of compaction 
progress after compaction is finished to show the final total and current 
values.
                
> "Num compacting KVs" diverges from "num compacted KVs" over time
> ----------------------------------------------------------------
>
>                 Key: HBASE-8060
>                 URL: https://issues.apache.org/jira/browse/HBASE-8060
>             Project: HBase
>          Issue Type: Bug
>          Components: Compaction, UI
>    Affects Versions: 0.94.6, 0.95.0, 0.95.2
>            Reporter: Andrew Purtell
>            Assignee: Sergey Shelukhin
>         Attachments: HBASE-8060-v0.patch, screenshot.png
>
>
> I have been running what amounts to an ingestion test for a day or so. This 
> is an all-in-one cluster launched with './bin/hbase master start' from 
> sources. In the RS stats on the master UI, the "num compacting KVs" has 
> diverged from "num compacted KVs" even though compaction has been completed 
> from perspective of selection, no compaction tasks are running on the RS. I 
> think this could be confusing -- is compaction happening or not?
> Or maybe I'm misunderstanding what this is supposed to show?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to