[
https://issues.apache.org/jira/browse/HBASE-17179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701985#comment-15701985
]
Anoop Sam John commented on HBASE-17179:
----------------------------------------
Many threads working on same region and so on MSLAB might call getChunk
concurrently. All might result in creating chunk object and so increment the
counter. The init() call on Chunk actually allocate the byte[] 2 MB. So only
one thread will succeed in that. So said there is chance of this counter
getting corrupted. But what u say is 10 G memstore pool initial size itself
and all memstores sized never crosses 3 GB (correct?), then there should not be
ideally no case of new chunks creation need..
220 regions means 220 * 128 MB , 10 GB of max global memstore can easily get
reached no?
> the chunkpool are not reclamed correctly
> ----------------------------------------
>
> Key: HBASE-17179
> URL: https://issues.apache.org/jira/browse/HBASE-17179
> Project: HBase
> Issue Type: Bug
> Affects Versions: 1.0.1.1, 1.1.2
> Reporter: chenxu
>
> in our cluster, the RS's config is as below
> {quote}
> heap size(25G)
> hbase.regionserver.global.memstore.size(0.5)
> hbase.hregion.memstore.chunkpool.maxsize(0.8)
> hbase.hregion.memstore.chunkpool.initialsize(1.0)
> {quote}
> so the chunkpool's size is 25*0.5*0.8 = 10GB
> in our monitor system, the _memStoreSize_ never up to 3G，so the _reuseRatio_
> of the chunkpool should always 100%, but it's not, see the logs below:
> {quote}
> 2016-11-23 11:47:34,302 DEBUG
> [StoreOpener-33a77b971aff15e5e6be3cc614870e43-1-MemStoreChunkPool Statistics]
> regionserver.MemStoreChunkPool: Stats: current pool size=5009,created chunk
> count=0,reused chunk count=81,reuseRatio=100.00%
> 2016-11-28 11:47:34,302 DEBUG
> [StoreOpener-33a77b971aff15e5e6be3cc614870e43-1-MemStoreChunkPool Statistics]
> regionserver.MemStoreChunkPool: Stats: current pool size=3,created chunk
> count=1325,reused chunk count=67209,reuseRatio=98.07%
> {quote}
> 5 days later, the _reuseRatio_ is below 100%
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
