hbase set memstore size to 0

Hello, In our hbase cluster memstore flush size is 128 mb. And to insert data to tables, we only use bulk load tool. Since bulk loading bypasses memstores, they are never used, so we want to minimize memstore flush size. But memstore flush size is used in many important calculations in hbase such

hbase memstore size

Hello, In our hbase cluster memstore flush size is 128 mb. And to insert data to tables, we only use bulk load tool. Since bulk loading bypasses memstores, they are never used, so we want to minimize memstore flush size. But memstore flush size is used in many important calculations in hbase such

Re: hbase set memstore size to 0

Hi Ozhang, If you are only bulk loading into HBase, then memstore flush size should not matter. You most likely you looking to lower the upper/global memstore limits. On Aug 3, 2014 2:23 PM, ozhang ozhangu...@gmail.com wrote: Hello, In our hbase cluster memstore flush size is 128 mb. And to

Re: hbase set memstore size to 0

Hi Kevin, We guess that, on region server start up, hbase gets some memory for each memstore. So we want to decrease this value. You are saying that memstore size doesnt matter. If memstore flush size 128 mb, does java take some memory for each memstore on region startup. Or it only takes memory

Re: hbase set memstore size to 0

Upon insert, lower the global setting not the flush size :) On Aug 3, 2014 3:01 PM, ozhang ozhangu...@gmail.com wrote: Hi Kevin, We guess that, on region server start up, hbase gets some memory for each memstore. So we want to decrease this value. You are saying that memstore size doesnt

Re: hbase set memstore size to 0

Just to add to Kevin's comments. Are you looking at that because of the split policy? If that's the case, can you not just change the policy? Like configure your table to use the ConstantSizeRegionSplitPolicy? 2014-08-03 15:15 GMT-04:00 Kevin O'dell kevin.od...@cloudera.com: Upon insert, lower

Re: hbase set memstore size to 0

I check that and see that memstore global upper limit is 0.4. As you suggested setting it to a lower value will to what i want. Also ConstantSizeRegionSplitPolicy is a nice suggestion. Thanks you so much. Best regards. Ozhan 3 Ağu 2014 22:49 tarihinde Jean-Marc Spaggiari [via Apache HBase]