Hi St.Ack,
We are working with HBase 0.96.1.1-cdh5.0.1 using 10 region servers. We
configured the bucket cache and set the -XX:MaxDirectMemorySize to 32g,
heap size of 12g, and hbase.regionserver.count=40. The bucket cache
configuration is the following (added in hbase-site.xml):
<property>
<name>hbase.regionserver.handler.count</name>
<value>40</value>
</property>
<property>
<name>hbase.bucketcache.ioengine</name>
<value>offheap</value>
</property>
<property>
<name>hbase.bucketcache.percentage.in.combinedcache</name>
<value>0.8</value>
</property>
<property>
<name>hbase.bucketcache.size</name>
<value>40000</value>
</property>
After restarting HBase, we checked out the HBase process from console we
are able to set the -XX:MaxDirectMemorySize=32, as well as the memory
heap size we configured. However, when we go to the
http://<hostname>:60010/conf, the*hbase.regionserver.count* is still set
up to 30 (presumably the default value) and the bucketcache parameters
added (bucketcache.ioengine, bucketcache.percentage.in.combinedcache,
bucketcache.size) are not showed up, so we are not sure if the
parameters are taken into account or not.
Is there a way to validate that the bucketcache parameters as well as
the new value for the hbase.regionserver.count are really taken from the
hbase-site.xml we changed?
Thanks,
Gaby
On 28/07/2014 02:23 p.m., Stack wrote:
And don't forget to set -XX:MaxDirectMemorySize (from 9.6.4.5.1. Enable
SlabCache in the refguide -- http://hbase.apache.org/book.html). This you
set where you pass your server JVM args.
St.Ack
On Mon, Jul 28, 2014 at 12:21 PM, Stack <[email protected]> wrote:
Probably a question for the cloudera hbase list? (Did you enter the block
cache configs via CM safety valve mechanism?)
Yours,
St.Ack
On Mon, Jul 28, 2014 at 11:54 AM, Gabriela Montiel <
[email protected]> wrote:
Hi Shengzhe,
We executed a rolling restart on HBase through Cloudera 5, but after
completing the site retrieved the same configurations.
Thanks,
Gaby
Sent from my Samsung Mobile
-------- Original message --------
From: yao <[email protected]>
Date:28/07/2014 13:43 (GMT-06:00)
To: [email protected]
Subject: Re: How to validate HBase configuration (for region servers)
from HBase admin page?
Hi Gaby,
Did you restart your regionservers ? If not, HBase won't pick up the
up-to-date configuration.
Best
Shengzhe
On Mon, Jul 28, 2014 at 11:38 AM, Ted Yu <[email protected]> wrote:
bq. <source>hbase-site.xml</source>
Can you check the hbase-site.xml which is in classpath of the region
server
?
What release of hbase are you using ?
Cheers
On Mon, Jul 28, 2014 at 11:28 AM, gabriela montiel <
[email protected]> wrote:
Hi all,
We have set up an HBase cluster with 10 region nodes. We modified the
default configurations to handle bucket cache in the hbase-site.xml
(for
all region servers) as follows:
<property>
<name>hbase.regionserver.handler.count</name>
<value>40</value>
</property>
<property>
<name>hbase.bucketcache.ioengine</name>
<value>offheap</value>
</property>
<property>
<name>hbase.bucketcache.percentage.in.combinedcache</name>
<value>0.8</value>
</property>
<property>
<name>hbase.bucketcache.size</name>
<value>40000</value>
</property>
However, when we access the HBase configuration page on the HBase Web
admin, we are not able to see the updated configurations, even for the
ones
not related to bucket cache:
<property><name>hbase.regionserver.handler.count</
name><value>*30*</value><source>hbase-site.xml</source></property>
Can you give us a hint on why the configurations are not seen in the
HBase
configuration site, and how we can check out the HBase configuration
for
all region servers?
Thanks,
Gaby
--
Regards, Gaby
<http://www.oracle.com> Gabriela Montiel Moreno | Senior Member of
Technical Staff
Phone: +52 33 12531343 <tel:+52%2033%2012531343>
Oracle Semantic Technoliges
ORACLE Mexico
<http://www.oracle.com/commitment> Oracle is committed to developing
practices and products that help protect the environment
