HBase TTL not working

2021-07-14 Thread Arul Ramachandran
We have a small use case for HBase but the data consumed by HBase is growing in size comparable to the rest of the HDFS usage. I noticed the hbase table TTL setting 5 days does not seem to be honored - the data stays much longer or is never purged. The major compaction is set for 7 days. Any sugg

Re: Offheap config question for Hbase 1.1.2

2017-09-12 Thread Arul Ramachandran
e of total heap memory size to > > give to the cache (if < 1.0) OR, it is the total capacity in megabytes of > > BucketCache. Default: 0.0 > > > > If you specify the size as capacity, -XX:MaxDirectMemorySize should be > > bigger than the capacity. > > > > Fo

Re: Offheap config question for Hbase 1.1.2

2017-09-12 Thread Arul Ramachandran
y. > > For #2, did you encounter some error ? > > Cheers > > On Tue, Sep 12, 2017 at 8:52 AM, Arul Ramachandran > wrote: > > > In HBase 1.1.2, I am setting up bucket cache. I set MaxDirectMemory size > > greater than hbase.bucket.cache.size - only then it would wo

Offheap config question for Hbase 1.1.2

2017-09-12 Thread Arul Ramachandran
In HBase 1.1.2, I am setting up bucket cache. I set MaxDirectMemory size greater than hbase.bucket.cache.size - only then it would work. 1) Does HBASE_REGIONSERVER_OPTS -XX:MaxDirectMemorySize needs to be greater than hbase.bucket.cache.size? 2) It seems with hbase 1.1.2, HBASE_MASTER_OPTS also n

Re: Hbase upgrade question

2016-01-27 Thread Arul Ramachandran
n 27, 2016 at 2:57 PM, Arul Ramachandran > wrote: > > > Hello HBase folks, > > > > > > - Looking to upgrade from Hortonworks HDP 2.1(Hadoop 2.4.0) to HDP 2.2. > > (Hadoop 2.6.0) > > - HBase version changes from 0.98.0 to 0.98.4 > > > > Ar

Hbase upgrade question

2016-01-27 Thread Arul Ramachandran
Hello HBase folks, - Looking to upgrade from Hortonworks HDP 2.1(Hadoop 2.4.0) to HDP 2.2. (Hadoop 2.6.0) - HBase version changes from 0.98.0 to 0.98.4 Are there any special steps involved for the HBase upgrade itself? From the Hortonworks doc, I did not see specific step for this - other than

HBase 1.1.1 - any opinions?

2016-01-10 Thread Arul Ramachandran
Has anyone migrated to HBase 1.1.1? We plan to upgrade from HDP 2.1 HBase 0.98.0.2.1 to HDP 2.3 HBase 1.1.1 http://hortonworks.com/hdp/whats-new/ What should I watch for? Is HBase 1.1.1 considered production/stable? or would it be safe to upgrade to HDP 2.2 HBase 0.98.4? If you have any in

While performing append operations, on region split, some of the data is lost

2015-01-02 Thread Arul Ramachandran
Hello folks, Hbase 0.96.1.2.0.6.1 We see the following behavior. With append operation, data gets appended as expected until existing regions are getting populated. But as soon as hbase does a split on one of the region as it gets to its capacity, some of the append operations which are already

Re: balance the tables across region servers

2014-11-21 Thread Arul Ramachandran
r.stochastic.tableSkewCost" > so that your table is more balanced. > > Cheers > > On Fri, Nov 21, 2014 at 1:35 PM, Arul Ramachandran > wrote: > > > Hello, > > > > HBase 0.96 > > > > I notice couple of our tables are on only one of the region s

balance the tables across region servers

2014-11-21 Thread Arul Ramachandran
Hello, HBase 0.96 I notice couple of our tables are on only one of the region servers and that one is doing magnitudes of requests per sec compared to others. Will setting hbase.master.loadbalance.bytable to true help this situation? Also, if that is the case, wondering why this is not set to t

Re: HBase concurrent.RejectedExecutionException

2014-11-17 Thread Arul Ramachandran
Hi Ted, I don't have the load metrics at the moment... are you suggesting this could be load related? Thanks On Mon, Nov 17, 2014 at 5:34 PM, Ted Yu wrote: > What was the load on rs3.world.com,60020,1414690096750 around 09:49:30 ? > > Cheers > > On Mon, Nov 17, 2

HBase concurrent.RejectedExecutionException

2014-11-17 Thread Arul Ramachandran
Hi, Our Hbase application gets the following exception - HBase 0.96.1.2.0.6.1-101-hadoop2. I looked at the region server log and nothing unusual is happening. Any pointers on what else I can check? Thanks! 2014-11-16 09:49:37,686 WARN [hbase-connection-shared-executor-pool644-t158] AsyncProces