hbase compaction stuck

2015-03-16 Thread Chen Song
We ran a hbase cluser with version 0.98.1+cdh5.1.0 and with auto compaction. I have noticed a few times that compaction stuck under the following circumstances. 1. Some server in the cluster is hard dead and physical down. 2. At the same time, if any region servers are running major compaction and

HBase compaction question

2014-02-21 Thread Chen Song
paction. We let HBase to manage itself and it works so far. However, our concern is still there, as data grows, will it have the same problem as the first option? Let me know if you need further clarification or any questions. Thank you very much in advance. Best, -- Chen Song

Re: Schedule major compaction programmatically

2012-05-18 Thread Chen Song
t; Cheers, > Jimmy > > On Thu, May 17, 2012 at 1:23 PM, Chen Song wrote: > > > Sorry for another dump question. As I am querying such information in > > client code, how to get a HRegionServer from a HRegionInfo, > > or HServerAddress? &g

Re: Schedule major compaction programmatically

2012-05-17 Thread Chen Song
HRegionInterface and only on HRegionServer. Thanks Chen On Thu, May 17, 2012 at 3:03 PM, Jimmy Xiang wrote: > HRegionServer.java: > >this.metrics.compactionQueueSize.set(compactSplitThread >.getCompactionQueueSize()); > > On Thu, May 17, 2012 at 12:00 PM, Chen Song >

Re: Schedule major compaction programmatically

2012-05-17 Thread Chen Song
o work around for now. > > Jimmy > > > On Thu, May 17, 2012 at 11:42 AM, Chen Song > wrote: > > > Thanks Jimmy. Meanwhile, is there a work around for this? > > > > How does compact/major_compact issued from hbase shell handles this under > >

Re: Schedule major compaction programmatically

2012-05-17 Thread Chen Song
am thinking to add a function to check if a table or region in compaction > (major or minor). > > I filed HBASE-6033. It won't show status of a specific compaction request. > Will this help? > > Thanks, > Jimmy > > On Thu, May 17, 2012 at 11:11 AM, Chen Song > wrote

Re: Get the list of store/store files for a region via HBase API

2012-05-16 Thread Chen Song
e only way I'm > aware of at this time. > > > > > On 5/15/12 5:37 PM, "Chen Song" wrote: > > >Thanks Doug, that should work as the hierarchy is explicitly reflected on > >HDFS. But is this the preferred way to do such table/region/storefile > >traver

Re: Get the list of store/store files for a region via HBase API

2012-05-15 Thread Chen Song
, May 15, 2012 at 5:23 PM, Doug Meil wrote: > > You can get the Table->Region->StoreFile information via HDFS. That is > described here in the RefGuide: > > http://hbase.apache.org/book.html#trouble.namenode > > > > > > > On 5/15/12 5:09 PM, "Chen S

Get the list of store/store files for a region via HBase API

2012-05-15 Thread Chen Song
I am new to HBase and started working on a project which needs meta information on HBase regions for a table. The version of HBase I am using 0.90.4. The use case is very simple. First, I want to get all regions for a table, which I can achieve using the API call below. HTable table = new HT