Re: Sources Of HBase Client Side Latency

We have very similar issues with HBase 1.1.2, especially around splits. It takes several minutes at times. We use phoenix with two global indexes and we know that compounds the issue a bit, but about 95% of inserts take < 50ms (with index writes included), but the remaining 5% are wild from 100ms t

Re: Failed open of region

On Tue, Apr 19, 2016 at 9:09 PM, Michal Medvecky wrote: > On Tue, Apr 19, 2016 at 9:02 PM, Stack wrote: > > > What happens if you try to copy /hbase/data/default/MEDIA/ > > ecd1e565ab8a8bfba77cab46ed023539* > > /F/5eacfeb8a2eb419cb6fe348df0540145 to local filesystem from HDFS (hdfs > dfs > > -co

Re: Failed open of region

On Tue, Apr 19, 2016 at 9:02 PM, Stack wrote: > If you run hdfs fsck it shows missing blocks? > No, HDFS reports healthy filesystem. > What happens if you try to copy /hbase/data/default/MEDIA/ > ecd1e565ab8a8bfba77cab46ed023539* > /F/5eacfeb8a2eb419cb6fe348df0540145 to local filesystem from H

Re: Failed open of region

If you run hdfs fsck it shows missing blocks? What happens if you try to copy /hbase/data/default/MEDIA/ ecd1e565ab8a8bfba77cab46ed023539* /F/5eacfeb8a2eb419cb6fe348df0540145 to local filesystem from HDFS (hdfs dfs -copyLocal... or whatever it is called)? Try moving aside the problematic files?

Failed open of region

Hello, after several network outages in AWS (never ever run HBase there!), my HBase was seriously damaged. After doing some steps like restarting namenodes, hdfs fsck, restarting all regionservers and hbase master, i'm still having 8 offline regions I am unable to start. When running hbck with an

Re: Sources Of HBase Client Side Latency

On Tue, Apr 19, 2016 at 2:07 PM, Saad Mufti wrote: > Hi, > > I found this blog post from 2014 on sources of HBase client side latency > which I found useful: > > > https://hadoop-hbase.blogspot.com/2014/08/hbase-client-response-times.html?showComment=1461099797978#c5266762058464276023 > > It is w

Re: Hbase Replication no longer replicating, help diagnose

my timeout is set pretty high 120 maybe too high We do get bursts of large changes when I update hbase via hive map reduce I restarted both clusters and they caught up - but after a couple of days they just slow down and stop On Fri, Apr 15, 2016 at 5:49 AM, ashish singhi wrote: > Let me

Sources Of HBase Client Side Latency

Hi, I found this blog post from 2014 on sources of HBase client side latency which I found useful: https://hadoop-hbase.blogspot.com/2014/08/hbase-client-response-times.html?showComment=1461099797978#c5266762058464276023 Since this is a bit dated, anyone have any other sources of latency to add?

Re: Major Compaction Strategy

Please use the following method of HBaseAdmin: public CompactionState getCompactionStateForRegion(final byte[] regionName) Cheers On Tue, Apr 19, 2016 at 12:56 PM, Saad Mufti wrote: > Hi, > > We have a large HBase 1.x cluster in AWS and have disabled automatic major > compaction as advised.

Major Compaction Strategy

Hi, We have a large HBase 1.x cluster in AWS and have disabled automatic major compaction as advised. We were running our own code for compaction daily around midnight which calls HBaseAdmin.majorCompactRegion(byte[] regionName) in a rolling fashion across all regions. But we missed the fact that

Re: Processing rows in parallel with MapReduce jobs.

>From the error, you need to provide an argumentless ctor for MyTableInputFormat. On Tue, Apr 19, 2016 at 12:12 AM, Ivan Cores gonzalez wrote: > > Hi Ted, > > Sorry, I forgot to write the error. In runtime I have the next exception: > > Exception in thread "main" java.lang.RuntimeException: > ja

Re: Processing rows in parallel with MapReduce jobs.

Hi Ted, Sorry, I forgot to write the error. In runtime I have the next exception: Exception in thread "main" java.lang.RuntimeException: java.lang.NoSuchMethodException: simplerowcounter.SimpleRowCounter$MyTableInputFormat.() the program works fine if I don't use "MyTableInputFormat" modifyin