Re: Failed open of region

2016-04-19 Thread Stack
On Tue, Apr 19, 2016 at 9:09 PM, Michal Medvecky wrote: > On Tue, Apr 19, 2016 at 9:02 PM, Stack wrote: > > > What happens if you try to copy /hbase/data/default/MEDIA/ > > ecd1e565ab8a8bfba77cab46ed023539* > > /F/5eacfeb8a2eb419cb6fe348df0540145 to local

Re: Failed open of region

2016-04-19 Thread Michal Medvecky
On Tue, Apr 19, 2016 at 9:02 PM, Stack wrote: > If you run hdfs fsck it shows missing blocks? > No, HDFS reports healthy filesystem. > What happens if you try to copy /hbase/data/default/MEDIA/ > ecd1e565ab8a8bfba77cab46ed023539* > /F/5eacfeb8a2eb419cb6fe348df0540145 to

Re: Failed open of region

2016-04-19 Thread Stack
If you run hdfs fsck it shows missing blocks? What happens if you try to copy /hbase/data/default/MEDIA/ ecd1e565ab8a8bfba77cab46ed023539* /F/5eacfeb8a2eb419cb6fe348df0540145 to local filesystem from HDFS (hdfs dfs -copyLocal... or whatever it is called)? Try moving aside the problematic files?

Failed open of region

2016-04-19 Thread Michal Medvecky
Hello, after several network outages in AWS (never ever run HBase there!), my HBase was seriously damaged. After doing some steps like restarting namenodes, hdfs fsck, restarting all regionservers and hbase master, i'm still having 8 offline regions I am unable to start. When running hbck with

Re: Sources Of HBase Client Side Latency

2016-04-19 Thread Stack
On Tue, Apr 19, 2016 at 2:07 PM, Saad Mufti wrote: > Hi, > > I found this blog post from 2014 on sources of HBase client side latency > which I found useful: > > >

Re: Hbase Replication no longer replicating, help diagnose

2016-04-19 Thread Abraham Tom
my timeout is set pretty high 120 maybe too high We do get bursts of large changes when I update hbase via hive map reduce I restarted both clusters and they caught up - but after a couple of days they just slow down and stop On Fri, Apr 15, 2016 at 5:49 AM, ashish singhi

Sources Of HBase Client Side Latency

2016-04-19 Thread Saad Mufti
Hi, I found this blog post from 2014 on sources of HBase client side latency which I found useful: https://hadoop-hbase.blogspot.com/2014/08/hbase-client-response-times.html?showComment=1461099797978#c5266762058464276023 Since this is a bit dated, anyone have any other sources of latency to

Re: Major Compaction Strategy

2016-04-19 Thread Ted Yu
Please use the following method of HBaseAdmin: public CompactionState getCompactionStateForRegion(final byte[] regionName) Cheers On Tue, Apr 19, 2016 at 12:56 PM, Saad Mufti wrote: > Hi, > > We have a large HBase 1.x cluster in AWS and have disabled automatic major >

Major Compaction Strategy

2016-04-19 Thread Saad Mufti
Hi, We have a large HBase 1.x cluster in AWS and have disabled automatic major compaction as advised. We were running our own code for compaction daily around midnight which calls HBaseAdmin.majorCompactRegion(byte[] regionName) in a rolling fashion across all regions. But we missed the fact

Re: Processing rows in parallel with MapReduce jobs.

2016-04-19 Thread Ted Yu
>From the error, you need to provide an argumentless ctor for MyTableInputFormat. On Tue, Apr 19, 2016 at 12:12 AM, Ivan Cores gonzalez wrote: > > Hi Ted, > > Sorry, I forgot to write the error. In runtime I have the next exception: > > Exception in thread "main"

Re: Processing rows in parallel with MapReduce jobs.

2016-04-19 Thread Ivan Cores gonzalez
Hi Ted, Sorry, I forgot to write the error. In runtime I have the next exception: Exception in thread "main" java.lang.RuntimeException: java.lang.NoSuchMethodException: simplerowcounter.SimpleRowCounter$MyTableInputFormat.() the program works fine if I don't use "MyTableInputFormat"