Puts failing with WrongRegionException

2014-10-03 Thread Thomas Kwan
Hi there, Wonder if anyone has seen error like this 2014-10-03 16:03:45,203 WARN [RpcServer.handler=7,port=60020] regionserver.HRegion: Failed getting lock in batch put, row=65317d52abfedc8b94a19f6fbffe187c org.apache.hadoop.hbase.regionserver.WrongRegionException: Requested row out of range

Region Server on all data node?

2014-09-26 Thread Thomas Kwan
Hi there, To get good read performance, should the region server be installed on every data node? (Thinking about data locality here) thanks thomas

Re: Region Server on all data node?

2014-09-26 Thread Thomas Kwan
#regions.arch.locality Cheers On Fri, Sep 26, 2014 at 7:02 AM, Thomas Kwan thomas.k...@manage.com wrote: Hi there, To get good read performance, should the region server be installed on every data node? (Thinking about data locality here) thanks thomas

random reads

2014-08-14 Thread Thomas Kwan
Hi there I have a use-case where I need to do a read to check if a hbase entry is present, then I do a put to create the entry when it is not there. I have a script to get a list of rowkeys from hive and put them on a HDFS directory. Then I have a MR job that reads the rowkeys and do batch

Re: random reads

2014-08-14 Thread Thomas Kwan
of threads or tasks, size of the row, RS resources, configurations, etc. so any additional info would be very helpful. cheers, esteban. -- Cloudera, Inc. On Thu, Aug 14, 2014 at 10:32 AM, Thomas Kwan thomas.k...@manage.com wrote: Hi there I have a use-case where I need to do

Cannot drop table

2014-08-12 Thread Thomas Kwan
I just created a new test table today, and when trying to drop it, I got ERROR: No serverName in hbase:meta for p_hashes,,1407880525015.6fe0bbb6e5a6f614891e7c1c5901c70f. containing In the hbase master log, it said client.HConnectionManager$HConnectionImplementation: locateRegionInMeta failed;

Read operations hanged

2014-08-10 Thread Thomas Kwan
And I have a program that do some read operations and it hangs. And I am seeing 2014-08-10 12:22:05,359 DEBUG [main] client.HConnectionManager$HConnectionImplementation: Removed all cached region locations that map to dn29.manage.com,60020,1407600154728 2014-08-10 12:22:06,173 DEBUG [main]

Re: Read operations hanged

2014-08-10 Thread Thomas Kwan
version are you using ? Cheers On Sun, Aug 10, 2014 at 10:27 AM, Thomas Kwan thomas.k...@manage.com wrote: And I have a program that do some read operations and it hangs. And I am seeing 2014-08-10 12:22:05,359 DEBUG [main] client.HConnectionManager$HConnectionImplementation: Removed all

Re: Read operations hanged

2014-08-10 Thread Thomas Kwan
,2fd811c2b1d7476efb16499ccb2b823d' went offline ? Thanks On Sun, Aug 10, 2014 at 12:13 PM, Thomas Kwan thomas.k...@manage.com wrote: Hi Ted, Hbase version is 0.96.0.2.0 Nothing interesting in the hbase log on dn29 and confirmed that region server is running on dn29 When I do 'get', i see hbase(main):001:0 get

Hbase MR Job with 2 OutputForm classes possible?

2014-07-30 Thread Thomas Kwan
Hi there, I have a Hbase MR job that reads data from HDFS, do a Hbase Get, and then do some data transformation. Then I need to put the data back to Hbase as well as write data to a HDFS file directory (so I can import it back into Hive). The current job creation logic is similar to the

Get operation slows in MR job

2014-07-28 Thread Thomas Kwan
Hi there, I have a MR job that does Get and then Put operation to a Hbase table. For the write operation, I am using TableOutputFormat (like to the map function in https://github.com/larsgeorge/hbase-book/blob/master/ch07/src/main/java/mapreduce/ImportFromFile.java ). The write is pretty fast,