Puts failing with WrongRegionException

2014-10-03 Thread Thomas Kwan
Hi there, Wonder if anyone has seen error like this 2014-10-03 16:03:45,203 WARN [RpcServer.handler=7,port=60020] regionserver.HRegion: Failed getting lock in batch put, row=65317d52abfedc8b94a19f6fbffe187c org.apache.hadoop.hbase.regionserver.WrongRegionException: Requested row out of range for

Re: Region Server on all data node?

2014-09-26 Thread Thomas Kwan
ions.arch.locality > > Cheers > > On Fri, Sep 26, 2014 at 7:02 AM, Thomas Kwan wrote: > >> Hi there, >> >> To get good read performance, should the region server be installed on >> every data node? (Thinking about data locality here) >> >> thanks >> thomas >>

Region Server on all data node?

2014-09-26 Thread Thomas Kwan
Hi there, To get good read performance, should the region server be installed on every data node? (Thinking about data locality here) thanks thomas

Re: random reads

2014-08-14 Thread Thomas Kwan
e performance: number of threads or tasks, size of the row, > RS resources, configurations, etc. so any additional info would be very > helpful. > > cheers, > esteban. > > > > > -- > Cloudera, Inc. > > > > On Thu, Aug 14, 2014 at 10:32 AM, Thomas Kwan >

random reads

2014-08-14 Thread Thomas Kwan
Hi there I have a use-case where I need to do a read to check if a hbase entry is present, then I do a put to create the entry when it is not there. I have a script to get a list of rowkeys from hive and put them on a HDFS directory. Then I have a MR job that reads the rowkeys and do batch reads.

Cannot drop table

2014-08-12 Thread Thomas Kwan
I just created a new test table today, and when trying to drop it, I got ERROR: No serverName in hbase:meta for p_hashes,,1407880525015.6fe0bbb6e5a6f614891e7c1c5901c70f. containing In the hbase master log, it said client.HConnectionManager$HConnectionImplementation: locateRegionInMeta failed; pa

Re: Read operations hanged

2014-08-10 Thread Thomas Kwan
t not processed > yet > > Can you look back (from 22:50:51) in master log to see what happened to > dn29 ? > > Thanks > > > On Sun, Aug 10, 2014 at 2:51 PM, Thomas Kwan wrote: > >> Thanks for your help Ted. >> >> From the master's log, I se

Re: Read operations hanged

2014-08-10 Thread Thomas Kwan
2:28 PM, Ted Yu wrote: > Can you check master log to see why 'm_data,2fd811c2b1d7476efb16499ccb2b823d' > went offline ? > > Thanks > > > On Sun, Aug 10, 2014 at 12:13 PM, Thomas Kwan > wrote: > >> Hi Ted, >> >> Hbase version is 0.96.0.2.0 >&g

Re: Read operations hanged

2014-08-10 Thread Thomas Kwan
g on dn29.manage.com ? > > What hbase version are you using ? > > Cheers > > > On Sun, Aug 10, 2014 at 10:27 AM, Thomas Kwan > wrote: > >> And I have a program that do some read operations and it hangs. And I am >> seeing >> >> 2014-08-10 12:22:

Read operations hanged

2014-08-10 Thread Thomas Kwan
And I have a program that do some read operations and it hangs. And I am seeing 2014-08-10 12:22:05,359 DEBUG [main] client.HConnectionManager$HConnectionImplementation: Removed all cached region locations that map to dn29.manage.com,60020,1407600154728 2014-08-10 12:22:06,173 DEBUG [main] client.

Hbase MR Job with 2 OutputForm classes possible?

2014-07-30 Thread Thomas Kwan
Hi there, I have a Hbase MR job that reads data from HDFS, do a Hbase Get, and then do some data transformation. Then I need to put the data back to Hbase as well as write data to a HDFS file directory (so I can import it back into Hive). The current job creation logic is similar to the followin

Get operation slows in MR job

2014-07-28 Thread Thomas Kwan
Hi there, I have a MR job that does Get and then Put operation to a Hbase table. For the write operation, I am using TableOutputFormat (like to the map function in https://github.com/larsgeorge/hbase-book/blob/master/ch07/src/main/java/mapreduce/ImportFromFile.java ). The write is pretty fast, 200