T Vinod Gupta tvinod@... writes:
I am badly stuck and can't find a way out. i want to change my rowkey
schema while copying data from 1 table to another. but a map reduce job to
do this won't work because of large row sizes (responseTooLarge errors).
so
i am left with a 2 steps processing
On Thu, Jan 12, 2012 at 9:47 PM, T Vinod Gupta tvi...@readypulse.com wrote:
i wrote an app to delete bunch of old data which we dont need
any more.. so that app is doing scans and deletes (specific columns of rows
based on some custom logic).
You understand that you are writing a new entry
I am badly stuck and can't find a way out. i want to change my rowkey
schema while copying data from 1 table to another. but a map reduce job to
do this won't work because of large row sizes (responseTooLarge errors). so
i am left with a 2 steps processing of exporting to hdfs files and
importing
What version of hbase did you use ?
Can you post the stack trace for the exception ?
Thanks
On Jan 12, 2012, at 3:37 AM, T Vinod Gupta tvi...@readypulse.com wrote:
I am badly stuck and can't find a way out. i want to change my rowkey
schema while copying data from 1 table to another. but a
hbase version -
hbase(main):001:0 version
0.90.3-cdh3u1, r, Mon Jul 18 08:23:50 PDT 2011
here are the different exceptions -
when copying table to another table -
12/01/12 11:06:41 INFO mapred.JobClient: Task Id :
attempt_201201120656_0012_m_01_0, Status : FAILED
I think you need to manipulate the keyvalue to match the new row.
Take a look at the check:
//Checking that the row of the kv is the same as the put
int res = Bytes.compareTo(this.row, 0, row.length,
kv.getBuffer(), kv.getRowOffset(), kv.getRowLength());
if(res != 0) {
And what is happening on the server
ip-10-68-145-124.ec2.internal:60020 such that 14 attempts at getting a
region failed. Is that region on line during this time or being
moved? If not online, why not? Was server opening the region taking
too long (because of high-load?). Grep around the
Stack,
Here are some of the failures im getting now. I don't know whats wrong with
my hbase right now.. i literally stopped my main processes that write to
the store. i wrote an app to delete bunch of old data which we dont need
any more.. so that app is doing scans and deletes (specific columns
