Potential bugs in HTable In incrementColumnValue method

2015-06-09 Thread Jerry Lam
Hi HBase community, Can anyone confirm that the method incrementColumnValue is implemented correctly? I'm talking about mainly the deprecated method: @Deprecated @Override public long incrementColumnValue(final byte [] row, final byte [] family, final byte [] qualifier, final long

Re: Potential bugs in HTable In incrementColumnValue method

2015-06-09 Thread Vladimir Rodionov
Hi, Jerry Which version of HBase is it? -Vlad On Tue, Jun 9, 2015 at 8:05 AM, Jerry Lam chiling...@gmail.com wrote: Hi HBase community, Can anyone confirm that the method incrementColumnValue is implemented correctly? I'm talking about mainly the deprecated method: @Deprecated

Re: Potential bugs in HTable In incrementColumnValue method

2015-06-09 Thread Ted Yu
I see code in this formation in 0.98 branch. Looking at the unit tests which exercise incrementColumnValue(), they all call: public long incrementColumnValue(final byte [] row, final byte [] family, final byte [] qualifier, final long amount) Possibly because the one mentioned by Jerry

Re: Potential bugs in HTable In incrementColumnValue method

2015-06-09 Thread Jerry Lam
at the unit tests which exercise incrementColumnValue(), they all call: public long incrementColumnValue(final byte [] row, final byte [] family, final byte [] qualifier, final long amount) Possibly because the one mentioned by Jerry is deprecated. FYI On Tue, Jun 9, 2015 at 8:49 AM

Re: Potential bugs in HTable In incrementColumnValue method

2015-06-09 Thread Ted Yu
Regards, Jerry On Tue, Jun 9, 2015 at 12:03 PM, Ted Yu yuzhih...@gmail.com wrote: I see code in this formation in 0.98 branch. Looking at the unit tests which exercise incrementColumnValue(), they all call: public long incrementColumnValue(final byte [] row, final byte [] family

Re: Potential bugs in HTable In incrementColumnValue method

2015-06-09 Thread Ted Yu
, Jerry On Tue, Jun 9, 2015 at 12:03 PM, Ted Yu yuzhih...@gmail.com wrote: I see code in this formation in 0.98 branch. Looking at the unit tests which exercise incrementColumnValue(), they all call: public long incrementColumnValue(final byte [] row, final

Re: Potential bugs in HTable In incrementColumnValue method

2015-06-09 Thread Andrew Purtell
incrementColumnValue(), they all call: public long incrementColumnValue(final byte [] row, final byte [] family, final byte [] qualifier, final long amount) Possibly because the one mentioned by Jerry is deprecated. FYI On Tue, Jun 9, 2015 at 8:49 AM, Vladimir

Re: Potential bugs in HTable In incrementColumnValue method

2015-06-09 Thread Jerry Lam
wrote: I see code in this formation in 0.98 branch. Looking at the unit tests which exercise incrementColumnValue(), they all call: public long incrementColumnValue(final byte [] row, final byte [] family, final byte [] qualifier, final long amount

Re: multi-threaded HTablePool, incrementColumnValue, compaction and large data set

2012-08-09 Thread Sambit Tripathy
(with threading and without), but the threaded solution is causing the problem. We are processing log files with PUTs in the Map and a followup incrementColumnValue() to a separate counts table in the Reducer. The reduce phase uses multi-threading. The Reducer initializes an HTablePool in the setup

multi-threaded HTablePool, incrementColumnValue, compaction and large data set

2012-01-15 Thread Neil Yalowitz
in an MR job it would be very helpful. We are testing both implementations (with threading and without), but the threaded solution is causing the problem. We are processing log files with PUTs in the Map and a followup incrementColumnValue() to a separate counts table in the Reducer. The reduce

Re: thread safety of incrementColumnValue

2011-07-23 Thread 陈加俊
. Reading through the HTable docs suggests not to use single HTable instance for updates, if it's true how can incrementColumnValue provide thread safety? thanks -- 陈加俊 项目经理 优讯时代(北京)网络技术有限公司 优讯网 www.uuwatch.com 地址:北京市海淀区上地信息路2号D栋412 电话:010-82895510 传真:010

Re: thread safety of incrementColumnValue

2011-07-23 Thread Ted Yu
different threads from different parts of the app. Reading through the HTable docs suggests not to use single HTable instance for updates, if it's true how can incrementColumnValue provide thread safety? thanks -- 陈加俊 项目经理 优讯时代(北京)网络技术有限公司 优

Re: thread safety of incrementColumnValue

2011-07-21 Thread large data
instance for updates, if it's true how can incrementColumnValue provide thread safety? thanks

Re: thread safety of incrementColumnValue

2011-07-21 Thread Doug Meil
incrementColumnValue provide thread safety? thanks

Re: thread safety of incrementColumnValue

2011-07-21 Thread large data
the HTable docs suggests not to use single HTable instance for updates, if it's true how can incrementColumnValue provide thread safety? thanks

Re: thread safety of incrementColumnValue

2011-07-21 Thread Ted Yu
service. This singleton service is called from different threads from different parts of the app. Reading through the HTable docs suggests not to use single HTable instance for updates, if it's true how can incrementColumnValue provide thread safety? thanks

Re: thread safety of incrementColumnValue

2011-07-21 Thread large data
threads from different parts of the app. Reading through the HTable docs suggests not to use single HTable instance for updates, if it's true how can incrementColumnValue provide thread safety? thanks

thread safety of incrementColumnValue

2011-07-20 Thread large data
I have an HTable instance instantiated as part of a singleton service. This singleton service is called from different threads from different parts of the app. Reading through the HTable docs suggests not to use single HTable instance for updates, if it's true how can incrementColumnValue provide

Re: thread safety of incrementColumnValue

2011-07-20 Thread Doug Meil
through the HTable docs suggests not to use single HTable instance for updates, if it's true how can incrementColumnValue provide thread safety? thanks

java.lang.IllegalArgumentException in incrementColumnValue and Increment

2011-03-29 Thread sulabh choudhury
.invoke(Unknown Source) at sun.reflec... I guess I have tried all possible combinations of datatypesI could not even find a decent example of incrementColumnValue()

Re: java.lang.IllegalArgumentException in incrementColumnValue and Increment

2011-03-29 Thread Stack
) at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)  at sun.reflec... I guess I have tried all possible combinations of datatypesI could not even find a decent example of incrementColumnValue()

Re: java.lang.IllegalArgumentException in incrementColumnValue and Increment

2011-03-29 Thread Jesse Hutton
Hi, It looks like the problem is that the initial value you're inserting in the column is an int, while HTable#incrementColumnValue() expects a long. Instead of: I enter data by :- theput.add(Bytes.toBytes(uid),Bytes.toBytes(1), 130108782L + t, Bytes.toBytes(10)) try: theput.add

Re: java.lang.IllegalArgumentException in incrementColumnValue and Increment

2011-03-29 Thread sulabh choudhury
tried all possible combinations of datatypesI could not even find a decent example of incrementColumnValue()

Re: java.lang.IllegalArgumentException in incrementColumnValue and Increment

2011-03-29 Thread sulabh choudhury
Thanks Jesse. Changing the 10 to 10L made it work. On Tue, Mar 29, 2011 at 8:59 AM, Jesse Hutton jesse.hut...@gmail.comwrote: Hi, It looks like the problem is that the initial value you're inserting in the column is an int, while HTable#incrementColumnValue() expects a long. Instead

Re: java.lang.IllegalArgumentException in incrementColumnValue and Increment

2011-03-29 Thread sulabh choudhury
. On Tue, Mar 29, 2011 at 8:59 AM, Jesse Hutton jesse.hut...@gmail.comwrote: Hi, It looks like the problem is that the initial value you're inserting in the column is an int, while HTable#incrementColumnValue() expects a long. Instead of: I enter data by :- theput.add(Bytes.toBytes(uid

Re: java.lang.IllegalArgumentException in incrementColumnValue and Increment

2011-03-29 Thread Jesse Hutton
in the column is an int, while HTable#incrementColumnValue() expects a long. Instead of: I enter data by :- theput.add(Bytes.toBytes(uid),Bytes.toBytes(1), 130108782L + t, Bytes.toBytes(10)) try: theput.add(Bytes.toBytes(uid),Bytes.toBytes(1), 130108782L + t

Re: incrementColumnValue

2011-01-12 Thread Billy Pearson
. You can also summarize your data and use a secondary process to execute a roll up of ICVs... if the number isnt too massive this might be acceptable. On Tue, Jan 11, 2011 at 4:07 PM, Billy Pearson sa...@pearsonwholesale.com wrote: Is there a way to make a mapreduce job and use incrementColumnValue

incrementColumnValue

2011-01-11 Thread Billy Pearson
Is there a way to make a mapreduce job and use incrementColumnValue in place of Put? I am trying to move a job over from thrift and have to be able to use incrementColumnValue as a output but I can not seams to work it out with out calling HTable every map. small example would be nice

Re: incrementColumnValue

2011-01-11 Thread Ryan Rawson
of ICVs... if the number isnt too massive this might be acceptable. On Tue, Jan 11, 2011 at 4:07 PM, Billy Pearson sa...@pearsonwholesale.com wrote: Is there a way to make a mapreduce job and use incrementColumnValue in place of Put? I am trying to move a job over from thrift and have