Re: HBase Thrift - HTTP - Kerberos & SPNEGO

2018-01-11 Thread Kevin Risden
"HBase Thrift2 "implementation" makes more sense to me" I agree with that statement since thrift2 follows the HBase API more closely. Thrift 1 follows the old HBase API. I don't think using Thrift2 with Hue is an option right now. It still interacts with Thrift 1. (I'm not really looking to

Re: HBase Thrift - HTTP - Kerberos & SPNEGO

2018-01-11 Thread Josh Elser
Hey Kevin! Looks like you got some good changes in here. IMO, the HBase Thrift2 "implementation" makes more sense to me (I'm sure there was a reason for having HTTP be involved at one point, but Thrift today has the ability to do all of this RPC work for us). I'm not sure what the HBase API

Re: Avoiding duplicate writes

2018-01-11 Thread Ted Yu
Peter: Normally java.lang.System.nanoTime() is used for measuring duration of time. See also https://www.javacodegeeks.com/2012/02/what-is-behind-systemnanotime.html bq. the prePut co-processor is executed inside a record lock The prePut hook is called with read lock on the underlying region.

HBase Thrift - HTTP - Kerberos & SPNEGO

2018-01-11 Thread Kevin Risden
I'm not 100% sure this should be posted to user list, but starting here before dev list/JIRA. I've been working on setting up the Hue HBase and it requires HBase Thrift v1 server. To support impersonation/proxyuser, the documentation states that this must be done with HTTP and not binary mode.

Re: Avoiding duplicate writes

2018-01-11 Thread Lalit Jadhav
Hello Peter, You can add a Random number in Row key for avoiding Rowkey overriding. Even though timeStamp at one ms is same Random Number provides uniqueness. On Thu, Jan 11, 2018 at 3:46 PM, Peter Marron wrote: > Hi, > > We have a problem when we are writing lots

Avoiding duplicate writes

2018-01-11 Thread Peter Marron
Hi, We have a problem when we are writing lots of records to HBase. We are not specifying timestamps explicitly and so the situation arises where multiple records are being written in the same millisecond. Unfortunately when the records are written and the timestamps are the same then later

RE: CompleteBulkLoad Error

2018-01-11 Thread ashish singhi
As per my understanding the online HBase book refers to master version. For the version specific document we can refer to book which is part of release tar, hbase-1.2.6-bin.tar.gz\hbase-1.2.6\docs\book.pdf Regards, Ashish -Original Message- From: Yung-An He

Re: CompleteBulkLoad Error

2018-01-11 Thread Yung-An He
Ankit and Ashish, thanks for reply, I saw the ImportTsv command `org.apache.hadoop.hbase.tool.LoadIncrementalHFiles` from the HBase book on the website, and according to official documents to run the command. But the command is for HBase-2.0.