Re: Rows per second for RegionScanner

2016-04-21 Thread Vladimir Rodionov
Try disabling block encoding - you will get better numbers. >> I mean per region scan speed, Scan performance depends on # of CPU cores, the more cores you have the more performance you will get. Your servers are pretty low end (4 virtual CPU cores is just 2 hardware cores). With 32 cores per

Re: Can not connect local java client to a remote Hbase

2016-04-21 Thread Sachin Mittal
Check these links out http://stackoverflow.com/questions/36377393/connecting-to-hbase-1-0-3-via-java-client-stuck-at-zookeeper-clientcnxn-session http://mail-archives.apache.org/mod_mbox/hbase-user/201604.mbox/browser First what is you machines IP address. If you can specify only IP address in

Re: Rows per second for RegionScanner

2016-04-21 Thread hongbin ma
hi Thakrar Thanks for your reply. My settings for the RegionScanner Scan is scan.setCaching(1024) scan.setMaxResultSize(5M) even if I change the caching to 10 I'm still not getting any improvements. I guess the caching works for remote scan through RPC, however not helping too much for

Re: Best way to pass configuration properties to MRv2 jobs

2016-04-21 Thread Henning Blohm
How true!! ;-) Thanks, Henning On 18.04.2016 19:53, Dima Spivak wrote: Probably better off asking on the Hadoop user mailing list ( u...@hadoop.apache.org) than the HBase one… :) -Dima On Mon, Apr 18, 2016 at 2:57 AM, Henning Blohm wrote: Hi, in our Hadoop 2.6.0

Hbase row key to Hive mapping

2016-04-21 Thread Viswanathan J
Hi, I'm storing the row key as following combination in bytes. Row key using rowbuilder: unused8+timestamp(int)+accountid(long)+id(long) When I'm trying to map that key in hive table, I'm unable to convert back the actual value since it's stored in bytes. Even I set mapping as :key#b. Please

Re: new 4.x-HBase-1.1 branch

2016-04-21 Thread Andrew Purtell
On Thu, Apr 21, 2016 at 11:09 AM, Enis Söztutar wrote: > > > > Also FWIW. I'd be curious to hear how many Phoenix users are using 0.98 > >> versus 1.0 and up, besides the folks at Salesforce, whom I know well > >> (smile). And, more generally, who in greater HBase land is still

Re: new 4.x-HBase-1.1 branch

2016-04-21 Thread Enis Söztutar
> > Also FWIW. I'd be curious to hear how many Phoenix users are using 0.98 >> versus 1.0 and up, besides the folks at Salesforce, whom I know well >> (smile). And, more generally, who in greater HBase land is still on 0.98 >> and won't move off this year. >> > From our customers perspective,

Re: new 4.x-HBase-1.1 branch

2016-04-21 Thread Enis Söztutar
Makes sense to drop the branch for HBase-1.0.x. I had proposed it here before: http://search-hadoop.com/m/9UY0h2XrnGW1d3OBF1=+DISCUSS+Drop+branch+for+HBase+1+0+ Enis On Thu, Apr 21, 2016 at 8:06 AM, Andrew Purtell wrote: > HBase announced at the last 1.0 release

Re: Can not connect local java client to a remote Hbase

2016-04-21 Thread Ted Yu
Are you using hbase 1.0 or 1.1 ? I assume you have verified that hbase master is running normally on master-sigma. Are you able to use hbase shell on that node ? If you check master log, you would see which node hosts hbase:meta On that node, do you see anything interesting in region server log

Can not connect local java client to a remote Hbase

2016-04-21 Thread SOUFIANI Mustapha | السفياني مصطفى
Hi all, I'm trying to connect my local java client (pentaho) to a remote Hbase but every time I get a TimeOut error telleing me that this connection couldn't be established. herer is the full message error:

Re: new 4.x-HBase-1.1 branch

2016-04-21 Thread Andrew Purtell
HBase announced at the last 1.0 release that it would be the last release in that line and I think we would recommend any 1.0 user move up to 1.1 or 1.2 at their earliest convenience. FWIW Also, as RM of the 0.98 code line I am considering ending its (mostly) regular release cadence at the end

Re: Processing rows in parallel with MapReduce jobs.

2016-04-21 Thread Ivan Cores gonzalez
Thanks Ted, Finally I found the real mistake, the class had to be declared static. Best, Iván. - Mensaje original - > De: "Ted Yu" > Para: user@hbase.apache.org > Enviados: Martes, 19 de Abril 2016 15:56:56 > Asunto: Re: Processing rows in parallel with MapReduce

RE: Rows per second for RegionScanner

2016-04-21 Thread Thakrar, Jayesh
Just curious - have you set the scanner caching to some high value - say 1000 (or even higher in your small value case)? The parameter is hbase.client.scanner.caching You can read up on it - https://hbase.apache.org/book.html Another thing, are you just looking for pure scan-read performance

Re: ERROR [main] client.ConnectionManager$HConnectionImplementation: The node /hbase is not in ZooKeeper.

2016-04-21 Thread Ted Yu
Since topic has shifted to making zookeeper quorum work, I suggest sending the question to user@zookeeper Thanks > On Apr 21, 2016, at 3:38 AM, Eric Gao wrote: > > Thanks a lot! > I delete the line /tmp/zookeeper,and make sure there is only one >

Rows per second for RegionScanner

2016-04-21 Thread hongbin ma
​Hi, experts, I'm trying to figure out how fast hbase can scan. I'm setting up the RegionScan in a endpoint coprocessor so that no network overhead will be included. My average key length is 35 and average value length is 5. My test result is that if I warm all my interested blocks in the block