Adding RegionServers when salting

2015-12-18 Thread Marko Dinic
Hi everyone, I read about salting and how it is used for load balancing in case of sequential keys. Basically, salt should distribute sequential rows to different region servers. I also read this article

Re: Type of Scan to be used for real time analysis

2015-12-18 Thread anil gupta
Hi RajeshKumar, IMO, type of scan is not decided on the basis of response time. Its decided on the basis of your query logic and data model. Also, Response time cannot be directly correlated to any filter or scan. Response time is more about how much data needs to read, cpu, network IO, etc to

Re: Type of Scan to be used for real time analysis

2015-12-18 Thread Rajeshkumar J
Hi Anil, I have about 10 million rows with each rows having more than 10k columns. I need to query this table based on row key and which will be the apt query process for this Thanks On Fri, Dec 18, 2015 at 5:43 PM, anil gupta wrote: > Hi RajeshKumar, > > IMO, type

RE: Type of Scan to be used for real time analysis

2015-12-18 Thread beeshma r
Hi Rajesh, Why you can't index all rows using Solr. Check this out Hbase indexer(NG data) Regards Beeshma Ramakrishnan -Original Message- From: Rajeshkumar J Sent: 18-12-2015 PM 05:59 To: user@hbase.apache.org Subject: Re: Type of Scan to be used for real time analysis Hi Anil, I

Re: Type of Scan to be used for real time analysis

2015-12-18 Thread anil gupta
If you know exact rowkey of row that you need to fetch then you just need to use GET. If you know just the prefix of rowkey, then you can use range scans in HBase. Does the above 2 scenario's cover your use case? On Fri, Dec 18, 2015 at 4:29 AM, Rajeshkumar J wrote:

Re: Type of Scan to be used for real time analysis

2015-12-18 Thread Rajeshkumar J
Hi, On Fri, Dec 18, 2015 at 7:30 PM, anil gupta wrote: > If you know exact rowkey of row that you need to fetch then you just need > to use GET. If you know just the prefix of rowkey, then you can use range > scans in HBase. Does the above 2 scenario's cover your use

Save the date and other notes

2015-12-18 Thread Stack
HBaseCon2016 will be on Tues. May 24, 2016 at The Village on Market St. in SF. Save the date! Call for papers will go out at start of the new year. Keep an eye out. There's a blog post up on the offheaping work that has been going on with a good while now. Lots of

Re: doAs with HBase Java API and Apache Ranger

2015-12-18 Thread Chris Gent
Hey Ted, Yeah - they suggested asking over here :-) I think the question is where the user context is set/comes from when using the HBase API. It was suggested that it comes when the Table object gets created? Or is it right back when the connection is established? -- Chris On 18 December

doAs with HBase Java API and Apache Ranger

2015-12-18 Thread Chris Gent
Hi, We have a webservice that performs reads/writes on HBase tables and have a requirement to authorize and audit table/column family access using Ranger. I've configured the reads/writes to be performed under doAs to try to make this happen but the requests end up being authorized and audit

Re: doAs with HBase Java API and Apache Ranger

2015-12-18 Thread Ted Yu
Have you polled Ranger community with this question ? http://ranger.apache.org/mail-lists.html Cheers On Fri, Dec 18, 2015 at 9:04 AM, Chris Gent < chris.g...@bigdatapartnership.com> wrote: > Hi, > > We have a webservice that performs reads/writes on HBase tables and have a > requirement to

Re: doAs with HBase Java API and Apache Ranger

2015-12-18 Thread Ted Yu
I talked with a Ranger developer who has read the thread on Ranger mailing list. Setting up proxy may require certain steps. I suggest responding to Bosco's question on the Ranger mailing list (by providing related server log, e.g.) - Ranger developers have knowledge about HBase. Cheers On

Re: Stripe Compactions - recommended/stable in 0.98?

2015-12-18 Thread Elliott Clark
What issues did you see reverting back? I don't have enough experience with the stripe compactions to call them stable yet. Maybe someone else does? On Fri, Dec 11, 2015 at 9:36 PM, sudhir patil wrote: > It would be great if some one can reply about stability of stripe

Re: Type of Scan to be used for real time analysis

2015-12-18 Thread Rajeshkumar J
Hi, yes I am currently using range scan but it takes more than 10 seconds based on the number of columns. But I want to bring this down to a second. Is there any other which I can do to achieve this Thanks On Fri, Dec 18, 2015 at 7:30 PM, anil gupta wrote: > If you

regionserver stuck

2015-12-18 Thread wangkai
Hi, all: our hbase cluster often occurs a strange phenomenon,we can’t query or execute bulkload when one machine goes down,like the hbase cluster is crashed. So we took a look at the jstack of the regionserver, we found some threads were blocked, waiting for the lock. Here is the jstack

java.lang.reflect.InvocationTargetException when doing batch with large number of increment

2015-12-18 Thread Keith Lui
Hi, Tried to do a 10K increment with batch. When using public void batch(List actions, Object[] results) got java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

Re: hbase using spark-sql

2015-12-18 Thread Yan Zhou
Stack, Per your request, a Jira has been filed for Project Astro: https://issues.apache.org/jira/browse/HBASE-14980 Thanks, Yan -- Forwarded message -- From: Stack > Date: Mon, Dec

Re: HBase End of Product Life Cycle

2015-12-18 Thread Ted Yu
For question #1, which release(s) are you using / interested in ? Cheers On Fri, Dec 18, 2015 at 9:21 AM, Dominic KUMAR wrote: > Hi HBase, > > Is there any HBase End of Product Life Cycle date / release ? What is the > road-map of HBase ? > > > > Regards, > > Dominic Vivek

HBase End of Product Life Cycle

2015-12-18 Thread Dominic KUMAR
Hi HBase, Is there any HBase End of Product Life Cycle date / release ? What is the road-map of HBase ? Regards, Dominic Vivek SHANTHA KUMAR

Re: java.lang.reflect.InvocationTargetException when doing batch with large number of increment

2015-12-18 Thread Ted Yu
Here is related code from AsyncProcess: if (results.length != actions.size()) { throw new AssertionError("results.length"); } It means that the length of results (0 in your case) is not the same as number of Action's Please create results array with proper length.