Re: Stripe Compactions - recommended/stable in 0.98?

2015-12-22 Thread sudhir patil
Thanks, Elliott & Devaraj. While reverting back to default compaction for few tables alter statement got stuck and did not complete even after long time. I had to kill the process, i tried to rerun alter statements again on these tables disable statements fails saying table is not enabled, so i tr

Re: Stripe Compactions - recommended/stable in 0.98?

2015-12-22 Thread Devaraj Das
We have some customers using it in prod. They are happy with it. Yeah interested in knowing what issues you faced reverting back. From: Elliott Clark Sent: Friday, December 18, 2015 4:01 PM To: user@hbase.apache.org Subject: Re: Stripe Compactions - recomm

Re: Put performance test

2015-12-22 Thread Ted Yu
Kumiko: You can define your own YCSB workload by specifying the readproportion and scanproportion you want. FYI On Tue, Dec 22, 2015 at 11:39 AM, iain wright wrote: > You could use YCSB and a custom workload (i don't see a predefined workload > for 100% puts without reads) > > https://github.co

Re: Put performance test

2015-12-22 Thread Stack
Why the crash? Is it in the library or hbase? Thanks, St.Ack On Tue, Dec 22, 2015 at 11:00 AM, Kumiko Yada wrote: > Hello, > > I wrote the python script w/ happybase library to do the performance put > test; however, this library is crashing when more than 90 rows are > put. I'd like to do

RE: Put performance test

2015-12-22 Thread Frank Luo
If the table is not pre-split properly and timeout not increased, then region server will crash when compacting. -Original Message- From: Kumiko Yada [mailto:kumiko.y...@ds-iq.com] Sent: Tuesday, December 22, 2015 1:01 PM To: user@hbase.apache.org Subject: Put performance test Hello, I

Re: Put performance test

2015-12-22 Thread iain wright
You could use YCSB and a custom workload (i don't see a predefined workload for 100% puts without reads) https://github.com/brianfrankcooper/YCSB/wiki/Core-Workloads HBase also has a utility for running some evaluations via MR or a thread based client: $ ./hbase org.apache.hadoop.hbase.Performan

RE: Put performance test

2015-12-22 Thread Kumiko Yada
For to add that I don't want to the bulkinsert for this test. Thanks Kumiko -Original Message- From: Kumiko Yada [mailto:kumiko.y...@ds-iq.com] Sent: Tuesday, December 22, 2015 11:01 AM To: user@hbase.apache.org Subject: Put performance test Hello, I wrote the python script w/ happybas

Put performance test

2015-12-22 Thread Kumiko Yada
Hello, I wrote the python script w/ happybase library to do the performance put test; however, this library is crashing when more than 90 rows are put. I'd like to do 1/10/100 million rows put tests. Is there any tool that I can use for this? Thanks Kumiko

Re: regions in transition

2015-12-22 Thread Brian Jeltema
> > You should really find out where you hmaster ui lives (there is a master UI > for every node provided by the apache project) because it gives you > information on the state of your system, I’m familiar with the HMaster UI. I’m looking at it now. It does not contain the information you describ

Re: regions in transition

2015-12-22 Thread Geovanie Marquez
You should really find out where you hmaster ui lives (there is a master UI for every node provided by the apache project) because it gives you information on the state of your system, but if you want to skip all that, here are the instructions for OfflineRepair, without knowing what is happening w

Re: regions in transition

2015-12-22 Thread Brian Jeltema
Thanks. Can I safely delete the ZK node? > On Dec 22, 2015, at 11:29 AM, Ted Yu wrote: > > From RegionListTmpl.jamon : > > <%if (onlineRegions != null && onlineRegions.size() > 0) %> > ... > <%else> > Not serving regions > > > The message means that there was no region online on the underly

Re: regions in transition

2015-12-22 Thread Brian Jeltema
I’m running Ambari 2.0.2 and HPD 2.2. I don’t see any of this displayed at master:60010. I really think this problem is the result of cruft in ZooKeeper. Does anybody know if it’s safe to delete the node? > On Dec 22, 2015, at 11:40 AM, Geovanie Marquez > wrote: > > check hmaster:60010 und

Re: regions in transition

2015-12-22 Thread Geovanie Marquez
check hmaster:60010 under TASKS (between Software Attributes and Tables) you will see if you have regions in transition. This will tell you which regions are transitioning and you can go to those region server logs and check them, I've run into a couple of these and every time they've talk to me ab

Re: regions in transition

2015-12-22 Thread Ted Yu
>From RegionListTmpl.jamon : <%if (onlineRegions != null && onlineRegions.size() > 0) %> ... <%else> Not serving regions The message means that there was no region online on the underlying server. FYI On Tue, Dec 22, 2015 at 7:18 AM, Brian Jeltema wrote: > Following up, if I look at the

Re: doAs with HBase Java API and Apache Ranger

2015-12-22 Thread Adam Davidson
Hi Jerry, I think we have cracked it now, thanks. I noticed the proxy setting on the HBase server was setup for the wrong user. It wasn't obvious until I noticed in some debug logs that the impersonation was being forbidden which helped me identify the issue. Ranger now reports the correct user in

Re: regions in transition

2015-12-22 Thread Brian Jeltema
> > Can you pick a few regions stuck in transition and check related region > server logs to see why they couldn't be assigned ? I don’t see anything in the region logs relating any regions. > > Which release were you using previously ? HDP 2.1 -> HDP 2.2 So is it safe to stop HBase and dele

Re: regions in transition

2015-12-22 Thread Brian Jeltema
Following up, if I look at the MBase Master UI in the Ambari console I see links to all of the region servers. If I click on those links, the Region Server page comes up and in the Regions section, is displays ‘Not serving regions’. I’m not sure if that means something is disabled, or it just doe

Re: doAs with HBase Java API and Apache Ranger

2015-12-22 Thread Jerry He
What is the ConectionCache in your code? Is it org.apache.hadoop.hbase. util.ConnectionCache? As a sample on how to use the ConnectionCache, you can look at this: https://github.com/apache/hbase/blob/master/hbase-rest/src/main/java/org/apache/hadoop/hbase/rest/RESTServletContainer.java and https