Re: Export HBase snapshot to S3 creates empty root directory (prefix)

2016-05-04 Thread Lex Toumbourou
Thank you sooo much guys! I used s3n and that's fixed it. I will try s3a too. Thanks for much for that thread, Ted. On 5 May 2016 at 14:07, Ted Yu wrote: > Lex: > Please also see this thread about s3n versus s3a: > >

Re: Export HBase snapshot to S3 creates empty root directory (prefix)

2016-05-04 Thread Ted Yu
Lex: Please also see this thread about s3n versus s3a: http://search-hadoop.com/m/uOzYtE1Fy22eEWfe1=Re+S3+Hadoop+FileSystems On Wed, May 4, 2016 at 9:01 PM, Matteo Bertozzi wrote: > never seen that problem before, but a couple of suggestions you can try. > > Instead of

Re: Export HBase snapshot to S3 creates empty root directory (prefix)

2016-05-04 Thread Matteo Bertozzi
never seen that problem before, but a couple of suggestions you can try. Instead of the old s3 driver, you can use s3n or s3a if you have it available (those are the ones I tested) and instead of using hbase.root dir use -copy-from ExportSnapshot -snapshot SNAPSHOT_NAME -copy-to

Export HBase snapshot to S3 creates empty root directory (prefix)

2016-05-04 Thread Lex Toumbourou
Hi all, I'm having a couple of problems with exporting HBase snapshots to S3. I am running HBase version 1.2.0. I have a table called "domain" And I have created a snapshot for it: hbase(main):003:0> snapshot 'domain', 'domain-aws-test' 0 row(s) in 0.3310 seconds --- I am attempting to

Re: Some regions never get online after a region server crashes

2016-05-04 Thread Shuai Lin
Hi Ted, The hbase version is 1.0.0-cdh5.4.8, shipped with cloudera CDH 5.4.8. The RS logs on node6 can be found here . Thanks! Shuai On Thu, May 5, 2016 at 9:15 AM, Ted Yu wrote: > Can you pastebin related server log w.r.t.

Re: Some regions never get online after a region server crashes

2016-05-04 Thread Ted Yu
Can you pastebin related server log w.r.t. d1c7f3f455f2529da82a2f713b5ee067 from rs-node6 ? Which release of hbase are you using ? Cheers On Wed, May 4, 2016 at 6:07 PM, Shuai Lin wrote: > Hi list, > > Last weekend I got a region server crashed, but some regions never

Some regions never get online after a region server crashes

2016-05-04 Thread Shuai Lin
Hi list, Last weekend I got a region server crashed, but some regions never got online again on other RSes. I've gone through the logs, and here is the timeline about some of the events: * 13:03:50 on of the region server, rs-node7, died because of a disk failure. Master started to split

Re: Does Scan API guarantee key order?

2016-05-04 Thread Ted Yu
Yes, key order is guaranteed. On Wed, May 4, 2016 at 3:20 PM, Dave Birdsall wrote: > Hi, > > > > Suppose I have an HBase table with many regions, and possibly many rows in > the memstore from recent additions. > > > > Suppose I have a program that opens a Scan on the

Does Scan API guarantee key order?

2016-05-04 Thread Dave Birdsall
Hi, Suppose I have an HBase table with many regions, and possibly many rows in the memstore from recent additions. Suppose I have a program that opens a Scan on the table, from start to finish. Full table scan. Does HBase guarantee that rows are returned in key order? Or might it jump

RE: Access cell tags from HBase shell

2016-05-04 Thread benedict.whittamsmith
Thanks guys. I've given it a go with the Java client but without success. I assume I set this property in hbase-site.xml: hbase.client.rpc.codec org.apache.hadoop.hbase.codec.KeyValueCodecWithTags Then I successfully set the labels. But the scan returns nothing new: scan = new

Re: Hbase ACL

2016-05-04 Thread ramkrishna vasudevan
I tried out with the examples already available in the code base. Will try it out on a cluster which I did not have access to today. Will probably have access tomorrow. I was not aware of that 'grant' feature which allows to set permission on all the cells with a specific prefix and on a specific

Re: Hbase ACL

2016-05-04 Thread Tokayer, Jason M.
Hi Ram, Thanks for the reply. I can take a look at that Mutation documentation. But I wanted to first confirm that this works at all, which is why I started in the shell. The docs I’ve been using are here: https://github.com/apache/hbase/blob/master/src/main/asciidoc/_chapters/sec urity.adoc. If

Re: Hbase ACL

2016-05-04 Thread ramkrishna vasudevan
Superuser: grant 'ns1:t1', {'userX' => 'R' }, { COLUMNS => 'cf1', FILTER => "(PrefixFilter ('r2'))" } So you are trying to grant R permission to user-X for a given qualifier. Please not that this is NOT for a given Cell. Reiterating from your first mail >>What I need to be able to do next is to

Re: Hbase ACL

2016-05-04 Thread Tokayer, Jason M.
Hi Ram, Unfortunately, that configuration doesn’t seem to help. I’ve pasted my config followed by the CLI commands I’ve been running so that the issue can be reproduced. CONFIG: hbase.security.authentication simple hbase.security.authorization true