HBase Snapshots as backup solution

2013-05-09 Thread Samir Ahmic
Hi all, We are using hbase-0.94.6.1 and at moment i'm evaluation Snapshots as backup solution for moving data between clusters. I'm wondering if someone have similar experience and what are pros and cons ? Also is Snapshot future stable enough for this sort of operation ? Thanks, Samir

Secure HBase upon Replication

2013-05-09 Thread Asaf Mesika
Hi, I know that HBase supports secure RPC between its nodes (Master, Region Server). I have couple of questions about it: 1. Does HBase supports secure RPC between Master and Slave replications? 2. Does enabling security in HBase entails using the latest hbase security branch? 3. Suppose the

Re: Secure HBase upon Replication

2013-05-09 Thread ramkrishna vasudevan
Does enabling security in HBase entails using the latest hbase security branch? Which branch are you using? Once you enable security the security feature on that branch starts working. 3. Suppose the only requirement I have is securing the RPC in between Master and Slave sites, do I must have

Re: HBase Snapshots as backup solution

2013-05-09 Thread Matteo Bertozzi
Hi, Could you describe a bit more what do you need by a backup, what do you expect by it and what is your data flow? A snapshot at the moment can guarantee just row level consistency. This means that if you have in-flight writes some can be present in the snapshot some not. so, The best type of

Re: Secure HBase upon Replication

2013-05-09 Thread Asaf Mesika
On Thu, May 9, 2013 at 11:43 AM, ramkrishna vasudevan ramkrishna.s.vasude...@gmail.com wrote: Does enabling security in HBase entails using the latest hbase security branch? Which branch are you using? Once you enable security the security feature on that branch starts working. If security

Re: EC2 Elastic MapReduce HBase install recommendations

2013-05-09 Thread Pal Konyves
Principally I chose to use Amazon, because they are supposedly high performance, and what more important is: HBase is already set up if I chose it as an EMR Workflow. I wanted to save up the time setting up the cluster manually on EC2 instances. Are you saying I will reach higher performance when

Re: Secure HBase upon Replication

2013-05-09 Thread Andrew Purtell
There is no separate branch for security features, they are integrated in 0.92 and 0.94. We did partition the security sources into a separate Maven module for 0.92 and 0.94, out of an abundance of caution during development of security features. (Some versions of Hadoop, e.g. 0.20, don't have the

Re: Secure HBase upon Replication

2013-05-09 Thread ramkrishna vasudevan
If security is a feature, why HBase are releasing two version each time. For instance 0.94.7 and 0.94.7-security? For the 0.94 versions you need to use the tar ball that has security in it. In trunk it is not so. I should have been clear on it. So Andy has sent the mail in more detail. Incase

Re: EC2 Elastic MapReduce HBase install recommendations

2013-05-09 Thread Michel Segel
What I am saying is that by default, you get two mappers per node. x4large can run HBase w more mapred slots, so you will want to tune the defaults based on machine size. Not just mapred, but also HBase stuff too. You need to do this on startup of EMR cluster though... Sent from a remote

HBase Support

2013-05-09 Thread raju
Hi all, I am New to Hbase(Hadoop), and i am working on hbase with standalone mode.My application running well for some time, after that it displays INFO zookeeper.ClientCnxn: Client session timed out, have not heard from server in 29946ms for sessionid 0x13e88be25cc0004, closing socket

Re: HBase Support

2013-05-09 Thread Mohammad Tariq
Hello Raju, Please find my answers embedded below : 1.what are the causes of Client session timed out.(and client session scenario) There could be several reasons. You network is totally down, you have exceeded the maximum no. of clients allowed at a time, you are facing network

Hbase Guidance.

2013-05-09 Thread naga raju
Hi all, I am New to Hbase(Hadoop), and i am working on hbase with standalone mode.My java application running well for some time, after that it displays INFO zookeeper.ClientCnxn: Client session timed out, have not heard from server in 29946ms for sessionid 0x13e88be25cc0004, closing socket

Re: Hbase Guidance.

2013-05-09 Thread Mohammad Tariq
I don't get the logic behind asking the same question multiple times with different names. Warm Regards, Tariq cloudfront.blogspot.com On Thu, May 9, 2013 at 6:30 PM, naga raju rajumudd...@gmail.com wrote: Hi all, I am New to Hbase(Hadoop), and i am working on hbase with standalone

Re: failed to create table using hbase shell

2013-05-09 Thread Ted Yu
Can you tell us the exact release of 0.94 that you're using ? Check master log to see if there was any clue. You can pastebin log snippet for us to see. Cheers On Thu, May 9, 2013 at 9:10 AM, huaxiang huaxi...@asiainfo-linkage.comwrote: HI, We are using hbase 0.94, but today I find I

答复: failed to create table using hbase shell

2013-05-09 Thread huaxiang
The hbase verison is 0.94.2-cdh4.2.0, r, from CDH. Below is master log: 2013-05-10 00:04:03,066 WARN org.apache.hadoop.conf.Configuration: fs.default.name is deprecated. Instead, use fs.defaultFS 2013-05-10 00:04:04,729 WARN org.apache.hadoop.conf.Configuration: fs.default.name is deprecated.

Re: 答复: failed to create table using hbase shell

2013-05-09 Thread Ted Yu
Was there any error / exception returned from table creation command in shell ? Was the log snippet below at around the time when you saw the error ? Cheers On Thu, May 9, 2013 at 9:30 AM, huaxiang huaxi...@asiainfo-linkage.comwrote: The hbase verison is 0.94.2-cdh4.2.0, r, from CDH. Below

Re: 答复: failed to create table using hbase shell

2013-05-09 Thread hua beatls
no messages shown, just stuck there.. nothing shown. On Fri, May 10, 2013 at 12:34 AM, Ted Yu yuzhih...@gmail.com wrote: Was there any error / exception returned from table creation command in shell ? Was the log snippet below at around the time when you saw the error ? Cheers On

答复: 答复: failed to create table using hbase shell

2013-05-09 Thread huaxiang
Cannot disable a table either. Thanks! beatls -邮件原件- 发件人: hua beatls [mailto:bea...@gmail.com] 发送时间: 2013年5月10日 0:40 收件人: user@hbase.apache.org 主题: Re: 答复: failed to create table using hbase shell no messages shown, just stuck there.. nothing shown. On Fri, May 10, 2013 at

答复: 答复: failed to create table using hbase shell

2013-05-09 Thread huaxiang
Seem all the 'ddl' command cannot work. Only hbase 'dml' command can work. -邮件原件- 发件人: hua beatls [mailto:bea...@gmail.com] 发送时间: 2013年5月10日 0:40 收件人: user@hbase.apache.org 主题: Re: 答复: failed to create table using hbase shell no messages shown, just stuck there.. nothing

Re: 答复: failed to create table using hbase shell

2013-05-09 Thread hua beatls
when i hit table -ROOT- , detailed information shown, but when hitting table '.META.', stucking. [image: Inline image 4] On Fri, May 10, 2013 at 12:39 AM, hua beatls bea...@gmail.com wrote: no messages shown, just stuck there.. nothing shown. On Fri, May 10, 2013 at 12:34 AM, Ted Yu

Re: 答复: 答复: failed to create table using hbase shell

2013-05-09 Thread Ted Yu
Is your hadoop / HBase cluster setup in secure mode ? Cheers On Thu, May 9, 2013 at 9:49 AM, huaxiang huaxi...@asiainfo-linkage.comwrote: Seem all the 'ddl' command cannot work. Only hbase 'dml' command can work. -邮件原件- 发件人: hua beatls [mailto:bea...@gmail.com] 发送时间:

Re: failed to create table using hbase shell

2013-05-09 Thread Michael Segel
What do you get when you enter the status command? (status 'simple' or just status should be sufficient.) Just because you can start the HBase Shell doesn't mean that the cluster is up and running properly. On May 9, 2013, at 11:49 AM, huaxiang huaxi...@asiainfo-linkage.com wrote: Seem

Re: failed to create table using hbase shell

2013-05-09 Thread hua beatls
@Ted: not in secure mode; @Michael: hbase status hbase(main):001:0 status SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/app/hbase/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in

Canonical dependency for hbase client

2013-05-09 Thread Elazar Leibovich
When someone wants to use HBase's client library, which dependency should he use? Using: dependency groupIdorg.apache.hbase/groupId artifactIdhbase/artifactId version${hbase.version}/version /dependency Is not good enough, because it will grab all

Re: Secure HBase upon Replication

2013-05-09 Thread Asaf Mesika
Thank you for the detailed answer. Regarding my 1st question - RPC for replication between master and slave region servers is secured the same as RPC between region servers in the same clusters? Is there a mechanism for exchanging keys between the master and slave clusters? On Thursday, May 9,

Re: HBase Support

2013-05-09 Thread Amandeep Khurana
Are you running HBase on your local development box or on some server outside and trying to connect to it from your dev box? On Thu, May 9, 2013 at 6:36 AM, raju rajumudd...@gmail.com wrote: Hi all, I am New to Hbase(Hadoop), and i am working on hbase with standalone mode.My application

RE: How to implement this check put and then update something logic?

2013-05-09 Thread Liu, Raymond
Any suggestion? Hi Say, I have four field for one record :id, status, targetid, and count. Status is on and off, target could reference other id, and count will record the number of on status for all targetid from same id. The record could be add / delete, or

Re: How to implement this check put and then update something logic?

2013-05-09 Thread Mike Axiak
You can do this by looping over a checkAndPut operation until it succeeds. -Mike On Thu, May 9, 2013 at 8:52 PM, Liu, Raymond raymond@intel.com wrote: Any suggestion? Hi Say, I have four field for one record :id, status, targetid, and count. Status is on and off, target

Re: HBase Support

2013-05-09 Thread naga raju
I am running hbase on same(single) system which i am using to development. On Fri, May 10, 2013 at 6:19 AM, Amandeep Khurana ama...@gmail.com wrote: Are you running HBase on your local development box or on some server outside and trying to connect to it from your dev box? On Thu, May 9,

Re: HBase Support

2013-05-09 Thread naga raju
Thanks Tariq. I have already set zookeeper.session.timeout in hbase-default.xml as: property namezookeeper.session.timeout/name value18/value descriptionZooKeeper session timeout. HBase passes this to the zk quorum as suggested maximum time for a session (This

Re: HBase Support

2013-05-09 Thread Amandeep Khurana
What do the HBase logs say? Can you access the web UI? On Thu, May 9, 2013 at 9:57 PM, naga raju rajumudd...@gmail.com wrote: I am running hbase on same(single) system which i am using to development. On Fri, May 10, 2013 at 6:19 AM, Amandeep Khurana ama...@gmail.com wrote: Are you

Re: HBase Support

2013-05-09 Thread naga raju
Thanks for the Reply Amandeep, I can access the web UI. On Fri, May 10, 2013 at 10:52 AM, Amandeep Khurana ama...@gmail.com wrote: What do the HBase logs say? Can you access the web UI? On Thu, May 9, 2013 at 9:57 PM, naga raju rajumudd...@gmail.com wrote: I am running hbase on

Re: HBase Support

2013-05-09 Thread Amandeep Khurana
Can you tell what the logs are saying? Did you try to restart your application? On Thu, May 9, 2013 at 10:36 PM, naga raju rajumudd...@gmail.com wrote: Thanks for the Reply Amandeep, I can access the web UI. On Fri, May 10, 2013 at 10:52 AM, Amandeep Khurana ama...@gmail.com wrote:

Re: HBase Support

2013-05-09 Thread naga raju
Thanks for your Guidance Amandeep, I can re-start my application and which logs i have to check. Thank Regards Raju. On Fri, May 10, 2013 at 11:07 AM, Amandeep Khurana ama...@gmail.com wrote: Can you tell what the logs are saying? Did you try to restart your application? On Thu, May 9,