Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
Hi Mohammad, I was following your tutorial and when I got to the part when you do $ bin/start-hbase.sh, this is what I get: http://bin.cakephp.org/view/428090088 I'll keep looking online for an answer, but was I supposed to do something else besides this? This is the contents of my bashrc:

Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
Also, I keep hearing that Java 6 is required. Currently I have Java 7 installed. Is this an issue or do I need to downgrade? On Tue, May 21, 2013 at 9:18 AM, Yves S. Garret yoursurrogate...@gmail.comwrote: Hi Mohammad, I was following your tutorial and when I got to the part when you do $

Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
Ok, it seems to be working now. I changed my environment variables as a result. However, when I try to get the web GUI to work, it doesn't work :) . That's where I'm stuck right now. On Tue, May 21, 2013 at 9:21 AM, Yves S. Garret yoursurrogate...@gmail.comwrote: Also, I keep hearing that

Inconsistent Table HBCK

2013-05-21 Thread Jay Talreja
One of our production clusters had several region server failures. As a result one of the tables is in an inconsistent state as reported by hbck. We have tried using hbck repair commands but none seem to work. There is one region that is stuck in a forever pending open state. The error reported

Help with Read Latency Metrics Interpretation

2013-05-21 Thread amit.mor.m...@gmail.com
I am on EC2, with HBase 0.94.2 and I can't find an explanation to this phenomena: I'm having these metrics on my RegionServers: blockCacheHitRatio=87% fsReadLatencyHistogramMean= 5886103.47 fsReadLatencyHistogramMedian=6280445 fsReadLatencyHistogram75th= 28117916.5 fsReadLatencyHistogram95th=

Re: Help with Read Latency Metrics Interpretation

2013-05-21 Thread Jeremy Carroll
There are more items then data in the BlockCache. There are bloom filters, indexes, and data. You should look at your blockCacheHitCount for each of these item times. You may have a high hit rate on blooms, but low on data for example. The fsReadxxx metrics are for items that read from disk. Not

HBase BoF around Hadoop Summit, San Jose, 2013

2013-05-21 Thread Devaraj Das
I am hosting a meetup on the 25th of June (a day before the Hadoop Summit). People interested in talking about HBase usecases, experience, new features, etc. - please get in touch with me. http://www.meetup.com/hbaseusergroup/events/119154442/

Re: HBase is not running.

2013-05-21 Thread Asaf Mesika
Devving.com has a good tutorial on HBase first setup On Tuesday, May 21, 2013, Yves S. Garret wrote: Hi Mohammad, I was following your tutorial and when I got to the part when you do $ bin/start-hbase.sh, this is what I get: http://bin.cakephp.org/view/428090088 I'll keep looking online

Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
Do you mean this? http://blog.devving.com/hbase-quickstart-guide/ On Tue, May 21, 2013 at 1:29 PM, Asaf Mesika asaf.mes...@gmail.com wrote: Devving.com has a good tutorial on HBase first setup On Tuesday, May 21, 2013, Yves S. Garret wrote: Hi Mohammad, I was following your tutorial

Re: HBase is not running.

2013-05-21 Thread Asaf Mesika
Yes. On May 21, 2013, at 8:32 PM, Yves S. Garret yoursurrogate...@gmail.com wrote: Do you mean this? http://blog.devving.com/hbase-quickstart-guide/ On Tue, May 21, 2013 at 1:29 PM, Asaf Mesika asaf.mes...@gmail.com wrote: Devving.com has a good tutorial on HBase first setup On

How does client connects to Hbase server

2013-05-21 Thread Vimal Jain
Hi, I am newbie to both Hadoop and Hbase technologies. I have setup Hbase properly in Standalone mode. I am unable to understand work flow when a client (Java program accessing Hbase) connects to Hbase Server. Documentations and Books say that the client should have hbase-site.xml in its classpath

Re: How does client connects to Hbase server

2013-05-21 Thread Shahab Yunus
A default hbase-site.xml is provided in all hbase installations. Plus and more importantly, you are running the Standalone mode so there is no need any information regarding zookeeper or HBase Master server. Everything is local. Regards, Shahab On Tue, May 21, 2013 at 1:50 PM, Vimal Jain

Re: How does client connects to Hbase server

2013-05-21 Thread Jean-Daniel Cryans
I guess you are referring to http://hbase.apache.org/book.html#client_dependencies ? The thing is by default hbase.zookeeper.quorum is localhost, so your client will look at your local machine to find HBase if you don't configure anything. J-D On Tue, May 21, 2013 at 10:50 AM, Vimal Jain

Re: What is in BlockCache?

2013-05-21 Thread Jean-Daniel Cryans
The reference guide has a pretty good section about this: http://hbase.apache.org/book.html#block.cache What do you think is missing in order to fully answer your question? Thx, J-D On Mon, May 20, 2013 at 5:07 AM, yun peng pengyunm...@gmail.com wrote: Hi, All, I am wondering what is exactly

Re: HBase is not running.

2013-05-21 Thread Mohammad Tariq
Hey Yves, I am sorry for being unresponsive. I was travelling and was out of reach. What's the current status?Are you good now? Warm Regards, Tariq cloudfront.blogspot.com On Tue, May 21, 2013 at 11:15 PM, Asaf Mesika asaf.mes...@gmail.com wrote: Yes. On May 21, 2013, at 8:32 PM,

Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
Hello, No, still having issues. I'll give you some more details in a second. On Tue, May 21, 2013 at 4:07 PM, Mohammad Tariq donta...@gmail.com wrote: Hey Yves, I am sorry for being unresponsive. I was travelling and was out of reach. What's the current status?Are you good now?

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jay Vyas
#This is my /etc/hosts file --- 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 #::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 127.0.0.1 hbase-master 192.168.122.200 hbase-master 192.168.122.201 hbase-regionserver1 192.168.122.202

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jay Vyas
Thanks, but adding 127.0.0.1 localhost to the top seems redundant... right? I did so but still no luck :(. 1) OS? This is fedora 16. 2) any thoughts on why the PleaseHoldException is being triggered ? On Tue, May 21, 2013 at 4:32 PM, Mohammad Tariq donta...@gmail.com wrote: OS?Add

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Mohammad Tariq
Sorry, my bad. By that I meant 127.0.0.1hostname..To me it seems like HBase is not able to connect to localhost using 127.0.0.1 Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 2:12 AM, Jay Vyas jayunit...@gmail.com wrote: Thanks, but adding 127.0.0.1 localhost to the

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Kevin O'dell
Jay, I am not sure if this is network related, but the host file doesn't look correct. Here is what I would add there: #This is my /etc/hosts file --- 127.0.0.1 localhost.localdomain localhost4 localhost4.localdomain4 localhost #::1 localhost.localdomain localhost6

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jay Vyas
Hi kevin : So you don't have any region servers defined in your /etc/hosts ? On Tue, May 21, 2013 at 4:46 PM, Mohammad Tariq donta...@gmail.com wrote: Sorry, my bad. By that I meant 127.0.0.1hostname..To me it seems like HBase is not able to connect to localhost using 127.0.0.1 Warm

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Kevin O'dell
Hi Jay, I think Gmail is cutting that off for you as it doesn't show duplicate data. Here you go: #This is my /etc/hosts file --- 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 #::1 localhost localhost.localdomain localhost6 localhost6.localdomain6

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Mohammad Tariq
OK..You already have your hostname in there. But it is appearing twice. Comment out 127.0.0.1 hbase-master. This might be a reason. I did not notice that you are on a distributed setup. RS IPs and hostnames are fine. Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 2:21 AM,

ETL tools

2013-05-21 Thread Aji Janis
Hello users, I am interested in hearing about what sort of ETL tools are you using with your cloud based apps. Ideally, I am looking ETL(s) with the following feature: -free (yup) -open-source/community support -handles different types of sources or atleast has plugins may be (email, rss,

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jay Vyas
Hmmm... what do you mean have your hostname in there? sorry -- just curious about which hostname you are referring to...? Im now getting a new exception: 13/05/21 17:02:44 INFO client.HConnectionManager$HConnectionImplementation: getMaster attempt 2 of 7 failed; retrying after sleep of 1002

Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
Hi, sorry, I thought I had more info than what was displayed in my e-mail a little earlier today that had the little list, but I did not. My biggest hangup is getting that Web GUI to work. That's really where I'm stuck. I followed your tutorial on the cloudfront blog and when it came time to go

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jay Vyas
Here is my new /etc/hosts file 127.0.0.1 localhost.localdomain localhost4 localhost4.localdomain4 localhost #::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 #127.0.0.1 hbase-master 192.168.122.200 hbase-master 192.168.122.201 hbase-regionserver1

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Mohammad Tariq
No prob. I was referring to this : 127.0.0.1 hbase-master 192.168.122.200 hbase-master I was thinking that this is your HBase master. Correct me if i'm wrong. Could you please show me your logs? Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 2:36 AM, Jay Vyas

Re: HBase is not running.

2013-05-21 Thread Mohammad Tariq
No issues. Are the HBase daemons running fine?Are you able to initiate anything from the shell? Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 2:37 AM, Yves S. Garret yoursurrogate...@gmail.comwrote: Hi, sorry, I thought I had more info than what was displayed in my

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jay Vyas
https://gist.github.com/anonymous/5623327 -- all logs for starting up hbase and master On Tue, May 21, 2013 at 5:13 PM, Mohammad Tariq donta...@gmail.com wrote: No prob. I was referring to this : 127.0.0.1 hbase-master 192.168.122.200 hbase-master I was thinking that this is your HBase

Re: HBase is not running.

2013-05-21 Thread Yves S. Garret
This is what happens when I start hbase. $ bin/start-hbase.sh starting master, logging to /media/alternative-storage-do-not-touch/hbase-0.94.7/logs/hbase-ysg-master-ysg.connect.out No real problems or error or warnings... but it does not have the same output that you have in your blog... perhaps

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Mohammad Tariq
hmmm...all looks fine to me. we can do a few checks though to make sure everything is in place. start with making sure that all the RSs are properly up. Also make sure HDFS is out of safemode. What does 192.168.122.200:60010 show? Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22,

Re: HBase is not running.

2013-05-21 Thread Mohammad Tariq
Is this the only thing which appears on your screen?Could you please show me your config files? Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 2:49 AM, Yves S. Garret yoursurrogate...@gmail.comwrote: This is what happens when I start hbase. $ bin/start-hbase.sh

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jean-Daniel Cryans
I see: 2013-05-21 17:15:07,914 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_FAILED_OPEN, server=hbase-regionserver1,60020,1369170595340, region=70236052/-ROOT- Over and over. Look in the region server logs, you should see fat stack traces on why it's

Re: HBase is not running.

2013-05-21 Thread Jay Vyas
Here is my conf file.I wonder if maybe the problem is intercommunication between region servers? configuration property namehbase.master/name valuehbase-master:6/value

querying hbase

2013-05-21 Thread Aji Janis
are there any tools out there that can help in visualizing data stored in Hbase? I know the shell lets you do basic stuff. But if I don't know what rowid I am looking for or if I want to rows with family say *name* (yes SQL like) are there any tools that can help with this? Not trying to use this

Re: querying hbase

2013-05-21 Thread Viral Bajaria
The shell allows you to use filters just like the standard HBase API but with jruby syntax. Have you tried that or that is too painful and you want a simpler tool ? -Viral On Tue, May 21, 2013 at 2:58 PM, Aji Janis aji1...@gmail.com wrote: are there any tools out there that can help in

Re: querying hbase

2013-05-21 Thread Aji Janis
I haven't tried that because I don't know how to. Still I think I am looking for a nice GUI interface that can take in HBase connection info and help me view the data something like pgadmin (or its php version), sql developer, etc On Tue, May 21, 2013 at 6:16 PM, Viral Bajaria

Re: PleaseHoldException when Master is clearly running as JPS

2013-05-21 Thread Jay Vyas
Hi again ! Well.. to make this easier, Ive created a script which greps the hotspots in log files out and cleans them, restarting the entire cluster. Overall, it appears that my region servers cant see my hbase-master due to closed connections, or something of that sort. These errors are

hbase region server shutdown after datanode connection exception

2013-05-21 Thread Cheng Su
Hi all. I have a small hbase cluster with 3 physical machines. On 192.168.1.80, there are HMaster and a region server. On 81 82, there is a region server on each. The region server on 80 can't sync HLog after a datanode access exception, and started to shutdown.

Re: Inconsistent Table HBCK

2013-05-21 Thread Jean-Marc Spaggiari
Hi Jay, Which 0.94 version are you running? 0.94.0? Or 0.94.7? JM 2013/5/21 Jay Talreja jay.talr...@oracle.com One of our production clusters had several region server failures. As a result one of the tables is in an inconsistent state as reported by hbck. We have tried using hbck repair

Re: querying hbase

2013-05-21 Thread lars hofhansl
Maybe Phoenix (http://phoenix-hbase.blogspot.com/) is what you are looking for. -- Lars From: Aji Janis aji1...@gmail.com To: user user@hbase.apache.org Sent: Tuesday, May 21, 2013 3:43 PM Subject: Re: querying hbase I haven't tried that because I don't know

Re: querying hbase

2013-05-21 Thread Jean-Marc Spaggiari
Using Phoenix for that is like trying to kill a mosquito with an atomic bomb, no? ;) Few easy to install and use tools which I already tried: - http://sourceforge.net/projects/haredbhbaseclie/files/ - http://sourceforge.net/projects/hbasemanagergui/ - https://github.com/NiceSystems/hrider/wiki