Jim, We know there are a number of pending issues related to Whirr and HBase and we are working to fix them. Matching versions is difficult (Bigtop should address some of those issues).
The following patch could also be useful to you: https://issues.apache.org/jira/browse/WHIRR-334 There is still a service start race condition that we need to address before committing (e.g. the HBase region server does not start if HDFS is not available). I'm working on some of the issues so let me know if is there anything I can do to help you with this. Cheers, -- Andrei Savu / andreisavu.ro On Tue, Jul 5, 2011 at 10:33 AM, Jim R. Wilson <wilson.ji...@gmail.com> wrote: > Ok, so, I found an email thread on the HBase users list where somebody had > the same problem, which in turn lead me to this: > http://hbase.apache.org/notsoquick.html#hadoop > From the article (emphasis mine): > Currently only the branch-0.20-append branch has this attribute. No official > releases have been made from this branch up to now so you will have to build > your own Hadoop from the tip of this branch... Because HBase depends on > Hadoop, it bundles an instance of the Hadoop jar under its lib directory. > The bundled Hadoop was made from the Apache branch-0.20-append branch at the > time of this HBase's release. It is critical that the version of Hadoop that > is out on your cluster matches what is Hbase match. Replace the hadoop jar > found in the HBase lib directory with the hadoop jar you are running out on > your cluster to avoid version mismatch issues. > So the problem is that the released version of HBase (0.90.3) contains an > unreleased version of hadoop 0.20.2 with append (r1056497) but the released > version of hadoop 0.20.2 that Whirr uses (r911707) is different. > It seems therefore that I (myself) have to roll my own hadoop 0.20.2 with > append at the hbase 0.90.3 level, then put this on a publicly available http > server, and use it in my .properties file. > Is there a Whirr-based alternative? That is, can I somehow tell Whirr to > use the hadoop bundled with HBase instead of the normal 0.20.2 version it > would download? > Thanks in advance, > -- Jim > > On Tue, Jul 5, 2011 at 1:15 PM, Jim R. Wilson <wilson.ji...@gmail.com> > wrote: >> >> More details: >> When I SSH into the hbase master node and use the HBase shell to ask for >> the cluster status, I get this: >> hbase(main):001:0> status >> ERROR: org.apache.hadoop.hbase.MasterNotRunningException: null >> Digging into the hbase error log, I see this when I try to start hbase on >> the master: >> 2011-07-05 17:12:50,995 INFO >> org.apache.hadoop.hbase.master.ActiveMasterManager: >> Master=ip-10-72-53-214.ec2.internal:60000 >> 2011-07-05 17:12:51,263 FATAL org.apache.hadoop.hbase.master.HMaster: >> Unhandled exception. Starting shutdown. >> org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol >> org.apache.hadoop.hdfs.protocol.ClientProtocol version mismatch. (client = >> 42, server = 41) >> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:364) >> at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:113) >> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:215) >> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:177) >> at >> org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82) >> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378) >> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66) >> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390) >> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196) >> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:175) >> at org.apache.hadoop.hbase.util.FSUtils.getRootDir(FSUtils.java:344) >> at >> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:81) >> at >> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:347) >> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:283) >> 2011-07-05 17:12:51,266 INFO org.apache.hadoop.hbase.master.HMaster: >> Aborting >> 2011-07-05 17:12:51,266 DEBUG org.apache.hadoop.hbase.master.HMaster: >> Stopping service threads >> 2011-07-05 17:12:51,266 INFO org.apache.hadoop.ipc.HBaseServer: Stopping >> server on 60000 >> Next I'll try explicitly setting the hadoop version... >> -- Jim >> On Tue, Jul 5, 2011 at 8:48 AM, Jim R. Wilson <wilson.ji...@gmail.com> >> wrote: >>> >>> Hi Whirrers, >>> Has anyone successfully run the latest HBase (0.90.3) with the latest >>> version of Whirr (0.5.0)? >>> I'm getting an error about the Master not running when I try to launch >>> the shell. This happens both from my localhost over the tunnel, and >>> directly within the master node from an SSH session. Executing >>> bin/start-hbase.sh doesn't seem to bring it up. >>> Thanks in advance for any help, >>> -- Jim R Wilson (jimbojw) > >
