Not really. As far as I know it's not possible to run HBase with CDH
yet. I believe Lars is planning to fix this for the 0.5.0 release. If
you remove the last to lines you should have an working cluster.
Is strange that you are seeing some SSH related exceptions.
I have attached bellow the property file Whirr 0.4.0 uses for
integration testing. You need something very similar.
whirr.cluster-name=hbaseclustertest
whirr.instance-templates=1 zookeeper,1
hadoop-namenode+hadoop-jobtracker+hbase-master,1 hbase-restserver,1
hadoop-datanode+hadoop-tasktracker+hbase-regionserver
whirr.provider=${sys:whirr.test.provider}
whirr.identity=${sys:whirr.test.identity}
whirr.credential=${sys:whirr.test.credential}
whirr.private-key-file=${sys:user.home}/.ssh/id_rsa
# enforce large instance during the test
whirr.hardware-id=m1.large
# Ubuntu 10.04 LTS Lucid instance-store - see http://alestic.com/
whirr.image-id=us-east-1/ami-da0cf8b3
whirr.location-id=us-east-1
whirr.hbase.tarball.url=http://archive.apache.org/dist/hbase/hbase-0.89.20100924/hbase-0.89.20100924-bin.tar.gz
I hope this helps.
Cheers,
-- Andrei Savu
On Fri, Feb 25, 2011 at 8:49 PM, Saptarshi Guha
<saptar...@revolutionanalytics.com> wrote:
> Hello,
> Does this configuration work for Whirr 0.4 (svn checked out today).
> I am basing this on a note
> in https://issues.apache.org/jira/browse/WHIRR-223.
> But i get this error (property file at end)
>
> #### ERRORS ###########
> org.jclouds.ssh.SshException: ubuntu@184.72.88.68:22: Error connecting to
> session.
> at org.jclouds.ssh.jsch.JschSshClient.propagate(JschSshClient.java:250)
> at org.jclouds.ssh.jsch.JschSshClient.connect(JschSshClient.java:200)
> at
> org.jclouds.compute.util.ComputeUtils.runCallablesOnNode(ComputeUtils.java:202)
> at
> org.jclouds.compute.util.ComputeUtils.runOptionsOnNode(ComputeUtils.java:151)
> at org.jclouds.compute.util.ComputeUtils$1.call(ComputeUtils.java:116)
> at org.jclouds.compute.util.ComputeUtils$1.call(ComputeUtils.java:112)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:680)
> Caused by: com.jcraft.jsch.JSchException: java.net.ConnectException:
> Connection refused
> at com.jcraft.jsch.Util.createSocket(Util.java:386)
> at com.jcraft.jsch.Session.connect(Session.java:182)
> at com.jcraft.jsch.Session.connect(Session.java:150)
> at org.jclouds.ssh.jsch.JschSshClient.newSession(JschSshClient.java:245)
> at org.jclouds.ssh.jsch.JschSshClient.connect(JschSshClient.java:184)
> ... 9 more
> Exception in thread "main" java.io.IOException:
> java.util.concurrent.ExecutionException:
> org.jclouds.compute.RunNodesException: error running 1 node tag(revotesting)
> location(us-east-1) image(ami-99df3ff0) size(c1.xlarge)
> options([groupIds=[], keyPair=null, noKeyPair=false, placementGroup=null,
> noPlacementGroup=false, monitoringEnabled=false, inboundPorts=[22],
> privateKey=true, publicKey=true, runScript=true, port:seconds=-1:-1,
> subnetId=null, metadata/details: false])
> Execution failures:
> 0 error[s]
> Node failures:
> 1) SshException on node us-east-1/i-491c3325:
> org.jclouds.ssh.SshException: ubuntu@184.72.88.68:22: Error connecting to
> session.
> at org.jclouds.ssh.jsch.JschSshClient.propagate(JschSshClient.java:250)
> at org.jclouds.ssh.jsch.JschSshClient.connect(JschSshClient.java:200)
> at
> org.jclouds.compute.util.ComputeUtils.runCallablesOnNode(ComputeUtils.java:202)
> at
> org.jclouds.compute.util.ComputeUtils.runOptionsOnNode(ComputeUtils.java:151)
> at org.jclouds.compute.util.ComputeUtils$1.call(ComputeUtils.java:116)
> at org.jclouds.compute.util.ComputeUtils$1.call(ComputeUtils.java:112)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:680)
> Caused by: com.jcraft.jsch.JSchException: java.net.ConnectException:
> Connection refused
> at com.jcraft.jsch.Util.createSocket(Util.java:386)
> at com.jcraft.jsch.Session.connect(Session.java:182)
> at com.jcraft.jsch.Session.connect(Session.java:150)
> at org.jclouds.ssh.jsch.JschSshClient.newSession(JschSshClient.java:245)
> at org.jclouds.ssh.jsch.JschSshClient.connect(JschSshClient.java:184)
> ... 9 more
>
> 1 error[s]
> at
> org.apache.whirr.cluster.actions.BootstrapClusterAction.doAction(BootstrapClusterAction.java:122)
> at
> org.apache.whirr.cluster.actions.ScriptBasedClusterAction.execute(ScriptBasedClusterAction.java:74)
> at org.apache.whirr.service.Service.launchCluster(Service.java:71)
> at
> org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:61)
> at org.apache.whirr.cli.Main.run(Main.java:66)
> at org.apache.whirr.cli.Main.main(Main.java:102)
> Caused by: java.util.concurrent.ExecutionException:
> org.jclouds.compute.RunNodesException: error running 1 node tag(revotesting)
> location(us-east-1) image(ami-99df3ff0) size(c1.xlarge)
> options([groupIds=[], keyPair=null, noKeyPair=false, placementGroup=null,
> noPlacementGroup=false, monitoringEnabled=false, inboundPorts=[22],
> privateKey=true, publicKey=true, runScript=true, port:seconds=-1:-1,
> subnetId=null, metadata/details: false])
> Execution failures:
> 0 error[s]
> Node failures:
> 1) SshException on node us-east-1/i-491c3325:
> org.jclouds.ssh.SshException: ubuntu@184.72.88.68:22: Error connecting to
> session.
> at org.jclouds.ssh.jsch.JschSshClient.propagate(JschSshClient.java:250)
> at org.jclouds.ssh.jsch.JschSshClient.connect(JschSshClient.java:200)
> at
> org.jclouds.compute.util.ComputeUtils.runCallablesOnNode(ComputeUtils.java:202)
> at
> org.jclouds.compute.util.ComputeUtils.runOptionsOnNode(ComputeUtils.java:151)
> at org.jclouds.compute.util.ComputeUtils$1.call(ComputeUtils.java:116)
> at org.jclouds.compute.util.ComputeUtils$1.call(ComputeUtils.java:112)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:680)
> Caused by: com.jcraft.jsch.JSchException: java.net.ConnectException:
> Connection refused
> at com.jcraft.jsch.Util.createSocket(Util.java:386)
> at com.jcraft.jsch.Session.connect(Session.java:182)
> at com.jcraft.jsch.Session.connect(Session.java:150)
> at org.jclouds.ssh.jsch.JschSshClient.newSession(JschSshClient.java:245)
> at org.jclouds.ssh.jsch.JschSshClient.connect(JschSshClient.java:184)
> ... 9 more
>
> 1 error[s]
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at
> org.apache.whirr.cluster.actions.BootstrapClusterAction.doAction(BootstrapClusterAction.java:118)
> ... 5 more
> Caused by: org.jclouds.compute.RunNodesException: error running 1 node
> tag(revotesting) location(us-east-1) image(ami-99df3ff0) size(c1.xlarge)
> options([groupIds=[], keyPair=null, noKeyPair=false, placementGroup=null,
> noPlacementGroup=false, monitoringEnabled=false, inboundPorts=[22],
> privateKey=true, publicKey=true, runScript=true, port:seconds=-1:-1,
> subnetId=null, metadata/details: false])
> Execution failures:
> 0 error[s]
> Node failures:
> 1) SshException on node us-east-1/i-491c3325:
> org.jclouds.ssh.SshException: ubuntu@184.72.88.68:22: Error connecting to
> session.
> at org.jclouds.ssh.jsch.JschSshClient.propagate(JschSshClient.java:250)
> at org.jclouds.ssh.jsch.JschSshClient.connect(JschSshClient.java:200)
> at
> org.jclouds.compute.util.ComputeUtils.runCallablesOnNode(ComputeUtils.java:202)
> at
> org.jclouds.compute.util.ComputeUtils.runOptionsOnNode(ComputeUtils.java:151)
> at org.jclouds.compute.util.ComputeUtils$1.call(ComputeUtils.java:116)
> at org.jclouds.compute.util.ComputeUtils$1.call(ComputeUtils.java:112)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:680)
> Caused by: com.jcraft.jsch.JSchException: java.net.ConnectException:
> Connection refused
> at com.jcraft.jsch.Util.createSocket(Util.java:386)
> at com.jcraft.jsch.Session.connect(Session.java:182)
> at com.jcraft.jsch.Session.connect(Session.java:150)
> at org.jclouds.ssh.jsch.JschSshClient.newSession(JschSshClient.java:245)
> at org.jclouds.ssh.jsch.JschSshClient.connect(JschSshClient.java:184)
> ... 9 more
>
> 1 error[s]
> at
> org.jclouds.compute.internal.BaseComputeService.runNodesWithTag(BaseComputeService.java:162)
> at
> org.apache.whirr.cluster.actions.BootstrapClusterAction$1.call(BootstrapClusterAction.java:103)
> at
> org.apache.whirr.cluster.actions.BootstrapClusterAction$1.call(BootstrapClusterAction.java:98)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:680)
> petrichor:whirr0.4 yanger [master] $
>
>
> ########### properties ###################
> whirr.cluster-name=revotesting
> whirr.service-name=hadoop
> whirr.instance-templates=1 zookeeper, 1
> hadoop-namenode+hadoop-jobtracker+hbase-master,2
> hadoop-datanode+hadoop-tasktracker+hbase-regionserver
> whirr.provider=ec2
> whirr.location-id=us-east-1
> whirr.hardware-id=c1.xlarge
> whirr.hadoop-install-runurl=cloudera/cdh/install
> whirr.hadoop-configure-runurl=cloudera/cdh/post-configure
>
>
