Moving this on the email list. A few questions:
* are you running Whirr from a local machine or from a VM inside Amazon? What user? * have you added something like whirr.cluster-user=whirr to hadoop.properties? -- Andrei Savu / andreisavu.ro On Wed, Jan 4, 2012 at 1:40 AM, Michael David (Commented) (JIRA) < [email protected]> wrote: > > [ > https://issues.apache.org/jira/browse/WHIRR-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179133#comment-13179133] > > Michael David commented on WHIRR-378: > ------------------------------------- > > Hi Andrei - Just tried with 0.7.0 and am getting new errors: > > Instead of using the properties file, I tried to invoke keys in command > line instead using the tuorial here: > http://whirr.apache.org/docs/0.7.0/whirr-in-5-minutes.html > > ./whirr launch-cluster --config hadoop.properties --private-key-file > ~/.ssh/id_rsa_whirr --public-key-file ~/.ssh/id_rsa_whirr.pub > > It seems that I'm not getting a different set of auth errors: > > Dying because - net.schmizz.sshj.transport.TransportException: Broken > transport; encountered EOF > Dying because - net.schmizz.sshj.transport.TransportException: Broken > transport; encountered EOF > <<kex done>> woke to: net.schmizz.sshj.transport.TransportException: > Broken transport; encountered EOF > << (USER:rsa[fingerprint(FINGERPRINT),sha1(SHA1)]@xx.xx.xx.xx:22) error > acquiring SSHClient(timeout=60000): Broken transport; encountered EOF > net.schmizz.sshj.transport.TransportException: Broken transport; > encountered EOF > at net.schmizz.sshj.transport.Reader.run(Reader.java:70) > <<authenticated>> woke to: net.schmizz.sshj.userauth.UserAuthException: > publickey auth failed > << (USER:rsa[fingerprint(FINGERPRINT),sha1(SHA1)]@xx.xx.xx:22) error > acquiring SSHClient(timeout=60000): exception not retryable > net.schmizz.sshj.userauth.UserAuthException: Exhausted available > authentication methods > at > net.schmizz.sshj.userauth.UserAuthImpl.authenticate(UserAuthImpl.java:114) > at net.schmizz.sshj.SSHClient.auth(SSHClient.java:204) > at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:304) > at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:323) > at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:199) > at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:171) > at org.jclouds.sshj.SshjSshClient.acquire(SshjSshClient.java:220) > at org.jclouds.sshj.SshjSshClient.connect(SshjSshClient.java:255) > at > org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.call(RunScriptOnNodeAsInitScriptUsingSsh.java:89) > at > org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:150) > at > org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:57) > at > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:636) > Caused by: net.schmizz.sshj.userauth.UserAuthException: publickey auth > failed > at > net.schmizz.sshj.userauth.UserAuthImpl.handle(UserAuthImpl.java:157) > at > net.schmizz.sshj.transport.TransportImpl.handle(TransportImpl.java:474) > at net.schmizz.sshj.transport.Decoder.decode(Decoder.java:127) > at net.schmizz.sshj.transport.Decoder.received(Decoder.java:195) > at net.schmizz.sshj.transport.Reader.run(Reader.java:72) > > << problem applying options to node(us-east-1/i-xxxxxe): > org.jclouds.rest.AuthorizationException: > (USER:rsa[fingerprint(RSA),sha1(SHA)]@xx.xx.xx:22) > (USER:rsa[fingerprint(RSA),sha1(SHA1)]@xx.xx.xx:22) error acquiring > SSHClient(timeout=60000): Exhausted available authentication methods > at org.jclouds.sshj.SshjSshClient.propagate(SshjSshClient.java:413) > at org.jclouds.sshj.SshjSshClient.acquire(SshjSshClient.java:244) > at org.jclouds.sshj.SshjSshClient.connect(SshjSshClient.java:255) > at > org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.call(RunScriptOnNodeAsInitScriptUsingSsh.java:89) > at > org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:150) > at > org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:57) > at > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:636) > Caused by: net.schmizz.sshj.userauth.UserAuthException: Exhausted > available authentication methods > at > net.schmizz.sshj.userauth.UserAuthImpl.authenticate(UserAuthImpl.java:114) > at net.schmizz.sshj.SSHClient.auth(SSHClient.java:204) > at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:304) > at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:323) > at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:199) > at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:171) > at org.jclouds.sshj.SshjSshClient.acquire(SshjSshClient.java:220) > ... 9 more > Caused by: net.schmizz.sshj.userauth.UserAuthException: publickey auth > failed > at > net.schmizz.sshj.userauth.UserAuthImpl.handle(UserAuthImpl.java:157) > at > net.schmizz.sshj.transport.TransportImpl.handle(TransportImpl.java:474) > at net.schmizz.sshj.transport.Decoder.decode(Decoder.java:127) > at net.schmizz.sshj.transport.Decoder.received(Decoder.java:195) > at net.schmizz.sshj.transport.Reader.run(Reader.java:72) > <<authenticated>> woke to: net.schmizz.sshj.userauth.UserAuthException: > publickey auth failed > << (USER:rsa[fingerprint(RSA),sha1(SHA1)]@xx.xxx.xx:22) error acquiring > SSHClient(timeout=60000): exception not retryable > net.schmizz.sshj.userauth.UserAuthException: Exhausted available > authentication methods > at > net.schmizz.sshj.userauth.UserAuthImpl.authenticate(UserAuthImpl.java:114) > at net.schmizz.sshj.SSHClient.auth(SSHClient.java:204) > at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:304) > at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:323) > at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:199) > at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:171) > at org.jclouds.sshj.SshjSshClient.acquire(SshjSshClient.java:220) > at org.jclouds.sshj.SshjSshClient.connect(SshjSshClient.java:255) > at > org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.call(RunScriptOnNodeAsInitScriptUsingSsh.java:89) > at > org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:150) > at > org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:57) > at > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:636) > Caused by: net.schmizz.sshj.userauth.UserAuthException: publickey auth > failed > at > net.schmizz.sshj.userauth.UserAuthImpl.handle(UserAuthImpl.java:157) > at > net.schmizz.sshj.transport.TransportImpl.handle(TransportImpl.java:474) > at net.schmizz.sshj.transport.Decoder.decode(Decoder.java:127) > at net.schmizz.sshj.transport.Decoder.received(Decoder.java:195) > at net.schmizz.sshj.transport.Reader.run(Reader.java:72) > << (USER:rsa[fingerprint(RSA),sha1(SHA1)]@xx.xx.xx:22) error acquiring > SSHClient(timeout=60000): Exhausted available authentication methods > net.schmizz.sshj.userauth.UserAuthException: Exhausted available > authentication methods > at > net.schmizz.sshj.userauth.UserAuthImpl.authenticate(UserAuthImpl.java:114) > at net.schmizz.sshj.SSHClient.auth(SSHClient.java:204) > at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:304) > at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:323) > at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:199) > at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:171) > at org.jclouds.sshj.SshjSshClient.acquire(SshjSshClient.java:220) > at org.jclouds.sshj.SshjSshClient.connect(SshjSshClient.java:255) > at > org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.call(RunScriptOnNodeAsInitScriptUsingSsh.java:89) > at > org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:150) > at > org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:57) > at > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:636) > Caused by: net.schmizz.sshj.userauth.UserAuthException: publickey auth > failed > at > net.schmizz.sshj.userauth.UserAuthImpl.handle(UserAuthImpl.java:157) > at > net.schmizz.sshj.transport.TransportImpl.handle(TransportImpl.java:474) > at net.schmizz.sshj.transport.Decoder.decode(Decoder.java:127) > at net.schmizz.sshj.transport.Decoder.received(Decoder.java:195) > at net.schmizz.sshj.transport.Reader.run(Reader.java:72) > > Thanks - really appreciate your speedy answers here! > > > > Auth fail when creating a cluster from an EC2 instance > > ------------------------------------------------------ > > > > Key: WHIRR-378 > > URL: https://issues.apache.org/jira/browse/WHIRR-378 > > Project: Whirr > > Issue Type: Bug > > Components: service/hadoop > > Affects Versions: 0.6.0 > > Reporter: Marc de Palol > > Assignee: Adrian Cole > > Priority: Critical > > Fix For: 0.8.0 > > > > Attachments: run-test.sh, setup-whirr.sh > > > > > > There is a ssh auth problem when creating a hadoop cluster from an EC2 > ubuntu instance. > > I've been using the same configuration file from an EC2 computer an a > physical one, everything works fine in the physical one, but I keep getting > this error in EC2: > > Running configuration script on nodes: [us-east-1/i-c7fde5a6, > us-east-1/i-c9fde5a8, us-east-1/i-cbfde5aa] > > <<authenticated>> woke to: net.schmizz.sshj.userauth.UserAuthException: > publickey auth failed > > <<authenticated>> woke to: net.schmizz.sshj.userauth.UserAuthException: > publickey auth failed > > The user in the virtual machine is new and with valid .ssh keys. > > The hadoop config file is (omitting commented lines): > > whirr.cluster-name=hadoop > > whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker,3 > hadoop-datanode+hadoop-tasktracker > > whirr.provider=aws-ec2 > > whirr.identity=**** > > whirr.credential=**** > > whirr.hardware-id=c1.xlarge > > whirr.image-id=us-east-1/ami-da0cf8b3 > > whirr.location-id=us-east-1 > > -- > This message is automatically generated by JIRA. > If you think it was sent incorrectly, please contact your JIRA > administrators: > https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa > For more information on JIRA, see: http://www.atlassian.com/software/jira > > >
