* are you running Whirr from a local machine or from a VM inside Amazon? What user? >>> VM Inside Amazon. Using a user I created not ec2-user or root. * have you added something like whirr.cluster-user=whirr to hadoop.properties? >>> No I havent - should I be?
Here's our properties file: whirr.cluster-name=myhadoopcluster whirr.instance-templates=1 hadoop-jobtracker+hadoop-namenode,1 hadoop-datanode+hadoop-tasktracker whirr.provider=aws-ec2 whirr.identity=<KEY> whirr.credential=<SECRET> whirr.login-user=USER whirr.hardware-id=m1.small whirr.image-id=us-east-1/ami-6936fb00 whirr.hadoop.install-function=install_cdh_hadoop whirr.hadoop.configure-function=configure_cdh_hadoop ~ On Tue, Jan 3, 2012 at 6:46 PM, Andrei Savu <[email protected]> wrote: > Moving this on the email list. > > A few questions: > > * are you running Whirr from a local machine or from a VM inside Amazon? > What user? > * have you added something like whirr.cluster-user=whirr to > hadoop.properties? > > -- Andrei Savu / andreisavu.ro > > On Wed, Jan 4, 2012 at 1:40 AM, Michael David (Commented) (JIRA) < > [email protected]> wrote: > >> >> [ >> https://issues.apache.org/jira/browse/WHIRR-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179133#comment-13179133] >> >> Michael David commented on WHIRR-378: >> ------------------------------------- >> >> Hi Andrei - Just tried with 0.7.0 and am getting new errors: >> >> Instead of using the properties file, I tried to invoke keys in command >> line instead using the tuorial here: >> http://whirr.apache.org/docs/0.7.0/whirr-in-5-minutes.html >> >> ./whirr launch-cluster --config hadoop.properties --private-key-file >> ~/.ssh/id_rsa_whirr --public-key-file ~/.ssh/id_rsa_whirr.pub >> >> It seems that I'm not getting a different set of auth errors: >> >> Dying because - net.schmizz.sshj.transport.TransportException: Broken >> transport; encountered EOF >> Dying because - net.schmizz.sshj.transport.TransportException: Broken >> transport; encountered EOF >> <<kex done>> woke to: net.schmizz.sshj.transport.TransportException: >> Broken transport; encountered EOF >> << (USER:rsa[fingerprint(FINGERPRINT),sha1(SHA1)]@xx.xx.xx.xx:22) error >> acquiring SSHClient(timeout=60000): Broken transport; encountered EOF >> net.schmizz.sshj.transport.TransportException: Broken transport; >> encountered EOF >> at net.schmizz.sshj.transport.Reader.run(Reader.java:70) >> <<authenticated>> woke to: net.schmizz.sshj.userauth.UserAuthException: >> publickey auth failed >> << (USER:rsa[fingerprint(FINGERPRINT),sha1(SHA1)]@xx.xx.xx:22) error >> acquiring SSHClient(timeout=60000): exception not retryable >> net.schmizz.sshj.userauth.UserAuthException: Exhausted available >> authentication methods >> at >> net.schmizz.sshj.userauth.UserAuthImpl.authenticate(UserAuthImpl.java:114) >> at net.schmizz.sshj.SSHClient.auth(SSHClient.java:204) >> at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:304) >> at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:323) >> at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:199) >> at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:171) >> at org.jclouds.sshj.SshjSshClient.acquire(SshjSshClient.java:220) >> at org.jclouds.sshj.SshjSshClient.connect(SshjSshClient.java:255) >> at >> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.call(RunScriptOnNodeAsInitScriptUsingSsh.java:89) >> at >> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:150) >> at >> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:57) >> at >> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) >> at java.util.concurrent.FutureTask.run(FutureTask.java:166) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) >> at java.lang.Thread.run(Thread.java:636) >> Caused by: net.schmizz.sshj.userauth.UserAuthException: publickey auth >> failed >> at >> net.schmizz.sshj.userauth.UserAuthImpl.handle(UserAuthImpl.java:157) >> at >> net.schmizz.sshj.transport.TransportImpl.handle(TransportImpl.java:474) >> at net.schmizz.sshj.transport.Decoder.decode(Decoder.java:127) >> at net.schmizz.sshj.transport.Decoder.received(Decoder.java:195) >> at net.schmizz.sshj.transport.Reader.run(Reader.java:72) >> >> << problem applying options to node(us-east-1/i-xxxxxe): >> org.jclouds.rest.AuthorizationException: >> (USER:rsa[fingerprint(RSA),sha1(SHA)]@xx.xx.xx:22) >> (USER:rsa[fingerprint(RSA),sha1(SHA1)]@xx.xx.xx:22) error acquiring >> SSHClient(timeout=60000): Exhausted available authentication methods >> at >> org.jclouds.sshj.SshjSshClient.propagate(SshjSshClient.java:413) >> at org.jclouds.sshj.SshjSshClient.acquire(SshjSshClient.java:244) >> at org.jclouds.sshj.SshjSshClient.connect(SshjSshClient.java:255) >> at >> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.call(RunScriptOnNodeAsInitScriptUsingSsh.java:89) >> at >> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:150) >> at >> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:57) >> at >> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) >> at java.util.concurrent.FutureTask.run(FutureTask.java:166) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) >> at java.lang.Thread.run(Thread.java:636) >> Caused by: net.schmizz.sshj.userauth.UserAuthException: Exhausted >> available authentication methods >> at >> net.schmizz.sshj.userauth.UserAuthImpl.authenticate(UserAuthImpl.java:114) >> at net.schmizz.sshj.SSHClient.auth(SSHClient.java:204) >> at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:304) >> at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:323) >> at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:199) >> at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:171) >> at org.jclouds.sshj.SshjSshClient.acquire(SshjSshClient.java:220) >> ... 9 more >> Caused by: net.schmizz.sshj.userauth.UserAuthException: publickey auth >> failed >> at >> net.schmizz.sshj.userauth.UserAuthImpl.handle(UserAuthImpl.java:157) >> at >> net.schmizz.sshj.transport.TransportImpl.handle(TransportImpl.java:474) >> at net.schmizz.sshj.transport.Decoder.decode(Decoder.java:127) >> at net.schmizz.sshj.transport.Decoder.received(Decoder.java:195) >> at net.schmizz.sshj.transport.Reader.run(Reader.java:72) >> <<authenticated>> woke to: net.schmizz.sshj.userauth.UserAuthException: >> publickey auth failed >> << (USER:rsa[fingerprint(RSA),sha1(SHA1)]@xx.xxx.xx:22) error acquiring >> SSHClient(timeout=60000): exception not retryable >> net.schmizz.sshj.userauth.UserAuthException: Exhausted available >> authentication methods >> at >> net.schmizz.sshj.userauth.UserAuthImpl.authenticate(UserAuthImpl.java:114) >> at net.schmizz.sshj.SSHClient.auth(SSHClient.java:204) >> at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:304) >> at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:323) >> at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:199) >> at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:171) >> at org.jclouds.sshj.SshjSshClient.acquire(SshjSshClient.java:220) >> at org.jclouds.sshj.SshjSshClient.connect(SshjSshClient.java:255) >> at >> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.call(RunScriptOnNodeAsInitScriptUsingSsh.java:89) >> at >> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:150) >> at >> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:57) >> at >> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) >> at java.util.concurrent.FutureTask.run(FutureTask.java:166) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) >> at java.lang.Thread.run(Thread.java:636) >> Caused by: net.schmizz.sshj.userauth.UserAuthException: publickey auth >> failed >> at >> net.schmizz.sshj.userauth.UserAuthImpl.handle(UserAuthImpl.java:157) >> at >> net.schmizz.sshj.transport.TransportImpl.handle(TransportImpl.java:474) >> at net.schmizz.sshj.transport.Decoder.decode(Decoder.java:127) >> at net.schmizz.sshj.transport.Decoder.received(Decoder.java:195) >> at net.schmizz.sshj.transport.Reader.run(Reader.java:72) >> << (USER:rsa[fingerprint(RSA),sha1(SHA1)]@xx.xx.xx:22) error acquiring >> SSHClient(timeout=60000): Exhausted available authentication methods >> net.schmizz.sshj.userauth.UserAuthException: Exhausted available >> authentication methods >> at >> net.schmizz.sshj.userauth.UserAuthImpl.authenticate(UserAuthImpl.java:114) >> at net.schmizz.sshj.SSHClient.auth(SSHClient.java:204) >> at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:304) >> at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:323) >> at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:199) >> at org.jclouds.sshj.SshjSshClient$1.create(SshjSshClient.java:171) >> at org.jclouds.sshj.SshjSshClient.acquire(SshjSshClient.java:220) >> at org.jclouds.sshj.SshjSshClient.connect(SshjSshClient.java:255) >> at >> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.call(RunScriptOnNodeAsInitScriptUsingSsh.java:89) >> at >> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:150) >> at >> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:57) >> at >> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) >> at java.util.concurrent.FutureTask.run(FutureTask.java:166) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) >> at java.lang.Thread.run(Thread.java:636) >> Caused by: net.schmizz.sshj.userauth.UserAuthException: publickey auth >> failed >> at >> net.schmizz.sshj.userauth.UserAuthImpl.handle(UserAuthImpl.java:157) >> at >> net.schmizz.sshj.transport.TransportImpl.handle(TransportImpl.java:474) >> at net.schmizz.sshj.transport.Decoder.decode(Decoder.java:127) >> at net.schmizz.sshj.transport.Decoder.received(Decoder.java:195) >> at net.schmizz.sshj.transport.Reader.run(Reader.java:72) >> >> Thanks - really appreciate your speedy answers here! >> >> >> > Auth fail when creating a cluster from an EC2 instance >> > ------------------------------------------------------ >> > >> > Key: WHIRR-378 >> > URL: https://issues.apache.org/jira/browse/WHIRR-378 >> > Project: Whirr >> > Issue Type: Bug >> > Components: service/hadoop >> > Affects Versions: 0.6.0 >> > Reporter: Marc de Palol >> > Assignee: Adrian Cole >> > Priority: Critical >> > Fix For: 0.8.0 >> > >> > Attachments: run-test.sh, setup-whirr.sh >> > >> > >> > There is a ssh auth problem when creating a hadoop cluster from an EC2 >> ubuntu instance. >> > I've been using the same configuration file from an EC2 computer an a >> physical one, everything works fine in the physical one, but I keep getting >> this error in EC2: >> > Running configuration script on nodes: [us-east-1/i-c7fde5a6, >> us-east-1/i-c9fde5a8, us-east-1/i-cbfde5aa] >> > <<authenticated>> woke to: net.schmizz.sshj.userauth.UserAuthException: >> publickey auth failed >> > <<authenticated>> woke to: net.schmizz.sshj.userauth.UserAuthException: >> publickey auth failed >> > The user in the virtual machine is new and with valid .ssh keys. >> > The hadoop config file is (omitting commented lines): >> > whirr.cluster-name=hadoop >> > whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker,3 >> hadoop-datanode+hadoop-tasktracker >> > whirr.provider=aws-ec2 >> > whirr.identity=**** >> > whirr.credential=**** >> > whirr.hardware-id=c1.xlarge >> > whirr.image-id=us-east-1/ami-da0cf8b3 >> > whirr.location-id=us-east-1 >> >> -- >> This message is automatically generated by JIRA. >> If you think it was sent incorrectly, please contact your JIRA >> administrators: >> https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa >> For more information on JIRA, see: http://www.atlassian.com/software/jira >> >> >> > -- _______________________________ David Dundas CEO - textingly www.textingly.com text DAVID to 52627 linkedin - http://www.linkedin.com/in/daviddundas textingly twitter: twitter.com/textingly my twitter: twitter.com/dundas
