Ah-ha - https://issues.apache.org/jira/browse/WHIRR-723 - I'll harass people into getting it reviewed and make sure it's in for 0.9.0. In the meantime, you can apply the patch, and then add lines like the following to your properties file -
whirr.templates.first-role.byon-instance-ids=foo+bar whirr.templates.second-role+third-role.byon-instance-ids=foo+baz Where the roles are, well, the roles, and foo/bar/baz are the id fields from the BYON yaml. A. On Thu, Jul 25, 2013 at 8:42 AM, Andrew Bayer <[email protected]>wrote: > Whoopsie - I know I did work on this, but it may not have made it in yet. > Let me dig into this a bit. > > A. > > > On Thu, Jul 25, 2013 at 8:20 AM, Joe Travaglini > <[email protected]>wrote: > >> Thanks to Andrew who pointed out an obvious typo which caused the error. >> >> A new question: is there a way to tell BYON which nodes should have which >> roles? For example which should be a NameNode vs. a DataNode. >> >> For example, in my properties file, I specify the number of templates and >> what does on them (whirr.instance-templates=1 >> cm-agent+cm-cdh-namenode+cm-cdh-zookeeper, etc.) >> In the YAML file, though, it seems you only specify the host and >> connection info, but not which instance templates to apply. >> >> Looking at this >> doc<https://github.com/jclouds/jclouds/blob/master/apis/byon/README.txt>it >> doesn't appear BYON has this level of granularity. Is that correct? >> >> >> On Thu, Jul 25, 2013 at 9:28 AM, Joe Travaglini <[email protected] >> > wrote: >> >>> Hello, >>> I'm new to Whirr so I've probably got this misconfigured. Just doing >>> a simple test to see if the creds and env are set up properly, but it >>> appears not. I have the RSA key specified in the path below propogated to >>> the target server (test-master1) so the whirr user can password-less SSH >>> between. >>> >>> The stack trace is below, but I don't know where the 'byon.yaml' is >>> coming from as the files and configuration are called 'cm-byon.yaml'. I'm >>> also not sure why this would be a "UnknownHostException"... >>> >>> Any help is appreciated. Thanks >>> -Joe >>> >>> $ whirr launch-cluster --config cm-byon.properties >>> $ cat cm-byon.properties >>> whirr.cluster-name=hadoop >>> whirr.cluster-user=whirr >>> whirr.instance-templates=1 cm-agent+cm-cdh-namenode+cm-cdh-zookeeper >>> whirr.client-cidrs=0.0.0.0/0 >>> whirr.private-key-file=/home/whirr/.ssh/id_rsa_cm >>> whirr.public-key-file=/home/whirr/.ssh/id_rsa_cm.pub >>> whirr.service-name=byon >>> whirr.provider=byon >>> whirr.identity=notused >>> whirr.credential=notused >>> jclouds.byon.enpoint=file:///home/whirr/cm-byon.yaml >>> whirr.cm.auto=false >>> >>> $ cat /home/whirr/cm-byon.yaml >>> nodes: >>> - id: test-master1 >>> hostname: 192.168.0.8 >>> os_arch: x86 >>> # os_arch: x86_64 >>> os_family: redhat >>> os_description: redhat >>> os_version: 6.3 >>> group: whirr >>> username: whirr >>> credential: >>> sudo_password: >>> >>> >>> ---- ERROR --- >>> >>> Running on provider byon using identity notused >>> Unable to start the cluster. Terminating all nodes. >>> java.lang.RuntimeException: java.net.UnknownHostException: *byon.yaml* >>> at >>> com.google.common.base.Throwables.propagate(Throwables.java:160) >>> at >>> org.jclouds.byon.suppliers.SupplyFromProviderURIOrNodesProperty.apply(SupplyFromProviderURIOrNodesProperty.java:84) >>> at >>> org.jclouds.byon.suppliers.SupplyFromProviderURIOrNodesProperty.get(SupplyFromProviderURIOrNodesProperty.java:68) >>> at >>> org.jclouds.byon.suppliers.SupplyFromProviderURIOrNodesProperty.get(SupplyFromProviderURIOrNodesProperty.java:44) >>> at >>> org.jclouds.byon.suppliers.NodesParsedFromSupplier.get(NodesParsedFromSupplier.java:58) >>> at >>> org.jclouds.byon.suppliers.NodesParsedFromSupplier.get(NodesParsedFromSupplier.java:42) >>> at >>> org.jclouds.byon.internal.BYONComputeServiceAdapter.listNodes(BYONComputeServiceAdapter.java:83) >>> at >>> org.jclouds.compute.strategy.impl.AdaptingComputeServiceStrategies.listDetailsOnNodesMatching(AdaptingComputeServiceStrategies.java:115) >>> at >>> org.jclouds.compute.strategy.impl.AdaptingComputeServiceStrategies.listNodes(AdaptingComputeServiceStrategies.java:110) >>> at >>> org.jclouds.compute.internal.BaseComputeService.listNodes(BaseComputeService.java:342) >>> at >>> org.apache.whirr.actions.ByonClusterAction.doAction(ByonClusterAction.java:112) >>> at >>> org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedClusterAction.java:127) >>> at >>> org.apache.whirr.ByonClusterController.bootstrapCluster(ByonClusterController.java:92) >>> at >>> org.apache.whirr.ClusterController.launchCluster(ClusterController.java:113) >>> at >>> org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:69) >>> at >>> org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:59) >>> at org.apache.whirr.cli.Main.run(Main.java:69) >>> at org.apache.whirr.cli.Main.main(Main.java:102) >>> Caused by: java.net.UnknownHostException: byon.yaml >>> at >>> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:175) >>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384) >>> at java.net.Socket.connect(Socket.java:546) >>> at java.net.Socket.connect(Socket.java:495) >>> at sun.net.NetworkClient.doConnect(NetworkClient.java:178) >>> at sun.net.NetworkClient.openServer(NetworkClient.java:134) >>> at sun.net.ftp.FtpClient.openServer(FtpClient.java:505) >>> at sun.net.ftp.FtpClient.openServer(FtpClient.java:492) >>> at >>> sun.net.www.protocol.ftp.FtpURLConnection.connect(FtpURLConnection.java:288) >>> at >>> sun.net.www.protocol.ftp.FtpURLConnection.getInputStream(FtpURLConnection.java:375) >>> at java.net.URL.openStream(URL.java:1029) >>> at >>> org.jclouds.byon.suppliers.SupplyFromProviderURIOrNodesProperty.apply(SupplyFromProviderURIOrNodesProperty.java:81) >>> ... 16 more >>> >>> >> >
