Hi. I uploaded an (anonymised) version of this question to SO, along with an answer that includes snippets from Alex and Aled's responses, here:
- http://stackoverflow.com/questions/28943810/brooklyn-starting-blueprint-vms-created-but-brooklyn-cant-ssh-in/28943811#28943811 Could other committers please take a look, to see if this properly answers the (SSH key) question, as I think this is a common problem for people getting started with Brooklyn? It will be useful to have these answers recorded permanently outside the mailing list archives for anyone else with the same problem. Andrew. -- -- andrew kennedy ; clocker.io project founder ; @grkvlt ; On 4 March 2015 at 10:29, Alex Heneveld <[email protected]> wrote: > +1 the quota issue is independent. Removing machines via the gui can help > but for working at scale the aws default limit of 20 is very low. > > Also note id_rsa must have one and only one private key and must not > contain the public key. Tedious that there are so many formats! > > Best > Alex > On 4 Mar 2015 10:05, "Aled Sage" <[email protected]> wrote: > > > John, > > > > I believe the quota is completely unrelated to the privateKeyFile issue. > > > > The privateKeyFile config, and use of ~/.ssh/id_rsa, is just used by > > Brooklyn for setting up ssh access to the VM after it is provisioned. > > > > --- > > By default, jclouds (which we use under the covers) will create a > > temporary AWS key-pair to get initial access to the VM. We'll then > > automatically add the ~/.ssh/id_rsa.pub to the VM's > ~/.ssh/authorized_keys > > (creating a user on the VM that by default has the same name as the user > > who is running the Brooklyn process). > > > > There are instructions for creating an ssh key at [1]. > > > > --- > > The jwkey4brooklyn.pem is presumably the private part of the AWS > key-pair. > > By default, this will *not* be used because jclouds will create its own > > key-pair. > > > > If you wanted jclouds to use your pre-existing key pair then I think > you'd > > have to use the config: > > > > brooklyn.location.jclouds.aws-ec2.keyPair=MyKeypairName > > > > (where MyKeypairName is the name of the key-pair according to AWS.) > > > > Aled > > > > [1] https://brooklyn.incubator.apache.org/v/latest/ops/ > > locations/ssh-keys.html > > > > > > On 04/03/2015 00:45, John Warde wrote: > > > >> Hi Alex, > >> > >> Thanks for the reply! > >> > >> I concatenated the contents of the (AWS) > >> > >> jwkey4brooklyn.pem on to ~/.ssh/id_rsa (have a github key in there > too), I > >> didn't touch ~/.ssh/id_rsa.pub because I was not sure what to add to > it? - > >> sorry I have only minimal experience of SSH usage (github setup). > >> > >> I tried this set-up this first without the brooklyn.properties file > >> active/in place and then with ~/.brooklyn/brooklyn.properties file > >> active, > >> with the following line: > >> brooklyn.location.jclouds.aws-ec2.privateKeyFile=/home/ > >> johnwarde/.ssh/id_rsa > >> > >> I do not see the ' > >> > >> Not able to load publicKeyData from inferred files, based on > >> privateKeyFile: tried [/home/johnwarde/jwkey4brooklyn.pem.pub] for > >> aws-ec2@MySqlNodeImpl{id=lzJhHxwD}' error message anymore - so I > believe > >> I > >> am past this issue? > >> > >> I am only seeing the ' > >> > >> 'Your quota allows for 0 more running instance(s). You requested at > least > >> 1' > >> error messages now, I have asked AWS to increase the EC2 limit to 30 - > >> waiting on a reply. > >> > >> Or are you suggesting here that the ' > >> > >> 'Your quota allows for 0 more running instance(s). You requested at > least > >> 1' > >> error message is related to an issue with SSH keys and not the AWS EC2 > >> Instance limit? > >> > >> > >> Thanks again, > >> > >> John > >> > >> > >> > >> On 3 March 2015 at 18:10, Alex Heneveld < > [email protected]> > >> wrote: > >> > >> Hi John- > >>> > >>> The private key file needs to be id_rsa / id_dsa style (with > >>> corresponding > >>> *.pub) as described at [1]. > >>> > >>> It is confusing and better error reporting around keys (including > >>> fail-fast) is in the latest SNAPSHOT and will be in M3. > >>> > >>> Best > >>> Alex > >>> > >>> > >>> [1] https://brooklyn.incubator.apache.org/v/latest/ops/ > >>> locations/ssh-keys.html > >>> > >>> On 03/03/2015 17:36, John Warde wrote: > >>> > >>> Hi, > >>>> > >>>> I have just started using Brooklyn and I am trying to get the example > >>>> from > >>>> the DEPLOYING BLUEPRINTS > >>>> <https://brooklyn.incubator.apache.org/v/latest/start/blueprints.html > > > >>>> page > >>>> working fully through my AWS account. > >>>> > >>>> The Maven build completed successfully and I can successfully launch > the > >>>> Brooklyn Web UI from > >>>> ~/apache-brooklyn-0.7.0-M2-incubating/usage/dist/target/brooklyn-dist > >>>> using > >>>> the steps on the RUNNING BROOKLYN > >>>> <https://brooklyn.incubator.apache.org/v/latest/start/running.html> > >>>> page. > >>>> > >>>> When I launch the blueprint from the DEPLOYING BLUEPRINTS > >>>> <https://brooklyn.incubator.apache.org/v/latest/start/blueprints.html > > > >>>> page, > >>>> I can see all the VMs launching in my AWS Console UI. I can also see > >>>> the > >>>> key pairs and security groups created. But the blueprint eventually > >>>> fails > >>>> because (I believe) Brooklyn cannot ssh into the VMs, see the first > log > >>>> output below. I assume Brooklyn attempts to login to the VMs using > the > >>>> created key pairs somehow? > >>>> > >>>> Based on the info in the LOCATIONS > >>>> <https://brooklyn.incubator.apache.org/v/latest/ops/ > >>>> locations/index.html#clouds> > >>>> page, I created a ~/.brooklyn/brooklyn.properties file and added the > >>>> following: > >>>> brooklyn.location.jclouds.aws-ec2.identity = MyAwsAccessKeyID > >>>> brooklyn.location.jclouds.aws-ec2.credential = MyAwsSecretAccessKey > >>>> brooklyn.location.jclouds.aws-ec2.privateKeyFile=/home/johnwarde/ > >>>> > >>>> jwkey4brooklyn.pem > >>>> > >>>> I created the jwkey4brooklyn.pem file from the AWS Console UI and > >>>> restarted > >>>> Brooklyn however the blueprint still does not work, it creates the VMs > >>>> but > >>>> cannot access the VMs, see 2nd log output below. > >>>> > >>>> For the following error message ... > >>>> Error invoking start at JBoss7ServerImpl{id=Uk71AKfZ}: > >>>> org.jclouds.aws.AWSResponseException: request POST > >>>> https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code 400, > >>>> error: > >>>> AWSError{requestId='1fd436dc-6603-4a1b-8a84-fe249924b217', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}' > >>>> ... I am not aware of a limit on my account, I was able to manually > >>>> create > >>>> a Load Balancer from the AWS Console - but I'm not sure that is the > same > >>>> thing. How else can I check my AWS account for limits preventing the > >>>> blueprint from working? > >>>> > >>>> I am using Ubuntu 14.04 with Oracle Java 7 installed, it is a > VirtualBox > >>>> VM. > >>>> > >>>> Any tips? > >>>> > >>>> > >>>> Thanks > >>>> for your help! > >>>> > >>>> John > >>>> > >>>> > >>>> ====================================================================== > >>>> *Without ~/.brooklyn/brooklyn.properties* > >>>> > >>>> 2015-03-03 09:46:30,670 INFO Persistence disabled > >>>> 2015-03-03 09:46:30,672 INFO High availability disabled > >>>> 2015-03-03 09:46:42,912 INFO Starting Brooklyn web-console with > >>>> passwordless access on localhost and protected access from any other > >>>> interfaces (no bind address specified) > >>>> 2015-03-03 09:46:50,282 INFO Started Brooklyn console at > >>>> http://127.0.0.1:8081/, running classpath://brooklyn.war > >>>> 2015-03-03 09:46:50,285 INFO Server started. Press return to stop. > >>>> 2015-03-03 09:49:40,122 INFO REST using security provider > >>>> brooklyn.rest.security.provider.BrooklynUserWithRandomPassword > >>>> SecurityProvider > >>>> 2015-03-03 09:49:40,355 INFO Allowing access to web console from > >>>> localhost > >>>> or with brooklyn:rLZ7P2OsFJ > >>>> 2015-03-03 09:50:06,564 INFO Geo info lookup unavailable (for > >>>> 127.0.0.1/127.0.0.1; cause > >>>> brooklyn.util.exceptions.RuntimeInterruptedException: > >>>> java.lang.InterruptedException) > >>>> 2015-03-03 09:50:31,138 INFO Launched from YAML: > >>>> io.brooklyn.camp.spi.AssemblyTemplate@67e7625f[id=qvo8VXEC; > >>>> type=AssemblyTemplate] -> BasicApplicationImpl{id=RdD908P8} > >>>> (Task[start:P9dpQaoz]) > >>>> 2015-03-03 09:50:31,716 INFO Starting MySqlNodeImpl{id=mqLKmhzM}, > >>>> obtaining a new location instance in > >>>> JcloudsLocation[aws-ec2:AKIAIGDWNPGMYRTKQFMQ/aws-ec2] with ports [22, > >>>> 3306] > >>>> 2015-03-03 09:50:31,889 INFO Starting NginxControllerImpl{id= > >>>> EesqjKYJ}, > >>>> obtaining a new location instance in > >>>> JcloudsLocation[aws-ec2:AKIAIGDWNPGMYRTKQFMQ/aws-ec2] with ports [22, > >>>> 8000] > >>>> 2015-03-03 09:50:32,233 INFO Resize DynamicWebAppClusterImpl{id= > >>>> PIUU0Wme} > >>>> from 0 to 1 > >>>> 2015-03-03 09:50:33,433 INFO Starting JBoss7ServerImpl{id=Uk71AKfZ}, > >>>> obtaining a new location instance in > >>>> JcloudsLocation[aws-ec2:AKIAIGDWNPGMYRTKQFMQ/aws-ec2] with ports [22, > >>>> 9443, > >>>> 10999, 8443, 8080, 9990] > >>>> 2015-03-03 09:50:42,720 INFO Creating VM aws-ec2@MySqlNodeImpl{id= > >>>> mqLKmhzM} > >>>> in JcloudsLocation[aws-ec2:AKIAIGDWNPGMYRTKQFMQ/aws-ec2] > >>>> 2015-03-03 09:50:43,120 INFO Creating VM aws-ec2@JBoss7ServerImpl > {id= > >>>> Uk71AKfZ} > >>>> in JcloudsLocation[aws-ec2:AKIAIGDWNPGMYRTKQFMQ/aws-ec2] > >>>> 2015-03-03 09:50:43,849 INFO Creating VM > >>>> aws-ec2@NginxControllerImpl{id=EesqjKYJ} > >>>> in JcloudsLocation[aws-ec2:AKIAIGDWNPGMYRTKQFMQ/aws-ec2] > >>>> 2015-03-03 09:53:05,125 ERROR Failed to start VM for > >>>> aws-ec2@MySqlNodeImpl{id=mqLKmhzM}: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='ce33608d-4b20-490b-98a5-392ad38295f2', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-03 09:53:05,126 ERROR Failed to start VM for > >>>> aws-ec2@NginxControllerImpl{id=EesqjKYJ}: request POST > >>>> https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code 400, > >>>> error: > >>>> AWSError{requestId='730828d3-5371-4cd3-b539-66093e817136', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-03 09:53:05,360 WARN Attempt #1/1 to obtain machine threw > >>>> error: > >>>> org.jclouds.aws.AWSResponseException: request POST > >>>> https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code 400, > >>>> error: > >>>> AWSError{requestId='730828d3-5371-4cd3-b539-66093e817136', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-03 09:53:05,363 WARN Attempt #1/1 to obtain machine threw > >>>> error: > >>>> org.jclouds.aws.AWSResponseException: request POST > >>>> https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code 400, > >>>> error: > >>>> AWSError{requestId='ce33608d-4b20-490b-98a5-392ad38295f2', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-03 09:53:05,395 WARN Error invoking start at > >>>> MySqlNodeImpl{id=mqLKmhzM}: org.jclouds.aws.AWSResponseException: > >>>> request > >>>> POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code > >>>> 400, > >>>> error: AWSError{requestId='ce33608d-4b20-490b-98a5-392ad38295f2', > >>>> requestToken='null', code='InstanceLimitExceeded', message= > >>>> > >>>> 'Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-03 09:53:05,405 WARN Error invoking start at > >>>> NginxControllerImpl{id=EesqjKYJ}: > org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='730828d3-5371-4cd3-b539-66093e817136', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-03 09:53:05,594 ERROR Failed to start VM for > >>>> aws-ec2@JBoss7ServerImpl{id=Uk71AKfZ}: request POST > >>>> https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code 400, > >>>> error: > >>>> AWSError{requestId='1fd436dc-6603-4a1b-8a84-fe249924b217', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-03 09:53:05,595 WARN Attempt #1/1 to obtain machine threw > >>>> error: > >>>> org.jclouds.aws.AWSResponseException: request POST > >>>> https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code 400, > >>>> error: > >>>> AWSError{requestId='1fd436dc-6603-4a1b-8a84-fe249924b217', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-03 09:53:05,615 WARN Error invoking start at > >>>> JBoss7ServerImpl{id=Uk71AKfZ}: org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='1fd436dc-6603-4a1b-8a84-fe249924b217', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-03 09:53:05,630 ERROR Cluster DynamicWebAppClusterImpl{id= > >>>> PIUU0Wme} > >>>> failed to start entity JBoss7ServerImpl{id=Uk71AKfZ} (removing): > >>>> org.jclouds.aws.AWSResponseException: request POST > >>>> https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code 400, > >>>> error: > >>>> AWSError{requestId='1fd436dc-6603-4a1b-8a84-fe249924b217', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> org.jclouds.aws.AWSResponseException: request POST > >>>> https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code 400, > >>>> error: > >>>> AWSError{requestId='1fd436dc-6603-4a1b-8a84-fe249924b217', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> at > >>>> org.jclouds.aws.handlers.ParseAWSErrorFromXmlContent.handleError( > >>>> ParseAWSErrorFromXmlContent.java:75) > >>>> ~[sts-1.8.0.jar:1.8.0] > >>>> 2015-03-03 09:53:05,653 WARN Setting QuarantineGroupImpl{id=HTMCIUbq} > >>>> on-fire due to problems when expected null / up=null: > >>>> {service-lifecycle-indicators-from-children-and-members=Required > entity > >>>> not > >>>> healthy: JBoss7ServerImpl{id=Uk71AKfZ}} > >>>> 2015-03-03 09:53:06,609 WARN Service is not up when setting running > on > >>>> DynamicWebAppClusterImpl{id=PIUU0Wme}; delayed 388ms but Sensor: > >>>> service.isUp (java.lang.Boolean) did not recover from false; > >>>> not-up-indicators={service-not-up-indicators-from- > >>>> children-and-members=No > >>>> entities present} > >>>> 2015-03-03 09:53:06,610 WARN Setting DynamicWebAppClusterImpl{id= > >>>> PIUU0Wme} > >>>> on-fire due to problems when expected running, up=false, problems: > >>>> {start=start failed with error: java.lang.IllegalStateException: Node > >>>> in > >>>> cluster DynamicWebAppClusterImpl{id=PIUU0Wme} failed: Error invoking > >>>> start > >>>> at JBoss7ServerImpl{id=Uk71AKfZ}: > org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='1fd436dc-6603-4a1b-8a84-fe249924b217', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'}} > >>>> 2015-03-03 09:53:06,610 WARN Setting DynamicWebAppClusterImpl{id= > >>>> PIUU0Wme} > >>>> on-fire due to problems when expected running, up=false, problems: > >>>> {start=start failed with error: java.lang.IllegalStateException: Node > >>>> in > >>>> cluster DynamicWebAppClusterImpl{id=PIUU0Wme} failed: Error invoking > >>>> start > >>>> at JBoss7ServerImpl{id=Uk71AKfZ}: > org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='1fd436dc-6603-4a1b-8a84-fe249924b217', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'}} > >>>> 2015-03-03 09:53:06,623 WARN Error invoking start at > >>>> DynamicWebAppClusterImpl{id=PIUU0Wme}: Node in cluster > >>>> DynamicWebAppClusterImpl{id=PIUU0Wme} failed: Error invoking start at > >>>> JBoss7ServerImpl{id=Uk71AKfZ}: org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='1fd436dc-6603-4a1b-8a84-fe249924b217', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-03 09:53:06,629 WARN Error invoking start at > >>>> DynamicWebAppClusterImpl{id=PIUU0Wme}: Error invoking start at > >>>> DynamicWebAppClusterImpl{id=PIUU0Wme}: Node in cluster > >>>> DynamicWebAppClusterImpl{id=PIUU0Wme} failed: Error invoking start at > >>>> JBoss7ServerImpl{id=Uk71AKfZ}: org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='1fd436dc-6603-4a1b-8a84-fe249924b217', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-03 09:53:07,562 WARN Error invoking start at > >>>> ControlledDynamicWebAppClusterImpl{id=aFVq2UOZ}: 2 of 2 parallel child > >>>> tasks failed, 2 errors including: Error invoking start at > >>>> DynamicWebAppClusterImpl{id=PIUU0Wme}: Node in cluster > >>>> DynamicWebAppClusterImpl{id=PIUU0Wme} failed: Error invoking start at > >>>> JBoss7ServerImpl{id=Uk71AKfZ}: org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='1fd436dc-6603-4a1b-8a84-fe249924b217', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-03 09:53:07,619 WARN Error invoking start at > >>>> ControlledDynamicWebAppClusterImpl{id=aFVq2UOZ}: Error invoking start > >>>> at > >>>> ControlledDynamicWebAppClusterImpl{id=aFVq2UOZ}: 2 of 2 parallel child > >>>> tasks failed, 2 errors including: Error invoking start at > >>>> DynamicWebAppClusterImpl{id=PIUU0Wme}: Node in cluster > >>>> DynamicWebAppClusterImpl{id=PIUU0Wme} failed: Error invoking start at > >>>> JBoss7ServerImpl{id=Uk71AKfZ}: org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='1fd436dc-6603-4a1b-8a84-fe249924b217', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-03 09:53:25,232 WARN Service is not up when setting running > on > >>>> BasicApplicationImpl{id=RdD908P8}; delayed 208ms but Sensor: > >>>> service.isUp > >>>> (java.lang.Boolean) did not recover from false; > >>>> not-up-indicators={service-lifecycle-indicators-from- > >>>> children-and-members=None > >>>> of the entities are up} > >>>> 2015-03-03 09:53:25,233 WARN Setting > BasicApplicationImpl{id=RdD908P8} > >>>> on-fire due to problems when expected running, up=false, problems: > >>>> {service-lifecycle-indicators-from-children-and-members=Required > >>>> entities > >>>> not healthy: ControlledDynamicWebAppClusterImpl{id=aFVq2UOZ}, > >>>> MySqlNodeImpl{id=mqLKmhzM}} > >>>> 2015-03-03 09:53:25,333 WARN Error invoking start at > >>>> BasicApplicationImpl{id=RdD908P8}: 2 of 2 parallel child tasks failed, > >>>> 2 > >>>> errors including: Error invoking start at > >>>> ControlledDynamicWebAppClusterImpl{id=aFVq2UOZ}: 2 of 2 parallel child > >>>> tasks failed, 2 errors including: Error invoking start at > >>>> DynamicWebAppClusterImpl{id=PIUU0Wme}: Node in cluster > >>>> DynamicWebAppClusterImpl{id=PIUU0Wme} failed: Error invoking start at > >>>> JBoss7ServerImpl{id=Uk71AKfZ}: org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='1fd436dc-6603-4a1b-8a84-fe249924b217', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-03 09:53:25,661 WARN Error invoking start at > >>>> BasicApplicationImpl{id=RdD908P8}: Error invoking start at > >>>> BasicApplicationImpl{id=RdD908P8}: 2 of 2 parallel child tasks failed, > >>>> 2 > >>>> errors including: Error invoking start at > >>>> ControlledDynamicWebAppClusterImpl{id=aFVq2UOZ}: 2 of 2 parallel child > >>>> tasks failed, 2 errors including: Error invoking start at > >>>> DynamicWebAppClusterImpl{id=PIUU0Wme}: Node in cluster > >>>> DynamicWebAppClusterImpl{id=PIUU0Wme} failed: Error invoking start at > >>>> JBoss7ServerImpl{id=Uk71AKfZ}: org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='1fd436dc-6603-4a1b-8a84-fe249924b217', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> > >>>> > >>>> > >>>> ====================================================================== > >>>> *With ~/.brooklyn/brooklyn.properties* > >>>> > >>>> 2015-03-02 23:30:05,593 INFO Persistence disabled > >>>> 2015-03-02 23:30:05,595 INFO High availability disabled > >>>> 2015-03-02 23:30:21,206 INFO Starting Brooklyn web-console with > >>>> passwordless access on localhost and protected access from any other > >>>> interfaces (no bind address specified) > >>>> 2015-03-02 23:30:31,585 INFO Started Brooklyn console at > >>>> http://127.0.0.1:8081/, running classpath://brooklyn.war > >>>> 2015-03-02 23:30:31,592 INFO Server started. Press return to stop. > >>>> 2015-03-02 23:30:32,371 INFO REST using security provider > >>>> brooklyn.rest.security.provider.BrooklynUserWithRandomPassword > >>>> SecurityProvider > >>>> 2015-03-02 23:30:32,376 INFO Allowing access to web console from > >>>> localhost > >>>> or with brooklyn:TuLzYaXbk2 > >>>> 2015-03-02 23:30:39,215 INFO Geo info lookup for 127.0.0.1/127.0.0.1 > >>>> returned: HostGeoInfo[UPC Ireland, Dublin (IE): 127.0.0.1 at > >>>> (53.333099365234,-6.248899936676)] > >>>> 2015-03-02 23:31:27,150 INFO Launched from YAML: > >>>> io.brooklyn.camp.spi.AssemblyTemplate@37877541[id=mJe1gtUU; > >>>> type=AssemblyTemplate] -> BasicApplicationImpl{id=Sahs6Kxa} > >>>> (Task[start:H1y2ebZs]) > >>>> 2015-03-02 23:31:27,295 INFO Starting MySqlNodeImpl{id=lzJhHxwD}, > >>>> obtaining a new location instance in > >>>> JcloudsLocation[aws-ec2:MyAwsAccessKeyID/aws-ec2] with ports [22, > 3306] > >>>> 2015-03-02 23:31:27,369 INFO Starting NginxControllerImpl{id= > >>>> QYRLgQPh}, > >>>> obtaining a new location instance in > >>>> JcloudsLocation[aws-ec2:MyAwsAccessKeyID/aws-ec2] with ports [22, > 8000] > >>>> 2015-03-02 23:31:27,612 INFO Resize DynamicWebAppClusterImpl{id= > >>>> iJNs2ltC} > >>>> from 0 to 1 > >>>> 2015-03-02 23:31:28,830 INFO Starting JBoss7ServerImpl{id=MWMGwHXx}, > >>>> obtaining a new location instance in > >>>> JcloudsLocation[aws-ec2:MyAwsAccessKeyID/aws-ec2] with ports [22, > 9443, > >>>> 10999, 8443, 8080, 9990] > >>>> 2015-03-02 23:31:37,870 INFO Creating VM aws-ec2@MySqlNodeImpl{id= > >>>> lzJhHxwD} > >>>> in JcloudsLocation[aws-ec2:MyAwsAccessKeyID/aws-ec2] > >>>> 2015-03-02 23:31:38,508 INFO Creating VM aws-ec2@JBoss7ServerImpl > {id= > >>>> MWMGwHXx} > >>>> in JcloudsLocation[aws-ec2:MyAwsAccessKeyID/aws-ec2] > >>>> 2015-03-02 23:31:38,983 INFO Creating VM > >>>> aws-ec2@NginxControllerImpl{id=QYRLgQPh} > >>>> in JcloudsLocation[aws-ec2:MyAwsAccessKeyID/aws-ec2] > >>>> 2015-03-02 23:34:55,349 INFO > >>>> > >>>> Not able to load publicKeyData from inferred > >>>> files, based on privateKeyFile: tried > >>>> [/home/johnwarde/jwkey4brooklyn.pem.pub] for aws-ec2@MySqlNodeImpl > >>>> {id=lzJhHxwD} > >>>> 2015-03-02 23:34:55,353 INFO Not able to load publicKeyData from > >>>> inferred > >>>> files, based on privateKeyFile: tried > >>>> [/home/johnwarde/jwkey4brooklyn.pem.pub] for aws-ec2@JBoss7ServerImpl > >>>> {id=MWMGwHXx} > >>>> 2015-03-02 23:34:55,351 INFO Not able to load publicKeyData from > >>>> inferred > >>>> files, based on privateKeyFile: tried > >>>> [/home/johnwarde/jwkey4brooklyn.pem.pub] for > >>>> aws-ec2@NginxControllerImpl > >>>> {id=QYRLgQPh} > >>>> 2015-03-02 23:35:23,874 ERROR Failed to start VM for > >>>> aws-ec2@MySqlNodeImpl{id=lzJhHxwD}: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='f9a57c85-d03a-46d8-96a1-33be42f60200', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-02 23:35:23,954 WARN Attempt #1/1 to obtain machine threw > >>>> error: > >>>> org.jclouds.aws.AWSResponseException: request POST > >>>> https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code 400, > >>>> error: > >>>> AWSError{requestId='f9a57c85-d03a-46d8-96a1-33be42f60200', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-02 23:35:23,976 WARN Error invoking start at > >>>> MySqlNodeImpl{id=lzJhHxwD}: org.jclouds.aws.AWSResponseException: > >>>> request > >>>> POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code > >>>> 400, > >>>> error: AWSError{requestId='f9a57c85-d03a-46d8-96a1-33be42f60200', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-02 23:36:07,396 ERROR Failed to start VM for > >>>> aws-ec2@JBoss7ServerImpl{id=MWMGwHXx}: request POST > >>>> https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code 400, > >>>> error: > >>>> AWSError{requestId='339c3209-b399-41b3-b02a-75eee845ec43', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-02 23:36:07,397 WARN Attempt #1/1 to obtain machine threw > >>>> error: > >>>> org.jclouds.aws.AWSResponseException: request POST > >>>> https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code 400, > >>>> error: > >>>> AWSError{requestId='339c3209-b399-41b3-b02a-75eee845ec43', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-02 23:36:07,415 WARN Error invoking start at > >>>> JBoss7ServerImpl{id=MWMGwHXx}: org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='339c3209-b399-41b3-b02a-75eee845ec43', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-02 23:36:08,468 ERROR Failed to start VM for > >>>> aws-ec2@NginxControllerImpl{id=QYRLgQPh}: request POST > >>>> https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code 400, > >>>> error: > >>>> AWSError{requestId='9f1661e3-f7a7-4d84-81a8-ec52d7ec5f5d', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-02 23:36:08,716 ERROR Cluster DynamicWebAppClusterImpl{id= > >>>> iJNs2ltC} > >>>> failed to start entity JBoss7ServerImpl{id=MWMGwHXx} (removing): > >>>> org.jclouds.aws.AWSResponseException: request POST > >>>> https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code 400, > >>>> error: > >>>> AWSError{requestId='339c3209-b399-41b3-b02a-75eee845ec43', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> org.jclouds.aws.AWSResponseException: request POST > >>>> https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code 400, > >>>> error: > >>>> AWSError{requestId='339c3209-b399-41b3-b02a-75eee845ec43', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> at > >>>> org.jclouds.aws.handlers.ParseAWSErrorFromXmlContent.handleError( > >>>> ParseAWSErrorFromXmlContent.java:75) > >>>> ~[sts-1.8.0.jar:1.8.0] > >>>> 2015-03-02 23:36:08,723 WARN Attempt #1/1 to obtain machine threw > >>>> error: > >>>> org.jclouds.aws.AWSResponseException: request POST > >>>> https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed with code 400, > >>>> error: > >>>> AWSError{requestId='9f1661e3-f7a7-4d84-81a8-ec52d7ec5f5d', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-02 23:36:08,771 WARN Error invoking start at > >>>> NginxControllerImpl{id=QYRLgQPh}: > org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='9f1661e3-f7a7-4d84-81a8-ec52d7ec5f5d', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-02 23:36:08,775 WARN Setting QuarantineGroupImpl{id=nb0hPaQP} > >>>> on-fire due to problems when expected null / up=null: > >>>> {service-lifecycle-indicators-from-children-and-members=Required > entity > >>>> not > >>>> healthy: JBoss7ServerImpl{id=MWMGwHXx}} > >>>> 2015-03-02 23:36:09,184 WARN Service is not up when setting running > on > >>>> DynamicWebAppClusterImpl{id=iJNs2ltC}; delayed 239ms but Sensor: > >>>> service.isUp (java.lang.Boolean) did not recover from false; > >>>> not-up-indicators={service-not-up-indicators-from- > >>>> children-and-members=No > >>>> entities present} > >>>> 2015-03-02 23:36:09,185 WARN Setting DynamicWebAppClusterImpl{id= > >>>> iJNs2ltC} > >>>> on-fire due to problems when expected running, up=false, problems: > >>>> {start=start failed with error: java.lang.IllegalStateException: Node > >>>> in > >>>> cluster DynamicWebAppClusterImpl{id=iJNs2ltC} failed: Error invoking > >>>> start > >>>> at JBoss7ServerImpl{id=MWMGwHXx}: > org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='339c3209-b399-41b3-b02a-75eee845ec43', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'}} > >>>> 2015-03-02 23:36:09,190 WARN Error invoking start at > >>>> DynamicWebAppClusterImpl{id=iJNs2ltC}: Node in cluster > >>>> DynamicWebAppClusterImpl{id=iJNs2ltC} failed: Error invoking start at > >>>> JBoss7ServerImpl{id=MWMGwHXx}: org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='339c3209-b399-41b3-b02a-75eee845ec43', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-02 23:36:09,193 WARN Error invoking start at > >>>> DynamicWebAppClusterImpl{id=iJNs2ltC}: Error invoking start at > >>>> DynamicWebAppClusterImpl{id=iJNs2ltC}: Node in cluster > >>>> DynamicWebAppClusterImpl{id=iJNs2ltC} failed: Error invoking start at > >>>> JBoss7ServerImpl{id=MWMGwHXx}: org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='339c3209-b399-41b3-b02a-75eee845ec43', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-02 23:36:09,352 WARN Error invoking start at > >>>> ControlledDynamicWebAppClusterImpl{id=iN0oHDhm}: 2 of 2 parallel child > >>>> tasks failed, 2 errors including: Error invoking start at > >>>> DynamicWebAppClusterImpl{id=iJNs2ltC}: Node in cluster > >>>> DynamicWebAppClusterImpl{id=iJNs2ltC} failed: Error invoking start at > >>>> JBoss7ServerImpl{id=MWMGwHXx}: org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='339c3209-b399-41b3-b02a-75eee845ec43', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-02 23:36:09,421 WARN Error invoking start at > >>>> ControlledDynamicWebAppClusterImpl{id=iN0oHDhm}: Error invoking start > >>>> at > >>>> ControlledDynamicWebAppClusterImpl{id=iN0oHDhm}: 2 of 2 parallel child > >>>> tasks failed, 2 errors including: Error invoking start at > >>>> DynamicWebAppClusterImpl{id=iJNs2ltC}: Node in cluster > >>>> DynamicWebAppClusterImpl{id=iJNs2ltC} failed: Error invoking start at > >>>> JBoss7ServerImpl{id=MWMGwHXx}: org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='339c3209-b399-41b3-b02a-75eee845ec43', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-02 23:36:09,870 WARN Service is not up when setting running > on > >>>> BasicApplicationImpl{id=Sahs6Kxa}; delayed 209ms but Sensor: > >>>> service.isUp > >>>> (java.lang.Boolean) did not recover from false; > >>>> not-up-indicators={service-lifecycle-indicators-from- > >>>> children-and-members=None > >>>> of the entities are up} > >>>> 2015-03-02 23:36:09,871 WARN Setting > BasicApplicationImpl{id=Sahs6Kxa} > >>>> on-fire due to problems when expected running, up=false, problems: > >>>> {service-lifecycle-indicators-from-children-and-members=Required > >>>> entities > >>>> not healthy: ControlledDynamicWebAppClusterImpl{id=iN0oHDhm}, > >>>> MySqlNodeImpl{id=lzJhHxwD}} > >>>> 2015-03-02 23:36:10,198 WARN Error invoking start at > >>>> BasicApplicationImpl{id=Sahs6Kxa}: 2 of 2 parallel child tasks failed, > >>>> 2 > >>>> errors including: Error invoking start at > >>>> ControlledDynamicWebAppClusterImpl{id=iN0oHDhm}: 2 of 2 parallel child > >>>> tasks failed, 2 errors including: Error invoking start at > >>>> DynamicWebAppClusterImpl{id=iJNs2ltC}: Node in cluster > >>>> DynamicWebAppClusterImpl{id=iJNs2ltC} failed: Error invoking start at > >>>> JBoss7ServerImpl{id=MWMGwHXx}: org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='339c3209-b399-41b3-b02a-75eee845ec43', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> 2015-03-02 23:36:10,632 WARN Error invoking start at > >>>> BasicApplicationImpl{id=Sahs6Kxa}: Error invoking start at > >>>> BasicApplicationImpl{id=Sahs6Kxa}: 2 of 2 parallel child tasks failed, > >>>> 2 > >>>> errors including: Error invoking start at > >>>> ControlledDynamicWebAppClusterImpl{id=iN0oHDhm}: 2 of 2 parallel child > >>>> tasks failed, 2 errors including: Error invoking start at > >>>> DynamicWebAppClusterImpl{id=iJNs2ltC}: Node in cluster > >>>> DynamicWebAppClusterImpl{id=iJNs2ltC} failed: Error invoking start at > >>>> JBoss7ServerImpl{id=MWMGwHXx}: org.jclouds.aws.AWSResponseException: > >>>> request POST https://ec2.us-east-1.amazonaws.com/ HTTP/1.1 failed > with > >>>> code > >>>> 400, error: AWSError{requestId='339c3209-b399-41b3-b02a-75eee845ec43', > >>>> requestToken='null', code='InstanceLimitExceeded', message='Your quota > >>>> allows for 0 more running instance(s). You requested at least 1', > >>>> context='{Response=, Errors=}'} > >>>> > >>>> 2015-03-02 23:39:36,967 INFO Stopping application > >>>> BasicApplicationImpl{id=Sahs6Kxa} > >>>> 2015-03-02 23:39:37,075 INFO Stopping > NginxControllerImpl{id=QYRLgQPh} > >>>> in > >>>> [] > >>>> 2015-03-02 23:39:37,077 INFO Stopping MySqlNodeImpl{id=lzJhHxwD} in > [] > >>>> 2015-03-02 23:39:37,237 INFO Stopping JBoss7ServerImpl{id=MWMGwHXx} > in > >>>> [JcloudsLocation[aws-ec2:MyAwsAccessKeyID/aws-ec2]] > >>>> 2015-03-02 23:39:37,389 INFO Stopped application > >>>> BasicApplicationImpl{id=Sahs6Kxa} > >>>> 2015-03-02 23:39:37,751 WARN 2 threads could not be stopped > >>>> > >>>> > >>>> > > >
