Oct 07, 2014 11:41:27 AM hudson.plugins.ec2.EC2Cloud addProvisionedSlave
INFO: Provisioning for AMI ami-abcda06b; Estimated number of total slaves: 241; Estimated number of slaves for ami ami-abcda06b: 30
Launching ami-abcda06b for template aws builder
Oct 07, 2014 11:41:27 AM hudson.plugins.ec2.SlaveTemplate provisionOndemand
INFO: Launching ami-abcda06b for template aws builder
Looking for existing instances with describe-instance: {InstanceIds: [],Filters: [{Name: image-id,Values: [ami-abcda06b]}, {Name: availability-zone,Values: [us-east-1a]}, {Name: subnet-id,Values: [subnet-1a2bce59]}, {Name: instance.group-id,Values: [sg-e9bb378c, sg-1237d80c]}, {Name: key-name,Values: [jenkins-builder]}, {Name: instance-type,Values: [m3.large]}, {Name: tag:Name,Values: [jenkins-builder.elastic]}, {Name: tag:created_by,Values: [ci.corp.mydomain.com]}, {Name: tag:Service,Values: [jenkins]}, {Name: tag:Team,Values: [releng]}, {Name: tag:Stage,Values: [prod]}, {Name: instance-state-name,Values: [stopped, stopping]}],}
Oct 07, 2014 11:41:28 AM hudson.plugins.ec2.EC2Cloud addProvisionedSlave
INFO: Provisioning for AMI ami-abcda06b; Estimated number of total slaves: 242; Estimated number of slaves for ami ami-abcda06b: 31
Launching ami-abcda06b for template aws builder
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
INFO: Started provisioning aws builder (ami-abcda06b) from ec2-us-east-1 with 1 executors. Remaining excess workload:14.0
Oct 07, 2014 11:41:28 AM hudson.plugins.ec2.SlaveTemplate provisionOndemand
INFO: Launching ami-abcda06b for template aws builder
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
INFO: Started provisioning aws builder (ami-abcda06b) from ec2-us-east-1 with 1 executors. Remaining excess workload:13.0
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
INFO: Started provisioning aws builder (ami-abcda06b) from ec2-us-east-1 with 1 executors. Remaining excess workload:12.0
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
INFO: Started provisioning aws builder (ami-abcda06b) from ec2-us-east-1 with 1 executors. Remaining excess workload:11.0
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
INFO: Started provisioning aws builder (ami-abcda06b) from ec2-us-east-1 with 1 executors. Remaining excess workload:10.0
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
INFO: Started provisioning aws builder (ami-abcda06b) from ec2-us-east-1 with 1 executors. Remaining excess workload:9.0
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
INFO: Started provisioning aws builder (ami-abcda06b) from ec2-us-east-1 with 1 executors. Remaining excess workload:8.0
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
INFO: Started provisioning aws builder (ami-abcda06b) from ec2-us-east-1 with 1 executors. Remaining excess workload:7.0
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
INFO: Started provisioning aws builder (ami-abcda06b) from ec2-us-east-1 with 1 executors. Remaining excess workload:6.0
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
INFO: Started provisioning aws builder (ami-abcda06b) from ec2-us-east-1 with 1 executors. Remaining excess workload:5.0
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
INFO: Started provisioning aws builder (ami-abcda06b) from ec2-us-east-1 with 1 executors. Remaining excess workload:4.0
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
INFO: Started provisioning aws builder (ami-abcda06b) from ec2-us-east-1 with 1 executors. Remaining excess workload:3.0
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
INFO: Started provisioning aws builder (ami-abcda06b) from ec2-us-east-1 with 1 executors. Remaining excess workload:2.0
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
INFO: Started provisioning aws builder (ami-abcda06b) from ec2-us-east-1 with 1 executors. Remaining excess workload:1.0
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
INFO: Started provisioning aws builder (ami-abcda06b) from ec2-us-east-1 with 1 executors. Remaining excess workload:0.0
Oct 07, 2014 11:41:28 AM hudson.plugins.sauce_ondemand.SauceEnvironmentUtil getBuildWrapper
INFO: Could not find SauceOnDemandBuildWrapper on project hudson.model.FreeStyleProject@222a3030[gerrit_cdc]
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
WARNING: Provisioned slave aws builder (ami-abcda06b) failed to launch
com.amazonaws.AmazonServiceException: The instance ID 'i-7705eb7d' does not exist (Service: AmazonEC2; Status Code: 400; Error Code: InvalidInstanceID.NotFound; Request ID: abcd14da-de6a-40fa-967b-945290c35287)
at com.amazonaws.http.AmazonHttpClient.handleErrorResponse(AmazonHttpClient.java:886)
at com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:484)
at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:256)
at com.amazonaws.services.ec2.AmazonEC2Client.invoke(AmazonEC2Client.java:8798)
at com.amazonaws.services.ec2.AmazonEC2Client.createTags(AmazonEC2Client.java:4990)
at hudson.plugins.ec2.SlaveTemplate.updateRemoteTags(SlaveTemplate.java:667)
at hudson.plugins.ec2.SlaveTemplate.provisionOndemand(SlaveTemplate.java:410)
at hudson.plugins.ec2.SlaveTemplate.provision(SlaveTemplate.java:284)
at hudson.plugins.ec2.EC2Cloud$1.call(EC2Cloud.java:370)
at hudson.plugins.ec2.EC2Cloud$1.call(EC2Cloud.java:366)
at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Oct 07, 2014 11:41:28 AM hudson.slaves.NodeProvisioner update
WARNING: Provisioned slave aws builder (ami-abcda06b) failed to launch
com.amazonaws.AmazonServiceException: The instance ID 'i-9407e99e' does not exist (Service: AmazonEC2; Status Code: 400; Error Code: InvalidInstanceID.NotFound; Request ID: abcddcc1-f486-4598-b140-fb1656d24aef)
at com.amazonaws.http.AmazonHttpClient.handleErrorResponse(AmazonHttpClient.java:886)
at com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:484)
at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:256)
at com.amazonaws.services.ec2.AmazonEC2Client.invoke(AmazonEC2Client.java:8798)
at com.amazonaws.services.ec2.AmazonEC2Client.describeInstances(AmazonEC2Client.java:4137)
at hudson.plugins.ec2.SlaveTemplate.provisionOndemand(SlaveTemplate.java:385)
at hudson.plugins.ec2.SlaveTemplate.provision(SlaveTemplate.java:284)
at hudson.plugins.ec2.EC2Cloud$1.call(EC2Cloud.java:370)
at hudson.plugins.ec2.EC2Cloud$1.call(EC2Cloud.java:366)
at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Looking for existing instances with describe-instance: {InstanceIds: [],Filters: [{Name: image-id,Values: [ami-abcda06b]}, {Name: availability-zone,Values: [us-east-1a]}, {Name: subnet-id,Values: [subnet-1a2bce59]}, {Name: instance.group-id,Values: [sg-e9bb378c, sg-1237d80c]}, {Name: key-name,Values: [jenkins-builder]}, {Name: instance-type,Values: [m3.large]}, {Name: tag:Name,Values: [jenkins-builder.elastic]}, {Name: tag:created_by,Values: [ci.corp.mydomain.com]}, {Name: tag:Service,Values: [jenkins]}, {Name: tag:Team,Values: [releng]}, {Name: tag:Stage,Values: [prod]}, {Name: instance-state-name,Values: [stopped, stopping]}],}
No existing instance found - created: {InstanceId: i-1abceb45,ImageId: ami-abcda06b,State: {Code: 0,Name: pending},PrivateDnsName: ip-10-32-1-152.us-east-1.compute.internal,PublicDnsName: ,StateTransitionReason: ,KeyName: jenkins-builder,AmiLaunchIndex: 0,ProductCodes: [],InstanceType: m3.large,LaunchTime: Tue Oct 07 11:41:29 PDT 2014,Placement: {AvailabilityZone: us-east-1a,GroupName: ,Tenancy: default},KernelId: aki-98e26fa8,Monitoring: {State: disabled},SubnetId: subnet-1a2bce59,VpcId: vpc-26a44a43,PrivateIpAddress: 10.32.1.152,StateReason: {Code: pending,Message: pending},Architecture: x86_64,RootDeviceType: ebs,RootDeviceName: /dev/sda1,BlockDeviceMappings: [],VirtualizationType: paravirtual,ClientToken: 58ad84d4-2934-4647-b5e5-d7084db6c33a,Tags: [{Key: Service,Value: jenkins}, {Key: Name,Value: jenkins-builder.elastic}, {Key: Stage,Value: prod}, {Key: Team,Value: releng}, {Key: created_by,Value: ci.corp.mydomain.com}],SecurityGroups: [{GroupName: corp,GroupId: sg-e9bb378c}, {GroupName: jenkins,GroupId: sg-1237d80c}],SourceDestCheck: true,Hypervisor: xen,NetworkInterfaces: [{NetworkInterfaceId: eni-d4fbeeb1,SubnetId: subnet-1a2bce59,VpcId: vpc-26a44a43,Description: ,OwnerId: 742630462602,Status: in-use,PrivateIpAddress: 10.32.1.152,PrivateDnsName: ip-10-32-1-152.us-east-1.compute.internal,SourceDestCheck: true,Groups: [{GroupName: corp,GroupId: sg-e9bb378c}, {GroupName: jenkins,GroupId: sg-1237d80c}],Attachment: {AttachmentId: eni-attach-a7b54391,DeviceIndex: 0,Status: attaching,AttachTime: Tue Oct 07 11:41:29 PDT 2014,DeleteOnTermination: true},PrivateIpAddresses: [{PrivateIpAddress: 10.32.1.152,PrivateDnsName: ip-10-32-1-152.us-east-1.compute.internal,Primary: true,}]}],EbsOptimized: false,}
Oct 07, 2014 11:41:29 AM hudson.plugins.ec2.SlaveTemplate provisionOndemand
INFO: No existing instance found - created: {InstanceId: i-1abceb45,ImageId: ami-abcda06b,State: {Code: 0,Name: pending},PrivateDnsName: ip-10-32-1-152.us-east-1.compute.internal,PublicDnsName: ,StateTransitionReason: ,KeyName: jenkins-builder,AmiLaunchIndex: 0,ProductCodes: [],InstanceType: m3.large,LaunchTime: Tue Oct 07 11:41:29 PDT 2014,Placement: {AvailabilityZone: us-east-1a,GroupName: ,Tenancy: default},KernelId: aki-98e26fa8,Monitoring: {State: disabled},SubnetId: subnet-1a2bce59,VpcId: vpc-26a44a43,PrivateIpAddress: 10.32.1.152,StateReason: {Code: pending,Message: pending},Architecture: x86_64,RootDeviceType: ebs,RootDeviceName: /dev/sda1,BlockDeviceMappings: [],VirtualizationType: paravirtual,ClientToken: 58ad84d4-2934-4647-b5e5-d7084db6c33a,Tags: [{Key: Service,Value: jenkins}, {Key: Name,Value: jenkins-builder.elastic}, {Key: Stage,Value: prod}, {Key: Team,Value: releng}, {Key: created_by,Value: ci.corp.mydomain.com}],SecurityGroups: [{GroupName: corp,GroupId: sg-e9bb378c}, {GroupName: jenkins,GroupId: sg-1237d80c}],SourceDestCheck: true,Hypervisor: xen,NetworkInterfaces: [{NetworkInterfaceId: eni-d4fbeeb1,SubnetId: subnet-1a2bce59,VpcId: vpc-26a44a43,Description: ,OwnerId: 742630462602,Status: in-use,PrivateIpAddress: 10.32.1.152,PrivateDnsName: ip-10-32-1-152.us-east-1.compute.internal,SourceDestCheck: true,Groups: [{GroupName: corp,GroupId: sg-e9bb378c}, {GroupName: jenkins,GroupId: sg-1237d80c}],Attachment: {AttachmentId: eni-attach-a7b54391,DeviceIndex: 0,Status: attaching,AttachTime: Tue Oct 07 11:41:29 PDT 2014,DeleteOnTermination: true},PrivateIpAddresses: [{PrivateIpAddress: 10.32.1.152,PrivateDnsName: ip-10-32-1-152.us-east-1.compute.internal,Primary: true,}]}],EbsOptimized: false,}
Oct 07, 2014 11:41:29 AM hudson.plugins.ec2.EC2RetentionStrategy start
INFO: Start requested for aws builder (i-1abceb45)
No existing instance found - created: {InstanceId: i-2bcdeb44,ImageId: ami-abcda06b,State: {Code: 0,Name: pending},PrivateDnsName: ip-10-32-1-243.us-east-1.compute.internal,PublicDnsName: ,StateTransitionReason: ,KeyName: jenkins-builder,AmiLaunchIndex: 0,ProductCodes: [],InstanceType: m3.large,LaunchTime: Tue Oct 07 11:41:29 PDT 2014,Placement: {AvailabilityZone: us-east-1a,GroupName: ,Tenancy: default},KernelId: aki-98e26fa8,Monitoring: {State: disabled},SubnetId: subnet-1a2bce59,VpcId: vpc-26a44a43,PrivateIpAddress: 10.32.1.243,StateReason: {Code: pending,Message: pending},Architecture: x86_64,RootDeviceType: ebs,RootDeviceName: /dev/sda1,BlockDeviceMappings: [],VirtualizationType: paravirtual,ClientToken: 2988c7e3-b1ae-4d35-b294-9c1fc36b9d62,Tags: [{Key: Service,Value: jenkins}, {Key: Name,Value: jenkins-builder.elastic}, {Key: Stage,Value: prod}, {Key: Team,Value: releng}, {Key: created_by,Value: ci.corp.mydomain.com}],SecurityGroups: [{GroupName: corp,GroupId: sg-e9bb378c}, {GroupName: jenkins,GroupId: sg-1237d80c}],SourceDestCheck: true,Hypervisor: xen,NetworkInterfaces: [{NetworkInterfaceId: eni-d6fbeeb3,SubnetId: subnet-1a2bce59,VpcId: vpc-26a44a43,Description: ,OwnerId: 742630462602,Status: in-use,PrivateIpAddress: 10.32.1.243,PrivateDnsName: ip-10-32-1-243.us-east-1.compute.internal,SourceDestCheck: true,Groups: [{GroupName: corp,GroupId: sg-e9bb378c}, {GroupName: jenkins,GroupId: sg-1237d80c}],Attachment: {AttachmentId: eni-attach-a0b54396,DeviceIndex: 0,Status: attaching,AttachTime: Tue Oct 07 11:41:29 PDT 2014,DeleteOnTermination: true},PrivateIpAddresses: [{PrivateIpAddress: 10.32.1.243,PrivateDnsName: ip-10-32-1-243.us-east-1.compute.internal,Primary: true,}]}],EbsOptimized: false,}
Oct 07, 2014 11:41:29 AM hudson.plugins.ec2.SlaveTemplate provisionOndemand
INFO: No existing instance found - created: {InstanceId: i-2bcdeb44,ImageId: ami-abcda06b,State: {Code: 0,Name: pending},PrivateDnsName: ip-10-32-1-243.us-east-1.compute.internal,PublicDnsName: ,StateTransitionReason: ,KeyName: jenkins-builder,AmiLaunchIndex: 0,ProductCodes: [],InstanceType: m3.large,LaunchTime: Tue Oct 07 11:41:29 PDT 2014,Placement: {AvailabilityZone: us-east-1a,GroupName: ,Tenancy: default},KernelId: aki-98e26fa8,Monitoring: {State: disabled},SubnetId: subnet-1a2bce59,VpcId: vpc-26a44a43,PrivateIpAddress: 10.32.1.243,StateReason: {Code: pending,Message: pending},Architecture: x86_64,RootDeviceType: ebs,RootDeviceName: /dev/sda1,BlockDeviceMappings: [],VirtualizationType: paravirtual,ClientToken: 2988c7e3-b1ae-4d35-b294-9c1fc36b9d62,Tags: [{Key: Service,Value: jenkins}, {Key: Name,Value: jenkins-builder.elastic}, {Key: Stage,Value: prod}, {Key: Team,Value: releng}, {Key: created_by,Value: ci.corp.mydomain.com}],SecurityGroups: [{GroupName: corp,GroupId: sg-e9bb378c}, {GroupName: jenkins,GroupId: sg-1237d80c}],SourceDestCheck: true,Hypervisor: xen,NetworkInterfaces: [{NetworkInterfaceId: eni-d6fbeeb3,SubnetId: subnet-1a2bce59,VpcId: vpc-26a44a43,Description: ,OwnerId: 742630462602,Status: in-use,PrivateIpAddress: 10.32.1.243,PrivateDnsName: ip-10-32-1-243.us-east-1.compute.internal,SourceDestCheck: true,Groups: [{GroupName: corp,GroupId: sg-e9bb378c}, {GroupName: jenkins,GroupId: sg-1237d80c}],Attachment: {AttachmentId: eni-attach-a0b54396,DeviceIndex: 0,Status: attaching,AttachTime: Tue Oct 07 11:41:29 PDT 2014,DeleteOnTermination: true},PrivateIpAddresses: [{PrivateIpAddress: 10.32.1.243,PrivateDnsName: ip-10-32-1-243.us-east-1.compute.internal,Primary: true,}]}],EbsOptimized: false,}
Oct 07, 2014 11:41:29 AM hudson.plugins.ec2.EC2RetentionStrategy start
INFO: Start requested for aws builder (i-2bcdeb44)
No existing instance found - created: {InstanceId: i-a709e7ad,ImageId: ami-abcda06b,State: {Code: 0,Name: pending},PrivateDnsName: ip-10-32-1-22.us-east-1.compute.internal,PublicDnsName: ,StateTransitionReason: ,KeyName: jenkins-builder,AmiLaunchIndex: 0,ProductCodes: [],InstanceType: m3.large,LaunchTime: Tue Oct 07 11:41:30 PDT 2014,Placement: {AvailabilityZone: us-east-1a,GroupName: ,Tenancy: default},KernelId: aki-98e26fa8,Monitoring: {State: disabled},SubnetId: subnet-1a2bce59,VpcId: vpc-26a44a43,PrivateIpAddress: 10.32.1.22,StateReason: {Code: pending,Message: pending},Architecture: x86_64,RootDeviceType: ebs,RootDeviceName: /dev/sda1,BlockDeviceMappings: [],VirtualizationType: paravirtual,ClientToken: 171b131a-7067-4ac8-b106-89e1400304b1,Tags: [{Key: Service,Value: jenkins}, {Key: Name,Value: jenkins-builder.elastic}, {Key: Stage,Value: prod}, {Key: Team,Value: releng}, {Key: created_by,Value: ci.corp.mydomain.com}],SecurityGroups: [{GroupName: corp,GroupId: sg-e9bb378c}, {GroupName: jenkins,GroupId: sg-1237d80c}],SourceDestCheck: true,Hypervisor: xen,NetworkInterfaces: [{NetworkInterfaceId: eni-d1fbeeb4,SubnetId: subnet-1a2bce59,VpcId: vpc-26a44a43,Description: ,OwnerId: 742630462602,Status: in-use,PrivateIpAddress: 10.32.1.22,PrivateDnsName: ip-10-32-1-22.us-east-1.compute.internal,SourceDestCheck: true,Groups: [{GroupName: corp,GroupId: sg-e9bb378c}, {GroupName: jenkins,GroupId: sg-1237d80c}],Attachment: {AttachmentId: eni-attach-3ab3450c,DeviceIndex: 0,Status: attaching,AttachTime: Tue Oct 07 11:41:30 PDT 2014,DeleteOnTermination: true},PrivateIpAddresses: [{PrivateIpAddress: 10.32.1.22,PrivateDnsName: ip-10-32-1-22.us-east-1.compute.internal,Primary: true,}]}],EbsOptimized: false,}
Oct 07, 2014 11:41:30 AM hudson.plugins.ec2.SlaveTemplate provisionOndemand
INFO: No existing instance found - created: {InstanceId: i-a709e7ad,ImageId: ami-abcda06b,State: {Code: 0,Name: pending},PrivateDnsName: ip-10-32-1-22.us-east-1.compute.internal,PublicDnsName: ,StateTransitionReason: ,KeyName: jenkins-builder,AmiLaunchIndex: 0,ProductCodes: [],InstanceType: m3.large,LaunchTime: Tue Oct 07 11:41:30 PDT 2014,Placement: {AvailabilityZone: us-east-1a,GroupName: ,Tenancy: default},KernelId: aki-98e26fa8,Monitoring: {State: disabled},SubnetId: subnet-1a2bce59,VpcId: vpc-26a44a43,PrivateIpAddress: 10.32.1.22,StateReason: {Code: pending,Message: pending},Architecture: x86_64,RootDeviceType: ebs,RootDeviceName: /dev/sda1,BlockDeviceMappings: [],VirtualizationType: paravirtual,ClientToken: 171b131a-7067-4ac8-b106-89e1400304b1,Tags: [{Key: Service,Value: jenkins}, {Key: Name,Value: jenkins-builder.elastic}, {Key: Stage,Value: prod}, {Key: Team,Value: releng}, {Key: created_by,Value: ci.corp.mydomain.com}],SecurityGroups: [{GroupName: corp,GroupId: sg-e9bb378c}, {GroupName: jenkins,GroupId: sg-1237d80c}],SourceDestCheck: true,Hypervisor: xen,NetworkInterfaces: [{NetworkInterfaceId: eni-d1fbeeb4,SubnetId: subnet-1a2bce59,VpcId: vpc-26a44a43,Description: ,OwnerId: 742630462602,Status: in-use,PrivateIpAddress: 10.32.1.22,PrivateDnsName: ip-10-32-1-22.us-east-1.compute.internal,SourceDestCheck: true,Groups: [{GroupName: corp,GroupId: sg-e9bb378c}, {GroupName: jenkins,GroupId: sg-1237d80c}],Attachment: {AttachmentId: eni-attach-3ab3450c,DeviceIndex: 0,Status: attaching,AttachTime: Tue Oct 07 11:41:30 PDT 2014,DeleteOnTermination: true},PrivateIpAddresses: [{PrivateIpAddress: 10.32.1.22,PrivateDnsName: ip-10-32-1-22.us-east-1.compute.internal,Primary: true,}]}],EbsOptimized: false,}
O