Chandan Purushothama created CLOUDSTACK-128:
-----------------------------------------------
Summary: Delete Account Job is not waiting for the Network
Destruction to complete before marking the Account as removed in the Database
Key: CLOUDSTACK-128
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-128
Project: CloudStack
Issue Type: Bug
Components: Management Server
Affects Versions: pre-4.0.0
Reporter: Chandan Purushothama
Fix For: pre-4.0.0
===============
Steps to Reproduce:
===============
1. Create an Account. Log into as the Account's User.
2. Create an Isolated Guest Network using
DefaultNetworkOfferingwithSourceNATService Network Offering.
3. Deploy a VM in that Isolated Guest Network.
4. Log out of the Account
5. Login as ROOT domain Admin.
6. Delete the Account created in Step1.
===========
Observations:
===========
============================
Unable to destroy the Guest Network:
============================
2012-09-17 11:26:00,744 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-12:job-21) Successfully released network resources for the vm
VM[DomainRouter|r-17-ASF]
2012-09-17 11:26:00,744 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-12:job-21) Successfully released storage resources for the vm
VM[DomainRouter|r-17-ASF]
2012-09-17 11:26:00,748 DEBUG [vm.dao.VMInstanceDaoImpl]
(Job-Executor-12:job-21) Unable to update VM[DomainRouter|r-17-ASF]: DB
Data={Host=1; State=Stopping; updated=5; time=Mon Sep 17 11:26:00 PDT 2012} New
Data: {Host=null; State=Stopped; updated=5; time=Mon Sep 17 11:26:00 PDT 2012}
Stale Data: {Host=1; State=Stopping; updated=4; time=Mon Sep 17 11:25:11 PDT
2012}
2012-09-17 11:26:00,748 WARN [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Unable to complete shutdown of the network elements
due to element: VirtualRouter
2012-09-17 11:26:00,756 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Network is not not in the correct state to be
destroyed: Implemented
2012-09-17 11:26:00,756 WARN [cloud.user.AccountManagerImpl]
(Job-Executor-12:job-21) Unable to destroy network Ntwk[210|Guest|8] as a part
of account id=6 cleanup.
===================
Delete Account Job:
===================
[root@asfmgmt ~]# grep -i "job-21"
/var/log/cloud/management/management-server.log
2012-09-17 11:23:35,394 DEBUG [cloud.async.AsyncJobManagerImpl]
(catalina-exec-16:null) submit async job-21, details: AsyncJobVO {id:21,
userId: 2, accountId: 2, sessionKey: null, instanceType: Account, instanceId:
null, cmd: com.cloud.api.commands.DeleteAccountCmd, cmdOriginator: null,
cmdInfo:
{"response":"json","id":"e4438e90-4e5d-446a-b274-57f235b2e0ae","sessionkey":"u6LWTaW5070wtlr1F3LOD5CWBE8\u003d","ctxUserId":"2","_":"1347906467807","ctxAccountId":"2","ctxStartEventId":"138"},
cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0,
processStatus: 0, resultCode: 0, result: null, initMsid: 7471666038533,
completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
2012-09-17 11:23:35,398 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-12:job-21) Executing com.cloud.api.commands.DeleteAccountCmd for
job-21
2012-09-17 11:23:35,421 DEBUG [cloud.user.AccountManagerImpl]
(Job-Executor-12:job-21) Removed account 6
2012-09-17 11:23:35,444 DEBUG [cloud.user.AccountManagerImpl]
(Job-Executor-12:job-21) Successfully deleted snapshots directories for all
volumes under account 6 across all zones
2012-09-17 11:23:35,448 DEBUG [cloud.user.AccountManagerImpl]
(Job-Executor-12:job-21) Expunging # of vms (accountId=6): 1
2012-09-17 11:23:35,465 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-12:job-21) VM state transitted from :Running to Stopping with
event: StopRequestedvm's original host id: 1 new host id: 1 host id before
state transition: 1
2012-09-17 11:23:35,467 DEBUG [agent.transport.Request]
(Job-Executor-12:job-21) Seq 1-402924740: Sending { Cmd , MgmtId:
7471666038533, via: 1, Ver: v1, Flags: 100111,
[{"StopCommand":{"isProxy":false,"vmName":"i-6-16-ASF","wait":0}}] }
2012-09-17 11:23:35,467 DEBUG [agent.transport.Request]
(Job-Executor-12:job-21) Seq 1-402924740: Executing: { Cmd , MgmtId:
7471666038533, via: 1, Ver: v1, Flags: 100111,
[{"StopCommand":{"isProxy":false,"vmName":"i-6-16-ASF","wait":0}}] }
2012-09-17 11:23:59,949 DEBUG [agent.transport.Request]
(Job-Executor-12:job-21) Seq 1-402924740: Received: { Ans: , MgmtId:
7471666038533, via: 1, Ver: v1, Flags: 110, { StopAnswer } }
2012-09-17 11:23:59,950 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-12:job-21) VM[User|photons-regnet-VM-1] is stopped on the host.
Proceeding to release resource held.
2012-09-17 11:23:59,961 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Service SecurityGroup is not supported in the network
id=210
2012-09-17 11:23:59,967 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Changing active number of nics for network id=210 on -1
2012-09-17 11:23:59,972 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking VirtualRouter to release
Nic[35-16-d6600aa5-ccbb-401b-a313-242ef2aa2559-10.1.1.154]
2012-09-17 11:23:59,972 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking Ovs to release
Nic[35-16-d6600aa5-ccbb-401b-a313-242ef2aa2559-10.1.1.154]
2012-09-17 11:23:59,972 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking ExternalDhcpServer to release
Nic[35-16-d6600aa5-ccbb-401b-a313-242ef2aa2559-10.1.1.154]
2012-09-17 11:23:59,972 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking BareMetal to release
Nic[35-16-d6600aa5-ccbb-401b-a313-242ef2aa2559-10.1.1.154]
2012-09-17 11:23:59,972 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking SecurityGroupProvider to release
Nic[35-16-d6600aa5-ccbb-401b-a313-242ef2aa2559-10.1.1.154]
2012-09-17 11:23:59,972 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking VpcVirtualRouter to release
Nic[35-16-d6600aa5-ccbb-401b-a313-242ef2aa2559-10.1.1.154]
2012-09-17 11:23:59,972 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking NiciraNvp to release
Nic[35-16-d6600aa5-ccbb-401b-a313-242ef2aa2559-10.1.1.154]
2012-09-17 11:23:59,972 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-12:job-21) Successfully released network resources for the vm
VM[User|photons-regnet-VM-1]
2012-09-17 11:23:59,972 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-12:job-21) Successfully released storage resources for the vm
VM[User|photons-regnet-VM-1]
2012-09-17 11:23:59,996 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Service SecurityGroup is not supported in the network
id=210
2012-09-17 11:23:59,998 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Service SecurityGroup is not supported in the network
id=210
2012-09-17 11:23:59,998 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-12:job-21) VM state transitted from :Stopping to Stopped with
event: OperationSucceededvm's original host id: 1 new host id: null host id
before state transition: 1
2012-09-17 11:24:00,001 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-12:job-21) Hosts's actual total CPU: 9044 and CPU after applying
overprovisioning: 9044
2012-09-17 11:24:00,001 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-12:job-21) release cpu from host: 1, old used: 4600,reserved: 0,
actual total: 9044, total with overprovisioning: 9044; new used:
4500,reserved:100; movedfromreserved: false,moveToReserveredtrue
2012-09-17 11:24:00,001 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-12:job-21) release mem from host: 1, old used:
2952790016,reserved: 0, total: 16190149248; new used:
2818572288,reserved:134217728; movedfromreserved: false,moveToReserveredtrue
2012-09-17 11:24:00,018 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-12:job-21) VM state transitted from :Stopped to Expunging with
event: ExpungeOperationvm's original host id: 1 new host id: null host id
before state transition: null
2012-09-17 11:24:00,021 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-12:job-21) Hosts's actual total CPU: 9044 and CPU after applying
overprovisioning: 9044
2012-09-17 11:24:00,021 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-12:job-21) release cpu from host: 1, old used: 4500,reserved:
100, actual total: 9044, total with overprovisioning: 9044; new used:
4500,reserved:0; movedfromreserved: true,moveToReserveredfalse
2012-09-17 11:24:00,021 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-12:job-21) release mem from host: 1, old used:
2818572288,reserved: 134217728, total: 16190149248; new used:
2818572288,reserved:0; movedfromreserved: true,moveToReserveredfalse
2012-09-17 11:24:00,041 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-12:job-21) Destroying vm VM[User|photons-regnet-VM-1]
2012-09-17 11:24:00,041 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-12:job-21) Cleaning up NICS
2012-09-17 11:24:00,041 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Cleaning network for vm: 16
2012-09-17 11:24:00,048 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Service SecurityGroup is not supported in the network
id=210
2012-09-17 11:24:00,059 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Removed nic id=35
2012-09-17 11:24:00,059 DEBUG [cloud.storage.StorageManagerImpl]
(Job-Executor-12:job-21) Cleaning storage for vm: 16
2012-09-17 11:24:00,085 DEBUG [cloud.storage.StorageManagerImpl]
(Job-Executor-12:job-21) Expunging Vol[17|vm=16|ROOT]
2012-09-17 11:24:00,091 DEBUG [agent.transport.Request]
(Job-Executor-12:job-21) Seq 1-402924744: Waiting for Seq 402924741 Scheduling:
{ Cmd , MgmtId: 7471666038533, via: 1, Ver: v1, Flags: 100111,
[{"storage.DestroyCommand":{"vmName":"i-6-16-ASF","volume":{"id":17,"name":"ROOT-16","mountPoint":"/export/home/chandan/asf4-195-103/primary","path":"1863759a-0122-40ff-a86d-4ddd8e26b511","size":21474836480,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"bea72bcf-de5a-38a4-bfad-ec4a966f5f63","deviceId":0},"wait":0}}]
}
2012-09-17 11:25:08,511 DEBUG [agent.transport.Request]
(Job-Executor-12:job-21) Seq 1-402924744: Received: { Ans: , MgmtId:
7471666038533, via: 1, Ver: v1, Flags: 110, { Answer } }
2012-09-17 11:25:08,525 DEBUG [cloud.storage.StorageManagerImpl]
(Job-Executor-12:job-21) Volume successfully expunged from 200
2012-09-17 11:25:08,525 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-12:job-21) Expunged VM[User|photons-regnet-VM-1]
2012-09-17 11:25:08,525 DEBUG [cloud.vm.UserVmManagerImpl]
(Job-Executor-12:job-21) Starting cleaning up vm VM[User|photons-regnet-VM-1]
resources...
2012-09-17 11:25:08,569 DEBUG [network.firewall.FirewallManagerImpl]
(Job-Executor-12:job-21) No firewall rules are found for vm id=16
2012-09-17 11:25:08,569 DEBUG [cloud.vm.UserVmManagerImpl]
(Job-Executor-12:job-21) Firewall rules are removed successfully as a part of
vm id=16 expunge
2012-09-17 11:25:08,572 DEBUG [network.rules.RulesManagerImpl]
(Job-Executor-12:job-21) No port forwarding rules are found for vm id=16
2012-09-17 11:25:08,572 DEBUG [cloud.vm.UserVmManagerImpl]
(Job-Executor-12:job-21) Port forwarding rules are removed successfully as a
part of vm id=16 expunge
2012-09-17 11:25:08,574 DEBUG [cloud.vm.UserVmManagerImpl]
(Job-Executor-12:job-21) Removed vm id=16 from all load balancers as a part of
expunge process
2012-09-17 11:25:08,575 DEBUG [cloud.vm.UserVmManagerImpl]
(Job-Executor-12:job-21) Successfully cleaned up vm
VM[User|photons-regnet-VM-1] resources as a part of expunge process
2012-09-17 11:25:08,630 INFO [cloud.user.AccountManagerImpl]
(Job-Executor-12:job-21) deleteAccount: Deleted 1 network groups for account 6
2012-09-17 11:25:08,630 DEBUG [cloud.user.AccountManagerImpl]
(Job-Executor-12:job-21) Deleting networks for account 6
2012-09-17 11:25:08,643 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Releasing 0 port forwarding rules for network id=210
as a part of shutdownNetworkRules
2012-09-17 11:25:08,643 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) There are no rules to forward to the network elements
2012-09-17 11:25:08,644 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Releasing 0 static nat rules for network id=210 as a
part of shutdownNetworkRules
2012-09-17 11:25:08,644 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) There are no rules to forward to the network elements
2012-09-17 11:25:08,644 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) There are no rules to forward to the network elements
2012-09-17 11:25:08,645 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Releasing 0 firewall rules for network id=210 as a
part of shutdownNetworkRules
2012-09-17 11:25:08,645 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) There are no rules to forward to the network elements
2012-09-17 11:25:08,646 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Releasing 0 Network ACLs for network id=210 as a part
of shutdownNetworkRules
2012-09-17 11:25:08,646 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) There are no rules to forward to the network elements
2012-09-17 11:25:08,647 DEBUG [network.rules.RulesManagerImpl]
(Job-Executor-12:job-21) Found 0 static nat rules to apply for network id 210
2012-09-17 11:25:08,658 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-12:job-21)
Applying ip association in network Ntwk[210|Guest|8]
2012-09-17 11:25:08,671 DEBUG [agent.transport.Request]
(Job-Executor-12:job-21) Seq 1-402924753: Sending { Cmd , MgmtId:
7471666038533, via: 1, Ver: v1, Flags: 100001,
[{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":6,"publicIp":"10.223.139.3","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1390","vlanGateway":"10.223.139.1","vlanNetmask":"255.255.255.192","vifMacAddress":"06:8e:62:00:00:0d","networkRate":200,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.3.151","router.name":"r-17-ASF"},"wait":0}}]
}
2012-09-17 11:25:08,671 DEBUG [agent.transport.Request]
(Job-Executor-12:job-21) Seq 1-402924753: Executing: { Cmd , MgmtId:
7471666038533, via: 1, Ver: v1, Flags: 100001,
[{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":6,"publicIp":"10.223.139.3","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1390","vlanGateway":"10.223.139.1","vlanNetmask":"255.255.255.192","vifMacAddress":"06:8e:62:00:00:0d","networkRate":200,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.3.151","router.name":"r-17-ASF"},"wait":0}}]
}
2012-09-17 11:25:11,454 DEBUG [agent.transport.Request]
(Job-Executor-12:job-21) Seq 1-402924753: Received: { Ans: , MgmtId:
7471666038533, via: 1, Ver: v1, Flags: 0, { IpAssocAnswer } }
2012-09-17 11:25:11,458 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Sending network shutdown to VirtualRouter
2012-09-17 11:25:11,461 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-12:job-21)
Stopping router VM[DomainRouter|r-17-ASF]
2012-09-17 11:25:11,469 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-12:job-21) VM state transitted from :Running to Stopping with
event: StopRequestedvm's original host id: 1 new host id: 1 host id before
state transition: 1
2012-09-17 11:25:11,828 DEBUG [agent.transport.Request]
(Job-Executor-12:job-21) Seq 1-402924754: Received: { Ans: , MgmtId:
7471666038533, via: 1, Ver: v1, Flags: 10, { NetworkUsageAnswer } }
2012-09-17 11:25:11,828 DEBUG [agent.manager.AgentManagerImpl]
(Job-Executor-12:job-21) Details from executing class
com.cloud.agent.api.NetworkUsageCommand:
2012-09-17 11:25:11,828 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-12:job-21)
Recieved and Sent bytes are both 0. Not updating user_statistics
2012-09-17 11:25:11,830 DEBUG [agent.transport.Request]
(Job-Executor-12:job-21) Seq 1-402924755: Waiting for Seq 402924747 Scheduling:
{ Cmd , MgmtId: 7471666038533, via: 1, Ver: v1, Flags: 100111,
[{"StopCommand":{"isProxy":false,"vmName":"r-17-ASF","wait":0}}] }
2012-09-17 11:26:00,668 DEBUG [agent.transport.Request]
(Job-Executor-12:job-21) Seq 1-402924755: Received: { Ans: , MgmtId:
7471666038533, via: 1, Ver: v1, Flags: 110, { StopAnswer } }
2012-09-17 11:26:00,674 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-12:job-21)
Successfully updated user statistics as a part of domR
VM[DomainRouter|r-17-ASF] reboot/stop
2012-09-17 11:26:00,683 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-12:job-21) VM[DomainRouter|r-17-ASF] is stopped on the host.
Proceeding to release resource held.
2012-09-17 11:26:00,691 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Service SecurityGroup is not supported in the network
id=210
2012-09-17 11:26:00,702 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking VirtualRouter to release
Nic[36-17-a803fb90-4d15-4ab9-af73-a185eca2393d-10.1.1.1]
2012-09-17 11:26:00,702 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking Ovs to release
Nic[36-17-a803fb90-4d15-4ab9-af73-a185eca2393d-10.1.1.1]
2012-09-17 11:26:00,702 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking ExternalDhcpServer to release
Nic[36-17-a803fb90-4d15-4ab9-af73-a185eca2393d-10.1.1.1]
2012-09-17 11:26:00,702 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking BareMetal to release
Nic[36-17-a803fb90-4d15-4ab9-af73-a185eca2393d-10.1.1.1]
2012-09-17 11:26:00,702 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking SecurityGroupProvider to release
Nic[36-17-a803fb90-4d15-4ab9-af73-a185eca2393d-10.1.1.1]
2012-09-17 11:26:00,702 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking VpcVirtualRouter to release
Nic[36-17-a803fb90-4d15-4ab9-af73-a185eca2393d-10.1.1.1]
2012-09-17 11:26:00,702 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking NiciraNvp to release
Nic[36-17-a803fb90-4d15-4ab9-af73-a185eca2393d-10.1.1.1]
2012-09-17 11:26:00,729 DEBUG [network.guru.ControlNetworkGuru]
(Job-Executor-12:job-21) Released nic: NicProfile[37-17-null-null-null
2012-09-17 11:26:00,736 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking VirtualRouter to release
Nic[37-17-a803fb90-4d15-4ab9-af73-a185eca2393d-null]
2012-09-17 11:26:00,736 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking Ovs to release
Nic[37-17-a803fb90-4d15-4ab9-af73-a185eca2393d-null]
2012-09-17 11:26:00,736 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking ExternalDhcpServer to release
Nic[37-17-a803fb90-4d15-4ab9-af73-a185eca2393d-null]
2012-09-17 11:26:00,736 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking BareMetal to release
Nic[37-17-a803fb90-4d15-4ab9-af73-a185eca2393d-null]
2012-09-17 11:26:00,736 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking SecurityGroupProvider to release
Nic[37-17-a803fb90-4d15-4ab9-af73-a185eca2393d-null]
2012-09-17 11:26:00,736 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking VpcVirtualRouter to release
Nic[37-17-a803fb90-4d15-4ab9-af73-a185eca2393d-null]
2012-09-17 11:26:00,736 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Asking NiciraNvp to release
Nic[37-17-a803fb90-4d15-4ab9-af73-a185eca2393d-null]
2012-09-17 11:26:00,744 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-12:job-21) Successfully released network resources for the vm
VM[DomainRouter|r-17-ASF]
2012-09-17 11:26:00,744 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-12:job-21) Successfully released storage resources for the vm
VM[DomainRouter|r-17-ASF]
2012-09-17 11:26:00,748 DEBUG [vm.dao.VMInstanceDaoImpl]
(Job-Executor-12:job-21) Unable to update VM[DomainRouter|r-17-ASF]: DB
Data={Host=1; State=Stopping; updated=5; time=Mon Sep 17 11:26:00 PDT 2012} New
Data: {Host=null; State=Stopped; updated=5; time=Mon Sep 17 11:26:00 PDT 2012}
Stale Data: {Host=1; State=Stopping; updated=4; time=Mon Sep 17 11:25:11 PDT
2012}
2012-09-17 11:26:00,748 WARN [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Unable to complete shutdown of the network elements
due to element: VirtualRouter
2012-09-17 11:26:00,756 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Network is not not in the correct state to be
destroyed: Implemented
2012-09-17 11:26:00,756 WARN [cloud.user.AccountManagerImpl]
(Job-Executor-12:job-21) Unable to destroy network Ntwk[210|Guest|8] as a part
of account id=6 cleanup.
2012-09-17 11:26:00,757 DEBUG [cloud.user.AccountManagerImpl]
(Job-Executor-12:job-21) Deleting vpcs for account 6
2012-09-17 11:26:00,759 DEBUG [cloud.user.AccountManagerImpl]
(Job-Executor-12:job-21) Releasing ip Ip[10.223.139.3-1] as a part of account
id=6 cleanup
2012-09-17 11:26:00,759 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Revoking all Firewallrules as a part of public IP id=2
release...
2012-09-17 11:26:00,760 DEBUG [network.firewall.FirewallManagerImpl]
(Job-Executor-12:job-21) Releasing 0 firewall rules for ip id=2
2012-09-17 11:26:00,762 DEBUG [network.firewall.FirewallManagerImpl]
(Job-Executor-12:job-21) There are no firewall rules to apply
2012-09-17 11:26:00,763 DEBUG [network.firewall.FirewallManagerImpl]
(Job-Executor-12:job-21) Successfully released firewall rules for ip id=2 and #
of rules now = 0
2012-09-17 11:26:00,763 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Revoking all PortForwarding/StaticNat rules as a part
of public IP id=2 release...
2012-09-17 11:26:00,780 DEBUG [network.rules.RulesManagerImpl]
(Job-Executor-12:job-21) Releasing 0 port forwarding rules for ip id=2
2012-09-17 11:26:00,781 DEBUG [network.rules.RulesManagerImpl]
(Job-Executor-12:job-21) Releasing 0 static nat rules for ip id=2
2012-09-17 11:26:00,782 DEBUG [network.rules.RulesManagerImpl]
(Job-Executor-12:job-21) There are no port forwarding rules to apply for ip id=2
2012-09-17 11:26:00,783 DEBUG [network.rules.RulesManagerImpl]
(Job-Executor-12:job-21) There are no static nat rules to apply for ip id=2
2012-09-17 11:26:00,784 DEBUG [network.rules.RulesManagerImpl]
(Job-Executor-12:job-21) Source ip id=Ip[10.223.139.3-1] is not one to one nat
2012-09-17 11:26:00,785 DEBUG [network.rules.RulesManagerImpl]
(Job-Executor-12:job-21) Successfully released rules for ip id=2 and # of rules
now = 0
2012-09-17 11:26:00,785 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Revoking all LoadBalancing rules as a part of public
IP id=2 release...
2012-09-17 11:26:00,786 DEBUG [network.lb.LoadBalancingRulesManagerImpl]
(Job-Executor-12:job-21) Found 0 lb rules to cleanup
2012-09-17 11:26:00,786 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Cleaning up remote access vpns as a part of public IP
id=2 release...
2012-09-17 11:26:00,787 DEBUG [network.vpn.RemoteAccessVpnManagerImpl]
(Job-Executor-12:job-21) vpn id=2 does not exists
2012-09-17 11:26:00,798 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Releasing ip id=2; sourceNat = true
2012-09-17 11:26:00,819 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-12:job-21)
Router r-17-ASF is in Stopping, so not sending apply ip association commands to
the backend
2012-09-17 11:26:00,819 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Revoking all Firewallrules as a part of public IP id=2
release...
2012-09-17 11:26:00,819 DEBUG [network.firewall.FirewallManagerImpl]
(Job-Executor-12:job-21) Releasing 0 firewall rules for ip id=2
2012-09-17 11:26:00,820 DEBUG [network.firewall.FirewallManagerImpl]
(Job-Executor-12:job-21) There are no firewall rules to apply
2012-09-17 11:26:00,821 DEBUG [network.firewall.FirewallManagerImpl]
(Job-Executor-12:job-21) Successfully released firewall rules for ip id=2 and #
of rules now = 0
2012-09-17 11:26:00,821 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Revoking all PortForwarding/StaticNat rules as a part
of public IP id=2 release...
2012-09-17 11:26:00,822 DEBUG [network.rules.RulesManagerImpl]
(Job-Executor-12:job-21) Releasing 0 port forwarding rules for ip id=2
2012-09-17 11:26:00,822 DEBUG [network.rules.RulesManagerImpl]
(Job-Executor-12:job-21) Releasing 0 static nat rules for ip id=2
2012-09-17 11:26:00,825 DEBUG [network.rules.RulesManagerImpl]
(Job-Executor-12:job-21) There are no port forwarding rules to apply for ip id=2
2012-09-17 11:26:00,826 DEBUG [network.rules.RulesManagerImpl]
(Job-Executor-12:job-21) There are no static nat rules to apply for ip id=2
2012-09-17 11:26:00,827 DEBUG [network.rules.RulesManagerImpl]
(Job-Executor-12:job-21) Source ip id=Ip[10.223.139.3-1] is not one to one nat
2012-09-17 11:26:00,831 DEBUG [network.rules.RulesManagerImpl]
(Job-Executor-12:job-21) Successfully released rules for ip id=2 and # of rules
now = 0
2012-09-17 11:26:00,831 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Revoking all LoadBalancing rules as a part of public
IP id=2 release...
2012-09-17 11:26:00,832 DEBUG [network.lb.LoadBalancingRulesManagerImpl]
(Job-Executor-12:job-21) Found 0 lb rules to cleanup
2012-09-17 11:26:00,832 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Cleaning up remote access vpns as a part of public IP
id=2 release...
2012-09-17 11:26:00,833 DEBUG [network.vpn.RemoteAccessVpnManagerImpl]
(Job-Executor-12:job-21) vpn id=2 does not exists
2012-09-17 11:26:00,833 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Unassiging ip address Ip[10.223.139.3-1]
2012-09-17 11:26:00,838 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-12:job-21) Released a public ip id=2
2012-09-17 11:26:00,838 DEBUG [cloud.user.AccountManagerImpl]
(Job-Executor-12:job-21) Deleting site-to-site VPN customer gateways for
account 6
2012-09-17 11:26:00,873 INFO [cloud.user.AccountManagerImpl]
(Job-Executor-12:job-21) Cleanup for account 6 is needed.
2012-09-17 11:26:00,891 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-12:job-21) Complete async job-21, jobStatus: 1, resultCode: 0,
result: com.cloud.api.response.SuccessResponse@4b0a8734
2012-09-17 11:26:00,900 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-12:job-21) Done executing com.cloud.api.commands.DeleteAccountCmd
for job-21
2012-09-17 11:26:04,714 DEBUG [cloud.async.AsyncJobManagerImpl]
(catalina-exec-24:null) Async job-21 completed
[root@asfmgmt ~]#
=============================
Account & Guest Network Information:
=============================
mysql> select * from account where id=6;
+----+--------------+--------------------------------------+------+-----------+---------+---------------------+----------------+-----------------------+-----------------+
| id | account_name | uuid | type | domain_id | state | removed |
cleanup_needed | network_domain | default_zone_id |
+----+--------------+--------------------------------------+------+-----------+---------+---------------------+----------------+-----------------------+-----------------+
| 6 | photons | e4438e90-4e5d-446a-b274-57f235b2e0ae | 0 | 2 | enabled |
2012-09-17 18:23:35 | 1 | photons.lab.vmops.com | NULL |
+----+--------------+--------------------------------------+------+-----------+---------+---------------------+----------------+-----------------------+-----------------+
1 row in set (0.00 sec)
mysql> select * from networks where account_id=6 \G
*************************** 1. row ***************************
id: 210
name: TestNetwork-photons
uuid: c0132c3f-d10a-4f1f-931d-c24e109771f1
display_text: TestNetwork-photons
traffic_type: Guest
broadcast_domain_type: Vlan
broadcast_uri: NULL
gateway: 10.1.1.1
cidr: 10.1.1.0/24
mode: Dhcp
network_offering_id: 8
physical_network_id: 200
data_center_id: 1
guru_name: ExternalGuestNetworkGuru
state: Allocated
related: 210
domain_id: 2
account_id: 6
dns1: 72.52.126.11
dns2: 72.52.126.12
guru_data: NULL
set_fields: 0
acl_type: Account
network_domain: photons.lab.vmops.com
reservation_id: d6600aa5-ccbb-401b-a313-242ef2aa2559
guest_type: Isolated
restart_required: 0
created: 2012-09-17 18:11:28
removed: NULL
specify_ip_ranges: 0
vpc_id: NULL
1 row in set (0.00 sec)
mysql>
=======
Git Info:
=======
Git Revision: 54f9af1695bc359b02e9fc906b3b335cc0bfec41
Git URL: https://git-wip-us.apache.org/repos/asf/incubator-cloudstack.git
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
