[ https://issues.apache.org/jira/browse/CLOUDSTACK-5598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sudha Ponnaganti updated CLOUDSTACK-5598: ----------------------------------------- Environment: host XS 6.2 + hot fix installed : XS62E001 XS62E002 XS62E004 XS62E005 XS62E007 XS62E008 XS62E009 XS62E010 XS62E011 XS62E012 XS62E013 was: MS 3.0.7 Patch D CloudStack-PATCH_D-3.0.7-7-rhel6.3.tar.gz host XS 6.2 + hot fix installed : XS62E001 XS62E002 XS62E004 XS62E005 XS62E007 XS62E008 XS62E009 XS62E010 XS62E011 XS62E012 XS62E013 > XEN patch/hotfix certification - XS 6.2 SP1 patch installation fail > ------------------------------------------------------------------- > > Key: CLOUDSTACK-5598 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5598 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) > Components: Management Server > Affects Versions: pre-4.0.0 > Environment: host XS 6.2 + hot fix installed : > XS62E001 > XS62E002 > XS62E004 > XS62E005 > XS62E007 > XS62E008 > XS62E009 > XS62E010 > XS62E011 > XS62E012 > XS62E013 > Reporter: angeline shen > Priority: Critical > Fix For: pre-4.0.0 > > > Per http://wiki-ccp.citrix.com/pages/viewpage.action?pageId=11829631 > Xen Patch installation procedure > 1. completed steps 1 thru 7 to upgrade master XEN host to XS 6.2 + 6.2 SP1 > 2. On slave host, perform step 8: on MS put slave host in maintenance mode > Result: On slave host: all guest VMs fail to migrate to master host, slave > host remained in Preparemaintenance mode > MS Log: > 2013-12-19 18:51:37,965 DEBUG [cloud.capacity.CapacityManagerImpl] > (HA-Worker-0:work-2) CPU STATS after allocation: for host: 1, old used: 2100, > old reserved: 0, actual total: 9044, total with overprovisioning: 9044; new > us > ed:2600, reserved:0; requested cpu:500,alloc_from_last:false > 2013-12-19 18:51:37,965 DEBUG [cloud.capacity.CapacityManagerImpl] > (HA-Worker-0:work-2) RAM STATS after allocation: for host: 1, old used: > 2818572288, old reserved: 0, total: 16001258112; new used: 3087007744, > reserved: 0; > requested mem: 268435456,alloc_from_last:false > 2013-12-19 18:51:37,976 DEBUG [agent.transport.Request] (HA-Worker-0:work-2) > Seq 5-357629969: Waiting for Seq 357629965 Scheduling: { Cmd , MgmtId: > 7692017993539, via: 5, Ver: v1, Flags: 100111, [{"MigrateCommand":{"vmName > ":"s-1-VM","destIp":"10.223.51.3","hostGuid":"95273a98-5144-42a8-8fb9-2e9761ff2320","isWindows":false,"wait":0}}] > } > 2013-12-19 18:51:38,146 WARN [xen.resource.CitrixResourceBase] > (DirectAgent-11:null) Task failed! Task record: uuid: > 4ea260eb-f447-cf59-fc0a-ab830d87f9d4 > nameLabel: Async.VM.pool_migrate > nameDescription: > allowedOperations: [] currentOperations: {} created: Thu > Dec 19 18:54:55 PST 2013 finished: Thu Dec 19 18:54:55 PST 2013 > status: FAILURE > residentOn: com.xensource.xenapi.Host@6d9f1105 > progress: 1.0 > type: <none/> result: errorInfo: > [VM_REQUIRES_SR, OpaqueRef:b68a7638-2937-58ea-0f5d-52cc3e2f6905, > OpaqueRef:fb25c62b-174a-2a50-fdc0-9ff47c37170c] > otherConfig: {} subtaskOf: > com.xensource.xenapi.Task@aaf13f6f subtasks: [] 2013-12-19 > 18:51:38,149 WARN [xen.resource.CitrixResourceBase] (DirectAgent-11:null) > Unable to migrate VM(i-2-3-VM) from > host(f6c18d41-fa40-440b-932d-f84bf64e5772) due to Task failed! Task record: > uuid: 4ea260eb-f447-cf59-fc0a-ab830d87f9d4 > nameLabel: Async.VM.pool_migrate nameDescription: > allowedOperations: [] > currentOperations: {} > created: Thu Dec 19 18:54:55 PST 2013 > finished: Thu Dec 19 18:54:55 PST 2013 > status: FAILURE > residentOn: com.xensource.xenapi.Host@6d9f1105 > progress: 1.0 > type: <none/> > result: > errorInfo: [VM_REQUIRES_SR, > OpaqueRef:b68a7638-2937-58ea-0f5d-52cc3e2f6905, > OpaqueRef:fb25c62b-174a-2a50-fdc0-9ff47c37170c] > otherConfig: {} > subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > Task failed! Task record: uuid: > 4ea260eb-f447-cf59-fc0a-ab830d87f9d4 > nameLabel: Async.VM.pool_migrate > nameDescription: > allowedOperations: [] > currentOperations: {} created: Thu Dec 19 18:54:55 PST 2013 > finished: Thu Dec 19 18:54:55 PST 2013 > status: FAILURE > residentOn: com.xensource.xenapi.Host@6d9f1105 > progress: 1.0 > type: <none/> > result: > errorInfo: [VM_REQUIRES_SR, > OpaqueRef:b68a7638-2937-58ea-0f5d-52cc3e2f6905, > OpaqueRef:fb25c62b-174a-2a50-fdc0-9ff47c37170c] > otherConfig: {} > subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > at > com.cloud.hypervisor.xen.resource.CitrixResourceBase.checkForSuccess(CitrixResourceBase.java:3178) > at > com.cloud.hypervisor.xen.resource.CitrixResourceBase.migrateVM(CitrixResourceBase.java:3324) > at > com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:2877) > at > com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:441) > at > com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:55) > at > com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:217) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > > at java.lang.Thread.run(Thread.java:679) > 2013-12-19 18:51:38,153 WARN [xen.resource.CitrixResourceBase] > (DirectAgent-11:null) Catch Exception > com.cloud.utils.exception.CloudRuntimeException: Migration failed due to > com.cloud.utils.exception.CloudRuntimeException: Unable to migrate > VM(i-2-3-VM) from host(f6c18d41-fa40-440b-932d-f84bf64e5772) due to Task > failed! Task record: uuid: > 4ea260eb-f447-cf59-fc0a-ab830d87f9d4 > nameLabel: Async.VM.pool_migrate > nameDescription: > allowedOperations: [] > currentOperations: {} > created: Thu Dec 19 18:54:55 PST 2013 > finished: Thu Dec 19 18:54:55 PST 2013 > status: FAILURE > residentOn: com.xensource.xenapi.Host@6d9f1105 > progress: 1.0 > type: <none/> > result: > errorInfo: [VM_REQUIRES_SR, > OpaqueRef:b68a7638-2937-58ea-0f5d-52cc3e2f6905, > OpaqueRef:fb25c62b-174a-2a50-fdc0-9ff47c37170c] > otherConfig: {} > subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > com.cloud.utils.exception.CloudRuntimeException: Unable to migrate > VM(i-2-3-VM) from host(f6c18d41-fa40-440b-932d-f84bf64e5772) due to Task > failed! Task record: uuid: > 4ea260eb-f447-cf59-fc0a-ab830d87f9d4 > nameLabel: Async.VM.pool_migrate > nameDescription: > allowedOperations: [] > currentOperations: {} > created: Thu Dec 19 18:54:55 PST 2013 > finished: Thu Dec 19 18:54:55 PST 2013 > status: FAILURE > residentOn: com.xensource.xenapi.Host@6d9f1105 > progress: 1.0 > type: <none/> > result: > errorInfo: [VM_REQUIRES_SR, > OpaqueRef:b68a7638-2937-58ea-0f5d-52cc3e2f6905, > OpaqueRef:fb25c62b-174a-2a50-fdc0-9ff47c37170c] > otherConfig: {} > subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > at > com.cloud.hypervisor.xen.resource.CitrixResourceBase.migrateVM(CitrixResourceBase.java:3335) > > at > com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:2877) > > at > com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:441) > > at > com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:55) > > at > com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:217) > > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) > > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) > > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > > at java.lang.Thread.run(Thread.java:679) > 2013-12-19 18:51:38,154 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-11:null) 6. The VM i-2-3-VM is in Migrating state > 2013-12-19 18:51:38,155 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-11:null) Seq 5-357629965: Response Received: > 2013-12-19 18:51:38,155 DEBUG [agent.transport.Request] (DirectAgent-11:null) > Seq 5-357629965: Processing: { Ans: , MgmtId: 7692017993539, via: 5, Ver: > v1, Flags: 110, [{"MigrateAnswer":{"result":false,"details":"Catch Exception > com.cloud.utils.exception.CloudRuntimeException: Migration failed due to > com.cloud.utils.exception.CloudRuntimeException: Unable to migrate > VM(i-2-3-VM) from host(f6c18d41-fa40-440b-932d-f84bf64e5772) due to Task > failed! Task record: uuid: > 4ea260eb-f447-cf59-fc0a-ab830d87f9d4\n nameLabel: > Async.VM.pool_migrate\n nameDescription: \n allowedOperations: []\n > currentOperations: {}\n created: Thu Dec 19 18:54:55 PST 2013\n > finished: Thu Dec 19 18:54:55 PST 2013\n status: > FAILURE\n residentOn: com.xensource.xenapi.Host@6d9f1105\n > progress: 1.0\n type: <none/>\n result: \n > errorInfo: [VM_REQUIRES_SR, > OpaqueRef:b68a7638-2937-58ea-0f5d-52cc3e2f6905, > OpaqueRef:fb25c62b-174a-2a50-fdc0-9ff47c37170c]\n otherConfig: {}\n > subtaskOf: com.xensource.xenapi.Task@aaf13f6f\n subtasks: > []\n","wait":0}}] } > 2013-12-19 18:51:38,155 DEBUG [agent.transport.Request] (HA-Worker-4:work-4) > Seq 5-357629965: Received: { Ans: , MgmtId: 7692017993539, via: 5, Ver: v1, > Flags: 110, { MigrateAnswer } } > 2013-12-19 18:51:38,155 ERROR [cloud.vm.VirtualMachineManagerImpl] > (HA-Worker-4:work-4) Unable to migrate due to Catch Exception > com.cloud.utils.exception.CloudRuntimeException: Migration failed due to > com.cloud.utils.exception.CloudRuntimeException: Unable to migrate > VM(i-2-3-VM) from host(f6c18d41-fa40-440b-932d-f84bf64e5772) due to Task > failed! Task record: uuid: > 4ea260eb-f447-cf59-fc0a-ab830d87f9d4 > nameLabel: Async.VM.pool_migrate > nameDescription: > allowedOperations: [] > currentOperations: {} > created: Thu Dec 19 18:54:55 PST 2013 > finished: Thu Dec 19 18:54:55 PST 2013 > status: FAILURE > residentOn: com.xensource.xenapi.Host@6d9f1105 > progress: 1.0 > type: <none/> > result: > errorInfo: [VM_REQUIRES_SR, > OpaqueRef:b68a7638-2937-58ea-0f5d-52cc3e2f6905, > OpaqueRef:fb25c62b-174a-2a50-fdc0-9ff47c37170c] > otherConfig: {} > subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > 2013-12-19 18:51:38,157 INFO [cloud.vm.VirtualMachineManagerImpl] > (HA-Worker-4:work-4) Migration was unsuccessful. Cleaning up: VM[User|z1V55] > 2013-12-19 18:51:38,162 DEBUG [agent.manager.AgentAttache] > (DirectAgent-11:null) Seq 5-357629966: Sending now. is current sequence. > 2013-12-19 18:51:38,162 DEBUG [agent.transport.Request] (DirectAgent-11:null) > Seq 5-357629966: Executing: { Cmd , MgmtId: 7692017993539, via: 5, Ver: v1, > Flags: 100111, > [{"MigrateCommand":{"vmName":"i-2-5-VM","destIp":"10.223.51.3","hostGuid":"95273a98-5144-42a8-8fb9-2e9761ff2320","isWindows":true,"wait":0}}] > } > 2013-12-19 18:51:38,163 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-32:null) Seq 5-357629966: Executing request > 2013-12-19 18:51:38,169 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-32:null) 5. The VM i-2-5-VM is in Stopping state > 2013-12-19 18:51:38,188 DEBUG [cloud.alert.AlertManagerImpl] > (HA-Worker-4:work-4) Have already sent: 1 emails for alert type '16' -- > skipping send email > 2013-12-19 18:51:38,195 DEBUG [agent.manager.AgentAttache] > (HA-Worker-4:work-4) Seq 1-2027094047: Routed from 7692017993539 > 2013-12-19 18:51:38,196 DEBUG [agent.transport.Request] (HA-Worker-4:work-4) > Seq 1-2027094047: Sending { Cmd , MgmtId: 7692017993539, via: 1, Ver: v1, > Flags: 100111, > [{"StopCommand":{"isProxy":false,"vmName":"i-2-3-VM","wait":0}}] } > 2013-12-19 18:51:38,196 DEBUG [agent.transport.Request] (HA-Worker-4:work-4) > Seq 1-2027094047: Executing: { Cmd , MgmtId: 7692017993539, via: 1, Ver: v1, > Flags: 100111, > [{"StopCommand":{"isProxy":false,"vmName":"i-2-3-VM","wait":0}}] } > 2013-12-19 18:51:38,201 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-31:null) Seq 1-2027094047: Executing request > 2013-12-19 18:51:38,218 DEBUG [cloud.capacity.CapacityManagerImpl] > (HA-Worker-4:work-4) VM state transitted from :Migrating to Running with > event: OperationFailedvm's original host id: 5 new host id: 5 host id before > state transition: 1 > 2013-12-19 18:51:38,235 DEBUG [cloud.capacity.CapacityManagerImpl] > (HA-Worker-4:work-4) Hosts's actual total CPU: 9044 and CPU after applying > overprovisioning: 9044 > 2013-12-19 18:51:38,235 DEBUG [cloud.capacity.CapacityManagerImpl] > (HA-Worker-4:work-4) release cpu from host: 1, old used: 2600,reserved: 0, > actual total: 9044, total with overprovisioning: 9044; new used: > 2500,reserved:0;: > ................. > 2013-12-19 18:51:38,269 INFO [cloud.ha.HighAvailabilityManagerImpl] > (HA-Worker-4:work-4) Completed HAWork[4-Migration-3-Running-Migrating] > 2013-12-19 18:51:39,240 WARN [xen.resource.CitrixResourceBase] > (DirectAgent-32:null) Task failed! Task record: uuid: > 894a3994-629b-3e78-fb76-7721e97d3631 > nameLabel: Async.VM.pool_migrate > nameDescription: > allowedOperations: [] > currentOperations: {} > created: Thu Dec 19 18:54:56 PST 2013 > finished: Thu Dec 19 18:54:56 PST 2013 > status: FAILURE > residentOn: com.xensource.xenapi.Host@6d9f1105 > progress: 1.0 > type: <none/> > result: > errorInfo: [VM_REQUIRES_SR, > OpaqueRef:9de12ea0-134a-9f90-802c-c956ad12bf9d, > OpaqueRef:fb25c62b-174a-2a50-fdc0-9ff47c37170c] > otherConfig: {} > subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > 2013-12-19 18:51:39,244 WARN [xen.resource.CitrixResourceBase] > (DirectAgent-32:null) Unable to migrate VM(i-2-5-VM) from > host(f6c18d41-fa40-440b-932d-f84bf64e5772) due to Task failed! Task record: > uuid: 894a3994-629b-3e78-fb76-7721e97d3631 > nameLabel: Async.VM.pool_migrate > nameDescription: > allowedOperations: [] > currentOperations: {} > created: Thu Dec 19 18:54:56 PST 2013 > finished: Thu Dec 19 18:54:56 PST 2013 > status: FAILURE > residentOn: com.xensource.xenapi.Host@6d9f1105 > progress: 1.0 > type: <none/> > result: > errorInfo: [VM_REQUIRES_SR, > OpaqueRef:9de12ea0-134a-9f90-802c-c956ad12bf9d, > OpaqueRef:fb25c62b-174a-2a50-fdc0-9ff47c37170c] > otherConfig: {} > subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > Task failed! Task record: uuid: > 894a3994-629b-3e78-fb76-7721e97d3631 > nameLabel: Async.VM.pool_migrate > nameDescription: > allowedOperations: [] > currentOperations: {} > created: Thu Dec 19 18:54:56 PST 2013 > finished: Thu Dec 19 18:54:56 PST 2013 > status: FAILURE > residentOn: com.xensource.xenapi.Host@6d9f1105 > progress: 1.0 > type: <none/> > result: > errorInfo: [VM_REQUIRES_SR, > OpaqueRef:9de12ea0-134a-9f90-802c-c956ad12bf9d, > OpaqueRef:fb25c62b-174a-2a50-fdc0-9ff47c37170c] > otherConfig: {} > subtaskOf: com.xensource.xenapi.Task@aaf13f6f > subtasks: [] > > 1. install new xencenter > Hotfix XS62ESP1001 - For XenServer 6.2.0 Service Pack 1 > > xencenter > http://support.citrix.com/article/CTX139790 > > download > http://downloadns.citrix.com.edgesuite.net/8708/XenCenter.msi > https://www.citrix.com/go/private/vgpu.html > http://support.citrix.com/article/CTX139789 XS620SP1_ReleaseNotes.pdf > Compatibility > Service Pack 1 (XS62ESP1) can be installed on XenServer 6.2.0 with any > publically available hotfix combination > (of the form XS62Ennn). > The Service Pack includes all functionality included in hotfixes 1-12 for > XenServer 6.2.0 (XS62E001 – XS62E012). > • Before installing Service Pack 1, customers should upgrade > XenCenter. > • After installing Service Pack 1 (SP1) customers will be required to > reboot their hosts and upgrade the XenServer Tools in all Virtual > Machines (Windows and Linux VMs). > For full installation details, refer to CTX139788. > Warning: Customers who have installed a hotfix of the form > XS62Ennn, where nnn is greater than 13, should install SP1 and then > ensure that they also install the corresponding hotfix for SP1 (of the form > XS62ESP1nnn), in order to achieve the same patch level. > Note: There is no requirement to install any hotfixes before > applying Service Pack 1. > Note: Customers who have previously installed the vGPU Tech Preview > (XS62ETP001) on a host, > cannot subsequently install Service Pack 1. Customers wishing to > install Service Pack 1 will need to do a fresh installation of > XenServer 6.2.0, before installing Service Pack 1. -- This message was sent by Atlassian JIRA (v6.1.5#6160)