[jira] [Updated] (CLOUDSTACK-7291) LXC: Mgmt server/agent keeps killing systemvms
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Yadav updated CLOUDSTACK-7291: Fix Version/s: (was: 4.3.2) LXC: Mgmt server/agent keeps killing systemvms -- Key: CLOUDSTACK-7291 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7291 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Affects Versions: 4.3.0, 4.3.1 Reporter: Rohit Yadav Followed installation and setup docs of 4.3, was unable to get LXC to work on Ubuntu 14.04/trusty. The systemvms kept coming up and result from ssvm_check.sh was good and it was able to reach mgmt server /host, even then mgmt server complained that it was unable to contact agent on the systemvm (ping), while the agent would gracefully shutdown the systemvm (by killing them). Relevant log: 2014-08-07 19:52:26,294 INFO [c.c.u.e.CSExceptionErrorCode] (secstorage-1:ctx-fc57ef43) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,295 DEBUG [c.c.a.m.AgentAttache] (consoleproxy-1:ctx-e123fa9c) Seq 1-51249205: Cancelling. 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,303 DEBUG [c.c.h.Status] (AgentTaskPool-13:ctx-0b35e679) Transition:[Resource state = Enabled, Agent event = ShutdownRequested, Host id = 1, name = bluebox1.bhaisaab.org] 2014-08-07 19:52:26,311 DEBUG [c.c.h.HighAvailabilityManagerImpl] (secstorage-1:ctx-fc57ef43) Scheduled HAWork[12-CheckStop-2-Starting-Scheduled] 2014-08-07 19:52:26,314 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-fc57ef43) Exception while trying to start secondary storage vm com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start s-2-VM ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1051) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) ---at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) ... ... ... Caused by: com.cloud.exception.OperationTimedoutException: Commands 51249206 to Host 1 timed out after 3600 ---at com.cloud.agent.manager.AgentAttache.send(AgentAttache.java:439) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:394) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:920) ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:989) ---... 24 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CLOUDSTACK-7291) LXC: Mgmt server/agent keeps killing systemvms
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajani Karuturi updated CLOUDSTACK-7291: Fix Version/s: (was: 4.3.1) 4.3.2 LXC: Mgmt server/agent keeps killing systemvms -- Key: CLOUDSTACK-7291 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7291 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Affects Versions: 4.3.0, 4.3.1 Reporter: Rohit Yadav Fix For: 4.3.2 Followed installation and setup docs of 4.3, was unable to get LXC to work on Ubuntu 14.04/trusty. The systemvms kept coming up and result from ssvm_check.sh was good and it was able to reach mgmt server /host, even then mgmt server complained that it was unable to contact agent on the systemvm (ping), while the agent would gracefully shutdown the systemvm (by killing them). Relevant log: 2014-08-07 19:52:26,294 INFO [c.c.u.e.CSExceptionErrorCode] (secstorage-1:ctx-fc57ef43) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,295 DEBUG [c.c.a.m.AgentAttache] (consoleproxy-1:ctx-e123fa9c) Seq 1-51249205: Cancelling. 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,303 DEBUG [c.c.h.Status] (AgentTaskPool-13:ctx-0b35e679) Transition:[Resource state = Enabled, Agent event = ShutdownRequested, Host id = 1, name = bluebox1.bhaisaab.org] 2014-08-07 19:52:26,311 DEBUG [c.c.h.HighAvailabilityManagerImpl] (secstorage-1:ctx-fc57ef43) Scheduled HAWork[12-CheckStop-2-Starting-Scheduled] 2014-08-07 19:52:26,314 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-fc57ef43) Exception while trying to start secondary storage vm com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start s-2-VM ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1051) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) ---at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) ... ... ... Caused by: com.cloud.exception.OperationTimedoutException: Commands 51249206 to Host 1 timed out after 3600 ---at com.cloud.agent.manager.AgentAttache.send(AgentAttache.java:439) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:394) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:920) ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:989) ---... 24 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CLOUDSTACK-7291) LXC: Mgmt server/agent keeps killing systemvms
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kishan Kavala updated CLOUDSTACK-7291: -- Affects Version/s: (was: 4.5.0) LXC: Mgmt server/agent keeps killing systemvms -- Key: CLOUDSTACK-7291 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7291 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Affects Versions: 4.3.0, 4.3.1 Reporter: Rohit Yadav Fix For: 4.3.1 Followed installation and setup docs of 4.3, was unable to get LXC to work on Ubuntu 14.04/trusty. The systemvms kept coming up and result from ssvm_check.sh was good and it was able to reach mgmt server /host, even then mgmt server complained that it was unable to contact agent on the systemvm (ping), while the agent would gracefully shutdown the systemvm (by killing them). Relevant log: 2014-08-07 19:52:26,294 INFO [c.c.u.e.CSExceptionErrorCode] (secstorage-1:ctx-fc57ef43) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,295 DEBUG [c.c.a.m.AgentAttache] (consoleproxy-1:ctx-e123fa9c) Seq 1-51249205: Cancelling. 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,303 DEBUG [c.c.h.Status] (AgentTaskPool-13:ctx-0b35e679) Transition:[Resource state = Enabled, Agent event = ShutdownRequested, Host id = 1, name = bluebox1.bhaisaab.org] 2014-08-07 19:52:26,311 DEBUG [c.c.h.HighAvailabilityManagerImpl] (secstorage-1:ctx-fc57ef43) Scheduled HAWork[12-CheckStop-2-Starting-Scheduled] 2014-08-07 19:52:26,314 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-fc57ef43) Exception while trying to start secondary storage vm com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start s-2-VM ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1051) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) ---at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) ... ... ... Caused by: com.cloud.exception.OperationTimedoutException: Commands 51249206 to Host 1 timed out after 3600 ---at com.cloud.agent.manager.AgentAttache.send(AgentAttache.java:439) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:394) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:920) ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:989) ---... 24 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CLOUDSTACK-7291) LXC: Mgmt server/agent keeps killing systemvms
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kishan Kavala updated CLOUDSTACK-7291: -- Assignee: (was: Kishan Kavala) LXC: Mgmt server/agent keeps killing systemvms -- Key: CLOUDSTACK-7291 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7291 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Affects Versions: 4.3.0, 4.5.0, 4.3.1 Reporter: Rohit Yadav Fix For: 4.3.1 Followed installation and setup docs of 4.3, was unable to get LXC to work on Ubuntu 14.04/trusty. The systemvms kept coming up and result from ssvm_check.sh was good and it was able to reach mgmt server /host, even then mgmt server complained that it was unable to contact agent on the systemvm (ping), while the agent would gracefully shutdown the systemvm (by killing them). Relevant log: 2014-08-07 19:52:26,294 INFO [c.c.u.e.CSExceptionErrorCode] (secstorage-1:ctx-fc57ef43) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,295 DEBUG [c.c.a.m.AgentAttache] (consoleproxy-1:ctx-e123fa9c) Seq 1-51249205: Cancelling. 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,303 DEBUG [c.c.h.Status] (AgentTaskPool-13:ctx-0b35e679) Transition:[Resource state = Enabled, Agent event = ShutdownRequested, Host id = 1, name = bluebox1.bhaisaab.org] 2014-08-07 19:52:26,311 DEBUG [c.c.h.HighAvailabilityManagerImpl] (secstorage-1:ctx-fc57ef43) Scheduled HAWork[12-CheckStop-2-Starting-Scheduled] 2014-08-07 19:52:26,314 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-fc57ef43) Exception while trying to start secondary storage vm com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start s-2-VM ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1051) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) ---at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) ... ... ... Caused by: com.cloud.exception.OperationTimedoutException: Commands 51249206 to Host 1 timed out after 3600 ---at com.cloud.agent.manager.AgentAttache.send(AgentAttache.java:439) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:394) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:920) ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:989) ---... 24 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CLOUDSTACK-7291) LXC: Mgmt server/agent keeps killing systemvms
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kishan Kavala updated CLOUDSTACK-7291: -- Fix Version/s: (was: 4.5.0) LXC: Mgmt server/agent keeps killing systemvms -- Key: CLOUDSTACK-7291 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7291 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Affects Versions: 4.3.0, 4.5.0, 4.3.1 Reporter: Rohit Yadav Fix For: 4.3.1 Followed installation and setup docs of 4.3, was unable to get LXC to work on Ubuntu 14.04/trusty. The systemvms kept coming up and result from ssvm_check.sh was good and it was able to reach mgmt server /host, even then mgmt server complained that it was unable to contact agent on the systemvm (ping), while the agent would gracefully shutdown the systemvm (by killing them). Relevant log: 2014-08-07 19:52:26,294 INFO [c.c.u.e.CSExceptionErrorCode] (secstorage-1:ctx-fc57ef43) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,295 DEBUG [c.c.a.m.AgentAttache] (consoleproxy-1:ctx-e123fa9c) Seq 1-51249205: Cancelling. 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,303 DEBUG [c.c.h.Status] (AgentTaskPool-13:ctx-0b35e679) Transition:[Resource state = Enabled, Agent event = ShutdownRequested, Host id = 1, name = bluebox1.bhaisaab.org] 2014-08-07 19:52:26,311 DEBUG [c.c.h.HighAvailabilityManagerImpl] (secstorage-1:ctx-fc57ef43) Scheduled HAWork[12-CheckStop-2-Starting-Scheduled] 2014-08-07 19:52:26,314 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-fc57ef43) Exception while trying to start secondary storage vm com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start s-2-VM ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1051) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) ---at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) ... ... ... Caused by: com.cloud.exception.OperationTimedoutException: Commands 51249206 to Host 1 timed out after 3600 ---at com.cloud.agent.manager.AgentAttache.send(AgentAttache.java:439) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:394) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:920) ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:989) ---... 24 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CLOUDSTACK-7291) LXC: Mgmt server/agent keeps killing systemvms
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhinandan Prateek updated CLOUDSTACK-7291: --- Assignee: Kishan Kavala LXC: Mgmt server/agent keeps killing systemvms -- Key: CLOUDSTACK-7291 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7291 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Affects Versions: 4.3.0, 4.5.0, 4.3.1 Reporter: Rohit Yadav Assignee: Kishan Kavala Priority: Blocker Fix For: 4.5.0, 4.3.1 Followed installation and setup docs of 4.3, was unable to get LXC to work on Ubuntu 14.04/trusty. The systemvms kept coming up and result from ssvm_check.sh was good and it was able to reach mgmt server /host, even then mgmt server complained that it was unable to contact agent on the systemvm (ping), while the agent would gracefully shutdown the systemvm (by killing them). Relevant log: 2014-08-07 19:52:26,294 INFO [c.c.u.e.CSExceptionErrorCode] (secstorage-1:ctx-fc57ef43) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,295 DEBUG [c.c.a.m.AgentAttache] (consoleproxy-1:ctx-e123fa9c) Seq 1-51249205: Cancelling. 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,303 DEBUG [c.c.h.Status] (AgentTaskPool-13:ctx-0b35e679) Transition:[Resource state = Enabled, Agent event = ShutdownRequested, Host id = 1, name = bluebox1.bhaisaab.org] 2014-08-07 19:52:26,311 DEBUG [c.c.h.HighAvailabilityManagerImpl] (secstorage-1:ctx-fc57ef43) Scheduled HAWork[12-CheckStop-2-Starting-Scheduled] 2014-08-07 19:52:26,314 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-fc57ef43) Exception while trying to start secondary storage vm com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start s-2-VM ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1051) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) ---at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) ... ... ... Caused by: com.cloud.exception.OperationTimedoutException: Commands 51249206 to Host 1 timed out after 3600 ---at com.cloud.agent.manager.AgentAttache.send(AgentAttache.java:439) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:394) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:920) ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:989) ---... 24 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CLOUDSTACK-7291) LXC: Mgmt server/agent keeps killing systemvms
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kishan Kavala updated CLOUDSTACK-7291: -- Priority: Major (was: Blocker) LXC: Mgmt server/agent keeps killing systemvms -- Key: CLOUDSTACK-7291 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7291 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Affects Versions: 4.3.0, 4.5.0, 4.3.1 Reporter: Rohit Yadav Assignee: Kishan Kavala Fix For: 4.5.0, 4.3.1 Followed installation and setup docs of 4.3, was unable to get LXC to work on Ubuntu 14.04/trusty. The systemvms kept coming up and result from ssvm_check.sh was good and it was able to reach mgmt server /host, even then mgmt server complained that it was unable to contact agent on the systemvm (ping), while the agent would gracefully shutdown the systemvm (by killing them). Relevant log: 2014-08-07 19:52:26,294 INFO [c.c.u.e.CSExceptionErrorCode] (secstorage-1:ctx-fc57ef43) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,295 DEBUG [c.c.a.m.AgentAttache] (consoleproxy-1:ctx-e123fa9c) Seq 1-51249205: Cancelling. 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,303 DEBUG [c.c.h.Status] (AgentTaskPool-13:ctx-0b35e679) Transition:[Resource state = Enabled, Agent event = ShutdownRequested, Host id = 1, name = bluebox1.bhaisaab.org] 2014-08-07 19:52:26,311 DEBUG [c.c.h.HighAvailabilityManagerImpl] (secstorage-1:ctx-fc57ef43) Scheduled HAWork[12-CheckStop-2-Starting-Scheduled] 2014-08-07 19:52:26,314 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-fc57ef43) Exception while trying to start secondary storage vm com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start s-2-VM ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1051) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) ---at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) ... ... ... Caused by: com.cloud.exception.OperationTimedoutException: Commands 51249206 to Host 1 timed out after 3600 ---at com.cloud.agent.manager.AgentAttache.send(AgentAttache.java:439) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:394) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:920) ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:989) ---... 24 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CLOUDSTACK-7291) LXC: Mgmt server/agent keeps killing systemvms
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudha Ponnaganti updated CLOUDSTACK-7291: - Affects Version/s: 4.5.0 LXC: Mgmt server/agent keeps killing systemvms -- Key: CLOUDSTACK-7291 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7291 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Affects Versions: 4.3.0, 4.5.0, 4.3.1 Reporter: Rohit Yadav Priority: Blocker Fix For: 4.5.0, 4.3.1 Followed installation and setup docs of 4.3, was unable to get LXC to work on Ubuntu 14.04/trusty. The systemvms kept coming up and result from ssvm_check.sh was good and it was able to reach mgmt server /host, even then mgmt server complained that it was unable to contact agent on the systemvm (ping), while the agent would gracefully shutdown the systemvm (by killing them). Relevant log: 2014-08-07 19:52:26,294 INFO [c.c.u.e.CSExceptionErrorCode] (secstorage-1:ctx-fc57ef43) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,295 DEBUG [c.c.a.m.AgentAttache] (consoleproxy-1:ctx-e123fa9c) Seq 1-51249205: Cancelling. 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,303 DEBUG [c.c.h.Status] (AgentTaskPool-13:ctx-0b35e679) Transition:[Resource state = Enabled, Agent event = ShutdownRequested, Host id = 1, name = bluebox1.bhaisaab.org] 2014-08-07 19:52:26,311 DEBUG [c.c.h.HighAvailabilityManagerImpl] (secstorage-1:ctx-fc57ef43) Scheduled HAWork[12-CheckStop-2-Starting-Scheduled] 2014-08-07 19:52:26,314 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-fc57ef43) Exception while trying to start secondary storage vm com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start s-2-VM ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1051) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) ---at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) ... ... ... Caused by: com.cloud.exception.OperationTimedoutException: Commands 51249206 to Host 1 timed out after 3600 ---at com.cloud.agent.manager.AgentAttache.send(AgentAttache.java:439) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:394) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:920) ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:989) ---... 24 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CLOUDSTACK-7291) LXC: Mgmt server/agent keeps killing systemvms
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudha Ponnaganti updated CLOUDSTACK-7291: - Fix Version/s: 4.5.0 LXC: Mgmt server/agent keeps killing systemvms -- Key: CLOUDSTACK-7291 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7291 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Affects Versions: 4.3.0, 4.5.0, 4.3.1 Reporter: Rohit Yadav Priority: Blocker Fix For: 4.5.0, 4.3.1 Followed installation and setup docs of 4.3, was unable to get LXC to work on Ubuntu 14.04/trusty. The systemvms kept coming up and result from ssvm_check.sh was good and it was able to reach mgmt server /host, even then mgmt server complained that it was unable to contact agent on the systemvm (ping), while the agent would gracefully shutdown the systemvm (by killing them). Relevant log: 2014-08-07 19:52:26,294 INFO [c.c.u.e.CSExceptionErrorCode] (secstorage-1:ctx-fc57ef43) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,295 DEBUG [c.c.a.m.AgentAttache] (consoleproxy-1:ctx-e123fa9c) Seq 1-51249205: Cancelling. 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,303 DEBUG [c.c.h.Status] (AgentTaskPool-13:ctx-0b35e679) Transition:[Resource state = Enabled, Agent event = ShutdownRequested, Host id = 1, name = bluebox1.bhaisaab.org] 2014-08-07 19:52:26,311 DEBUG [c.c.h.HighAvailabilityManagerImpl] (secstorage-1:ctx-fc57ef43) Scheduled HAWork[12-CheckStop-2-Starting-Scheduled] 2014-08-07 19:52:26,314 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-fc57ef43) Exception while trying to start secondary storage vm com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start s-2-VM ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1051) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) ---at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) ... ... ... Caused by: com.cloud.exception.OperationTimedoutException: Commands 51249206 to Host 1 timed out after 3600 ---at com.cloud.agent.manager.AgentAttache.send(AgentAttache.java:439) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:394) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:920) ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:989) ---... 24 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CLOUDSTACK-7291) LXC: Mgmt server/agent keeps killing systemvms
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Brett updated CLOUDSTACK-7291: --- Priority: Blocker (was: Major) Upping this to blocker as I'm also seeing it and it is preventing me starting VMs on LXC LXC: Mgmt server/agent keeps killing systemvms -- Key: CLOUDSTACK-7291 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7291 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Affects Versions: 4.3.0, 4.3.1 Reporter: Rohit Yadav Assignee: Kishan Kavala Priority: Blocker Fix For: Future, 4.5.0 Followed installation and setup docs of 4.3, was unable to get LXC to work on Ubuntu 14.04/trusty. The systemvms kept coming up and result from ssvm_check.sh was good and it was able to reach mgmt server /host, even then mgmt server complained that it was unable to contact agent on the systemvm (ping), while the agent would gracefully shutdown the systemvm (by killing them). Relevant log: 2014-08-07 19:52:26,294 INFO [c.c.u.e.CSExceptionErrorCode] (secstorage-1:ctx-fc57ef43) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,295 DEBUG [c.c.a.m.AgentAttache] (consoleproxy-1:ctx-e123fa9c) Seq 1-51249205: Cancelling. 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,303 DEBUG [c.c.h.Status] (AgentTaskPool-13:ctx-0b35e679) Transition:[Resource state = Enabled, Agent event = ShutdownRequested, Host id = 1, name = bluebox1.bhaisaab.org] 2014-08-07 19:52:26,311 DEBUG [c.c.h.HighAvailabilityManagerImpl] (secstorage-1:ctx-fc57ef43) Scheduled HAWork[12-CheckStop-2-Starting-Scheduled] 2014-08-07 19:52:26,314 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-fc57ef43) Exception while trying to start secondary storage vm com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start s-2-VM ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1051) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) ---at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) ... ... ... Caused by: com.cloud.exception.OperationTimedoutException: Commands 51249206 to Host 1 timed out after 3600 ---at com.cloud.agent.manager.AgentAttache.send(AgentAttache.java:439) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:394) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:920) ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:989) ---... 24 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CLOUDSTACK-7291) LXC: Mgmt server/agent keeps killing systemvms
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kishan Kavala updated CLOUDSTACK-7291: -- Assignee: (was: Kishan Kavala) LXC: Mgmt server/agent keeps killing systemvms -- Key: CLOUDSTACK-7291 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7291 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Affects Versions: 4.3.0, 4.3.1 Reporter: Rohit Yadav Priority: Blocker Fix For: 4.3.1 Followed installation and setup docs of 4.3, was unable to get LXC to work on Ubuntu 14.04/trusty. The systemvms kept coming up and result from ssvm_check.sh was good and it was able to reach mgmt server /host, even then mgmt server complained that it was unable to contact agent on the systemvm (ping), while the agent would gracefully shutdown the systemvm (by killing them). Relevant log: 2014-08-07 19:52:26,294 INFO [c.c.u.e.CSExceptionErrorCode] (secstorage-1:ctx-fc57ef43) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,295 DEBUG [c.c.a.m.AgentAttache] (consoleproxy-1:ctx-e123fa9c) Seq 1-51249205: Cancelling. 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,303 DEBUG [c.c.h.Status] (AgentTaskPool-13:ctx-0b35e679) Transition:[Resource state = Enabled, Agent event = ShutdownRequested, Host id = 1, name = bluebox1.bhaisaab.org] 2014-08-07 19:52:26,311 DEBUG [c.c.h.HighAvailabilityManagerImpl] (secstorage-1:ctx-fc57ef43) Scheduled HAWork[12-CheckStop-2-Starting-Scheduled] 2014-08-07 19:52:26,314 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-fc57ef43) Exception while trying to start secondary storage vm com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start s-2-VM ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1051) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) ---at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) ... ... ... Caused by: com.cloud.exception.OperationTimedoutException: Commands 51249206 to Host 1 timed out after 3600 ---at com.cloud.agent.manager.AgentAttache.send(AgentAttache.java:439) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:394) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:920) ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:989) ---... 24 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CLOUDSTACK-7291) LXC: Mgmt server/agent keeps killing systemvms
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kishan Kavala updated CLOUDSTACK-7291: -- Fix Version/s: (was: 4.5.0) (was: Future) 4.3.1 LXC: Mgmt server/agent keeps killing systemvms -- Key: CLOUDSTACK-7291 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7291 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Affects Versions: 4.3.0, 4.3.1 Reporter: Rohit Yadav Assignee: Kishan Kavala Priority: Blocker Fix For: 4.3.1 Followed installation and setup docs of 4.3, was unable to get LXC to work on Ubuntu 14.04/trusty. The systemvms kept coming up and result from ssvm_check.sh was good and it was able to reach mgmt server /host, even then mgmt server complained that it was unable to contact agent on the systemvm (ping), while the agent would gracefully shutdown the systemvm (by killing them). Relevant log: 2014-08-07 19:52:26,294 INFO [c.c.u.e.CSExceptionErrorCode] (secstorage-1:ctx-fc57ef43) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,295 DEBUG [c.c.a.m.AgentAttache] (consoleproxy-1:ctx-e123fa9c) Seq 1-51249205: Cancelling. 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,303 DEBUG [c.c.h.Status] (AgentTaskPool-13:ctx-0b35e679) Transition:[Resource state = Enabled, Agent event = ShutdownRequested, Host id = 1, name = bluebox1.bhaisaab.org] 2014-08-07 19:52:26,311 DEBUG [c.c.h.HighAvailabilityManagerImpl] (secstorage-1:ctx-fc57ef43) Scheduled HAWork[12-CheckStop-2-Starting-Scheduled] 2014-08-07 19:52:26,314 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-fc57ef43) Exception while trying to start secondary storage vm com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start s-2-VM ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1051) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) ---at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) ... ... ... Caused by: com.cloud.exception.OperationTimedoutException: Commands 51249206 to Host 1 timed out after 3600 ---at com.cloud.agent.manager.AgentAttache.send(AgentAttache.java:439) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:394) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:920) ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:989) ---... 24 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CLOUDSTACK-7291) LXC: Mgmt server/agent keeps killing systemvms
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Yadav updated CLOUDSTACK-7291: Fix Version/s: (was: 4.3.1) 4.5.0 Future LXC: Mgmt server/agent keeps killing systemvms -- Key: CLOUDSTACK-7291 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7291 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Affects Versions: 4.3.0, 4.3.1 Reporter: Rohit Yadav Assignee: Kishan Kavala Fix For: Future, 4.5.0 Followed installation and setup docs of 4.3, was unable to get LXC to work on Ubuntu 14.04/trusty. The systemvms kept coming up and result from ssvm_check.sh was good and it was able to reach mgmt server /host, even then mgmt server complained that it was unable to contact agent on the systemvm (ping), while the agent would gracefully shutdown the systemvm (by killing them). Relevant log: 2014-08-07 19:52:26,294 INFO [c.c.u.e.CSExceptionErrorCode] (secstorage-1:ctx-fc57ef43) Could not find exception: com.cloud.exception.OperationTimedoutException in error code list for exceptions 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,295 DEBUG [c.c.a.m.AgentAttache] (consoleproxy-1:ctx-e123fa9c) Seq 1-51249205: Cancelling. 2014-08-07 19:52:26,295 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-e123fa9c) Unable to send the start command to host Host[-1-Routing] 2014-08-07 19:52:26,303 DEBUG [c.c.h.Status] (AgentTaskPool-13:ctx-0b35e679) Transition:[Resource state = Enabled, Agent event = ShutdownRequested, Host id = 1, name = bluebox1.bhaisaab.org] 2014-08-07 19:52:26,311 DEBUG [c.c.h.HighAvailabilityManagerImpl] (secstorage-1:ctx-fc57ef43) Scheduled HAWork[12-CheckStop-2-Starting-Scheduled] 2014-08-07 19:52:26,314 WARN [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-fc57ef43) Exception while trying to start secondary storage vm com.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start s-2-VM ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1051) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761) ---at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:745) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:261) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:694) ---at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1278) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:123) ---at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) ---at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) ... ... ... Caused by: com.cloud.exception.OperationTimedoutException: Commands 51249206 to Host 1 timed out after 3600 ---at com.cloud.agent.manager.AgentAttache.send(AgentAttache.java:439) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:394) ---at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:920) ---at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:989) ---... 24 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)
