master branch: VR not starting
Hi, I'm setting up a test env with the master branch and XenServer 6.5.0 VR are not starting I have the CPVM and SSVM running but VR failed to start for guest network and VPC. the VR instance start and got shutdown right after debian is booted. I've used templates from j.bac.o. Does anyone is aware of changes going on on master branch or experiencing the same? Thanks :-)
Re: master branch: VR not starting
Can you please check the MS logs for the VR start. You might be getting exception for VR start due which the MS is stopping the router. Can you please send the management server logs. Thanks, Jayapal On 02-Apr-2015, at 12:44 AM, Pierre-Luc Dion wrote: > Hi, > > I'm setting up a test env with the master branch and XenServer 6.5.0 > > VR are not starting I have the CPVM and SSVM running but VR failed to start > for guest network and VPC. the VR instance start and got shutdown right > after debian is booted. I've used templates from j.bac.o. > > Does anyone is aware of changes going on on master branch or experiencing > the same? > > Thanks :-)
Re: master branch: VR not starting
Hi Jayapal, Here is the management server log when I create a new VPC. I have the complete log file if you want. Thanks, 2015-04-02 09:24:33,464 DEBUG [c.c.a.ApiServlet] (catalina-exec-13:ctx-d346aa74 ctx-cb3cf0b3) ===END=== 172.16.11.102 -- GET command=createNetwork&response=json&sessionkey=QVBoxMj48NpXdjom%2FGHN7OzZBWI%3D&zoneId=6c2c1eb0-4466-4914-9c1c-ff73d716ed9a&name=asd&displayText=asd&networkOfferingId=8139494f-2036-4b06-87ea-2b635603196f&_=1427981074407 2015-04-02 09:26:33,842 ERROR [c.c.u.s.SshHelper] (DirectAgent-142:ctx-bc757c1a) SSH execution of command /opt/cloud/bin/router_proxy.sh update_config.py 169.254.3.118 ip_associations.json has an error status code in return. result output: Traceback (most recent call last): File "/opt/cloud/bin/update_config.py", line 20, in from merge import QueueFile File "/opt/cloud/bin/merge.py", line 23, in import cs_ip File "/opt/cloud/bin/cs_ip.py", line 19, in from netaddr import * ImportError: No module named netaddr 2015-04-02 09:26:33,862 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) null 2015-04-02 09:26:39,999 ERROR [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) Failed to start instance VM[DomainRouter|r-10-VM] com.cloud.utils.exception.ExecutionException: Unable to start VM[DomainRouter|r-10-VM] due to error in finalizeStart, not retrying at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1076) at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4503) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107) at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4659) at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2015-04-02 09:26:40,179 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44) Unable to complete AsyncJobVO {id:44, userId: 2, accountId: 2, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAACAAIACnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAADHcIEAF0AA5SZXN0YXJ0TmV0d29ya3QAP3JPMEFCWE55QUJGcVlYWmhMbXhoYm1jdVFtOXZiR1ZoYnMwZ2NvRFZuUHJ1QWdBQldnQUZkbUZzZFdWNGNBRXhw, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 7684065591473, completeMsid: null, lastUpdated: null, lastPolled: null, created: Thu Apr 02 09:25:24 EDT 2015}, job origin:43 On Thu, Apr 2, 2015 at 12:31 AM, Jayapal Reddy Uradi < jayapalreddy.ur...@citrix.com> wrote: > > Can you please check the MS logs for the VR start. > You might be getting exception for VR start due which the MS is stopping > the router. > > Can you please send the management server logs. > > Thanks, > Jayapal > On 02-Apr-2015, at 12:44 AM, Pierre-Luc Dion wrote: >
Re: master branch: VR not starting
Looks like the system vm template that you are using are not good. Try the templates from http://packages.shapeblue.com/systemvmtemplate/4.5/ > On 02-Apr-2015, at 7:00 pm, Pierre-Luc Dion wrote: > > Hi Jayapal, > > Here is the management server log when I create a new VPC. I have the > complete log file if you want. > > Thanks, > > 2015-04-02 09:24:33,464 DEBUG [c.c.a.ApiServlet] > (catalina-exec-13:ctx-d346aa74 ctx-cb3cf0b3) ===END=== 172.16.11.102 -- > GET > command=createNetwork&response=json&sessionkey=QVBoxMj48NpXdjom%2FGHN7OzZBWI%3D&zoneId=6c2c1eb0-4466-4914-9c1c-ff73d716ed9a&name=asd&displayText=asd&networkOfferingId=8139494f-2036-4b06-87ea-2b635603196f&_=1427981074407 > > > 2015-04-02 09:26:33,842 ERROR [c.c.u.s.SshHelper] > (DirectAgent-142:ctx-bc757c1a) SSH execution of command > /opt/cloud/bin/router_proxy.sh update_config.py 169.254.3.118 > ip_associations.json has an error status code in return. result output: > Traceback (most recent call last): > File "/opt/cloud/bin/update_config.py", line 20, in >from merge import QueueFile > File "/opt/cloud/bin/merge.py", line 23, in >import cs_ip > File "/opt/cloud/bin/cs_ip.py", line 19, in >from netaddr import * > ImportError: No module named netaddr > > 2015-04-02 09:26:33,862 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) null > > 2015-04-02 09:26:39,999 ERROR [c.c.v.VirtualMachineManagerImpl] > (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) Failed to > start instance VM[DomainRouter|r-10-VM] > com.cloud.utils.exception.ExecutionException: Unable to start > VM[DomainRouter|r-10-VM] due to error in finalizeStart, not retrying > at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1076) > at > com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4503) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107) > at > com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4659) > at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > > 2015-04-02 09:26:40,179 ERROR [c.c.v.VmWorkJobDispatcher] > (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44) Unable to complete > AsyncJobVO {id:44, userId: 2, accountId: 2, instanceType: null, instanceId: > null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: > rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAACAAIACnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAADHcIEAF0AA5SZXN0YXJ0TmV0d29ya3QAP3JPMEFCWE55QUJGcVlYWmhMbXhoYm1jdVFtOXZiR1ZoYnMwZ2NvRFZuUHJ1QWdBQldnQUZkbUZzZFdWNGNBRXhw, > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, > result: null, initMsid: 7684065591473, completeMsid: null, lastUpdated: > null, lastPolled: null, created: Thu Apr 02 09:25:24 EDT 2015}, job > origin:43 > > > > > > On Thu, Apr 2, 2015 at 12:31 AM, Jayapa
Re: master branch: VR not starting
The router start is failing because of the error (import error) in executing update_config.py. Template that you are using seems older version of cloudstack. As Abhi mentioned, Use the template which has the supported packages installed. * (DirectAgent-142:ctx-bc757c1a) SSH execution of command /opt/cloud/bin/router_proxy.sh update_config.py 169.254.3.118 ip_associations.json has an error status code in return. result output: Traceback (most recent call last): Thanks, Jayapal On 03-Apr-2015, at 9:19 AM, Abhinandan Prateek wrote: > Looks like the system vm template that you are using are not good. > Try the templates from http://packages.shapeblue.com/systemvmtemplate/4.5/ > >> On 02-Apr-2015, at 7:00 pm, Pierre-Luc Dion wrote: >> >> Hi Jayapal, >> >> Here is the management server log when I create a new VPC. I have the >> complete log file if you want. >> >> Thanks, >> >> 2015-04-02 09:24:33,464 DEBUG [c.c.a.ApiServlet] >> (catalina-exec-13:ctx-d346aa74 ctx-cb3cf0b3) ===END=== 172.16.11.102 -- >> GET >> command=createNetwork&response=json&sessionkey=QVBoxMj48NpXdjom%2FGHN7OzZBWI%3D&zoneId=6c2c1eb0-4466-4914-9c1c-ff73d716ed9a&name=asd&displayText=asd&networkOfferingId=8139494f-2036-4b06-87ea-2b635603196f&_=1427981074407 >> >> >> 2015-04-02 09:26:33,842 ERROR [c.c.u.s.SshHelper] >> (DirectAgent-142:ctx-bc757c1a) SSH execution of command >> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.3.118 >> ip_associations.json has an error status code in return. result output: >> Traceback (most recent call last): >> File "/opt/cloud/bin/update_config.py", line 20, in >> from merge import QueueFile >> File "/opt/cloud/bin/merge.py", line 23, in >> import cs_ip >> File "/opt/cloud/bin/cs_ip.py", line 19, in >> from netaddr import * >> ImportError: No module named netaddr >> >> 2015-04-02 09:26:33,862 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl] >> (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) null >> >> 2015-04-02 09:26:39,999 ERROR [c.c.v.VirtualMachineManagerImpl] >> (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) Failed to >> start instance VM[DomainRouter|r-10-VM] >> com.cloud.utils.exception.ExecutionException: Unable to start >> VM[DomainRouter|r-10-VM] due to error in finalizeStart, not retrying >> at >> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1076) >> at >> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4503) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at >> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107) >> at >> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4659) >> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103) >> at >> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537) >> at >> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) >> at >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) >> at >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) >> at >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) >> at >> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) >> at >> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494) >> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >> at java.util.concurrent.FutureTask.run(FutureTask.java:262) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >> at java.lang.Thread.run(Thread.java:745) >> >> 2015-04-02 09:26:40,179 ERROR [c.c.v.VmWorkJobDispatcher] >> (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44) Unable to complete >> AsyncJobVO {id:44, userId: 2, accountId: 2, instanceType: null, instanceId: >> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: >> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2h
Re: master branch: VR not starting
Hi, Looks like Python netaddr package is missing, can anyone check if this gets installed when systemvms are baked? I’ll try to test master and fix it next week. > On 03-Apr-2015, at 9:34 am, Jayapal Reddy Uradi > wrote: > > The router start is failing because of the error (import error) in executing > update_config.py. > > Template that you are using seems older version of cloudstack. > As Abhi mentioned, Use the template which has the supported packages > installed. > > * > (DirectAgent-142:ctx-bc757c1a) SSH execution of command > /opt/cloud/bin/router_proxy.sh update_config.py 169.254.3.118 > ip_associations.json has an error status code in return. result output: > Traceback (most recent call last): > > Thanks, > Jayapal > > On 03-Apr-2015, at 9:19 AM, Abhinandan Prateek > wrote: > >> Looks like the system vm template that you are using are not good. >> Try the templates from http://packages.shapeblue.com/systemvmtemplate/4.5/ >> >>> On 02-Apr-2015, at 7:00 pm, Pierre-Luc Dion wrote: >>> >>> Hi Jayapal, >>> >>> Here is the management server log when I create a new VPC. I have the >>> complete log file if you want. >>> >>> Thanks, >>> >>> 2015-04-02 09:24:33,464 DEBUG [c.c.a.ApiServlet] >>> (catalina-exec-13:ctx-d346aa74 ctx-cb3cf0b3) ===END=== 172.16.11.102 -- >>> GET >>> command=createNetwork&response=json&sessionkey=QVBoxMj48NpXdjom%2FGHN7OzZBWI%3D&zoneId=6c2c1eb0-4466-4914-9c1c-ff73d716ed9a&name=asd&displayText=asd&networkOfferingId=8139494f-2036-4b06-87ea-2b635603196f&_=1427981074407 >>> >>> >>> 2015-04-02 09:26:33,842 ERROR [c.c.u.s.SshHelper] >>> (DirectAgent-142:ctx-bc757c1a) SSH execution of command >>> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.3.118 >>> ip_associations.json has an error status code in return. result output: >>> Traceback (most recent call last): >>> File "/opt/cloud/bin/update_config.py", line 20, in >>> from merge import QueueFile >>> File "/opt/cloud/bin/merge.py", line 23, in >>> import cs_ip >>> File "/opt/cloud/bin/cs_ip.py", line 19, in >>> from netaddr import * >>> ImportError: No module named netaddr >>> >>> 2015-04-02 09:26:33,862 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl] >>> (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) null >>> >>> 2015-04-02 09:26:39,999 ERROR [c.c.v.VirtualMachineManagerImpl] >>> (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) Failed to >>> start instance VM[DomainRouter|r-10-VM] >>> com.cloud.utils.exception.ExecutionException: Unable to start >>> VM[DomainRouter|r-10-VM] due to error in finalizeStart, not retrying >>> at >>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1076) >>> at >>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4503) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>> at java.lang.reflect.Method.invoke(Method.java:606) >>> at >>> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107) >>> at >>> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4659) >>> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103) >>> at >>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537) >>> at >>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) >>> at >>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) >>> at >>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) >>> at >>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) >>> at >>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) >>> at >>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494) >>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) >>> at >>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >>> at >>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >>> at java.lang.Thread.run(Thread.java:745) >>> >>> 2015-04-02 09:26:40,179 ERROR [c.c.v.VmWorkJobDispatcher] >>> (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44) Unable to complete >>> AsyncJobVO {id:44, userId: 2, accountId: 2, instanceType: null, instanceId: >>> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: >>> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMa