master branch: VR not starting

2015-04-01 Thread Pierre-Luc Dion
Hi,

I'm setting up a test env with the master branch and XenServer 6.5.0

VR are not starting I have the CPVM and SSVM running but VR failed to start
for guest network and VPC. the VR instance start and got shutdown right
after debian is booted. I've used templates from j.bac.o.

Does anyone is aware of changes going on on master branch or experiencing
the same?

Thanks :-)


Re: master branch: VR not starting

2015-04-01 Thread Jayapal Reddy Uradi

Can you please check the MS logs for the VR start.
You might be getting exception for VR start due which the MS is stopping the 
router.

Can you please send the management server logs.

Thanks,
Jayapal
On 02-Apr-2015, at 12:44 AM, Pierre-Luc Dion  wrote:

> Hi,
> 
> I'm setting up a test env with the master branch and XenServer 6.5.0
> 
> VR are not starting I have the CPVM and SSVM running but VR failed to start
> for guest network and VPC. the VR instance start and got shutdown right
> after debian is booted. I've used templates from j.bac.o.
> 
> Does anyone is aware of changes going on on master branch or experiencing
> the same?
> 
> Thanks :-)



Re: master branch: VR not starting

2015-04-02 Thread Pierre-Luc Dion
Hi Jayapal,

Here is the management server log when I create a new VPC. I have the
complete log file if you want.

Thanks,

2015-04-02 09:24:33,464 DEBUG [c.c.a.ApiServlet]
(catalina-exec-13:ctx-d346aa74 ctx-cb3cf0b3) ===END===  172.16.11.102 --
GET
 
command=createNetwork&response=json&sessionkey=QVBoxMj48NpXdjom%2FGHN7OzZBWI%3D&zoneId=6c2c1eb0-4466-4914-9c1c-ff73d716ed9a&name=asd&displayText=asd&networkOfferingId=8139494f-2036-4b06-87ea-2b635603196f&_=1427981074407


2015-04-02 09:26:33,842 ERROR [c.c.u.s.SshHelper]
(DirectAgent-142:ctx-bc757c1a) SSH execution of command
/opt/cloud/bin/router_proxy.sh update_config.py 169.254.3.118
ip_associations.json has an error status code in return. result output:
Traceback (most recent call last):
  File "/opt/cloud/bin/update_config.py", line 20, in 
from merge import QueueFile
  File "/opt/cloud/bin/merge.py", line 23, in 
import cs_ip
  File "/opt/cloud/bin/cs_ip.py", line 19, in 
from netaddr import *
ImportError: No module named netaddr

2015-04-02 09:26:33,862 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) null

2015-04-02 09:26:39,999 ERROR [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) Failed to
start instance VM[DomainRouter|r-10-VM]
com.cloud.utils.exception.ExecutionException: Unable to start
VM[DomainRouter|r-10-VM] due to error in finalizeStart, not retrying
  at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1076)
  at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4503)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:606)
  at
com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
  at
com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4659)
  at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
  at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
  at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
  at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
  at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
  at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
  at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
  at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
  at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:745)

2015-04-02 09:26:40,179 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-10:ctx-15cd8652 job-43/job-44) Unable to complete
AsyncJobVO {id:44, userId: 2, accountId: 2, instanceType: null, instanceId:
null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAACAAIACnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAADHcIEAF0AA5SZXN0YXJ0TmV0d29ya3QAP3JPMEFCWE55QUJGcVlYWmhMbXhoYm1jdVFtOXZiR1ZoYnMwZ2NvRFZuUHJ1QWdBQldnQUZkbUZzZFdWNGNBRXhw,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
result: null, initMsid: 7684065591473, completeMsid: null, lastUpdated:
null, lastPolled: null, created: Thu Apr 02 09:25:24 EDT 2015}, job
origin:43





On Thu, Apr 2, 2015 at 12:31 AM, Jayapal Reddy Uradi <
jayapalreddy.ur...@citrix.com> wrote:

>
> Can you please check the MS logs for the VR start.
> You might be getting exception for VR start due which the MS is stopping
> the router.
>
> Can you please send the management server logs.
>
> Thanks,
> Jayapal
> On 02-Apr-2015, at 12:44 AM, Pierre-Luc Dion  wrote:
>

Re: master branch: VR not starting

2015-04-02 Thread Abhinandan Prateek
Looks like the system vm template that you are using are not good.
Try the templates from http://packages.shapeblue.com/systemvmtemplate/4.5/

> On 02-Apr-2015, at 7:00 pm, Pierre-Luc Dion  wrote:
>
> Hi Jayapal,
>
> Here is the management server log when I create a new VPC. I have the
> complete log file if you want.
>
> Thanks,
>
> 2015-04-02 09:24:33,464 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-13:ctx-d346aa74 ctx-cb3cf0b3) ===END===  172.16.11.102 --
> GET
> command=createNetwork&response=json&sessionkey=QVBoxMj48NpXdjom%2FGHN7OzZBWI%3D&zoneId=6c2c1eb0-4466-4914-9c1c-ff73d716ed9a&name=asd&displayText=asd&networkOfferingId=8139494f-2036-4b06-87ea-2b635603196f&_=1427981074407
>
>
> 2015-04-02 09:26:33,842 ERROR [c.c.u.s.SshHelper]
> (DirectAgent-142:ctx-bc757c1a) SSH execution of command
> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.3.118
> ip_associations.json has an error status code in return. result output:
> Traceback (most recent call last):
>  File "/opt/cloud/bin/update_config.py", line 20, in 
>from merge import QueueFile
>  File "/opt/cloud/bin/merge.py", line 23, in 
>import cs_ip
>  File "/opt/cloud/bin/cs_ip.py", line 19, in 
>from netaddr import *
> ImportError: No module named netaddr
>
> 2015-04-02 09:26:33,862 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) null
>
> 2015-04-02 09:26:39,999 ERROR [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) Failed to
> start instance VM[DomainRouter|r-10-VM]
> com.cloud.utils.exception.ExecutionException: Unable to start
> VM[DomainRouter|r-10-VM] due to error in finalizeStart, not retrying
>  at
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1076)
>  at
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4503)
>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>  at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>  at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:606)
>  at
> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>  at
> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4659)
>  at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
>  at
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>  at
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>  at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>  at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>  at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>  at
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>  at
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>  at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>  at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>  at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>  at java.lang.Thread.run(Thread.java:745)
>
> 2015-04-02 09:26:40,179 ERROR [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44) Unable to complete
> AsyncJobVO {id:44, userId: 2, accountId: 2, instanceType: null, instanceId:
> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAACAAIACnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAADHcIEAF0AA5SZXN0YXJ0TmV0d29ya3QAP3JPMEFCWE55QUJGcVlYWmhMbXhoYm1jdVFtOXZiR1ZoYnMwZ2NvRFZuUHJ1QWdBQldnQUZkbUZzZFdWNGNBRXhw,
> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> result: null, initMsid: 7684065591473, completeMsid: null, lastUpdated:
> null, lastPolled: null, created: Thu Apr 02 09:25:24 EDT 2015}, job
> origin:43
>
>
>
>
>
> On Thu, Apr 2, 2015 at 12:31 AM, Jayapa

Re: master branch: VR not starting

2015-04-02 Thread Jayapal Reddy Uradi
The router start is failing because of the error (import error) in executing 
update_config.py.

Template that you are using seems older version of cloudstack.
As Abhi mentioned, Use the template which has the supported packages installed.

*
(DirectAgent-142:ctx-bc757c1a) SSH execution of command
/opt/cloud/bin/router_proxy.sh update_config.py 169.254.3.118
ip_associations.json has an error status code in return. result output:
Traceback (most recent call last):

Thanks,
Jayapal

On 03-Apr-2015, at 9:19 AM, Abhinandan Prateek 
 wrote:

> Looks like the system vm template that you are using are not good.
> Try the templates from http://packages.shapeblue.com/systemvmtemplate/4.5/
> 
>> On 02-Apr-2015, at 7:00 pm, Pierre-Luc Dion  wrote:
>> 
>> Hi Jayapal,
>> 
>> Here is the management server log when I create a new VPC. I have the
>> complete log file if you want.
>> 
>> Thanks,
>> 
>> 2015-04-02 09:24:33,464 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-13:ctx-d346aa74 ctx-cb3cf0b3) ===END===  172.16.11.102 --
>> GET
>> command=createNetwork&response=json&sessionkey=QVBoxMj48NpXdjom%2FGHN7OzZBWI%3D&zoneId=6c2c1eb0-4466-4914-9c1c-ff73d716ed9a&name=asd&displayText=asd&networkOfferingId=8139494f-2036-4b06-87ea-2b635603196f&_=1427981074407
>> 
>> 
>> 2015-04-02 09:26:33,842 ERROR [c.c.u.s.SshHelper]
>> (DirectAgent-142:ctx-bc757c1a) SSH execution of command
>> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.3.118
>> ip_associations.json has an error status code in return. result output:
>> Traceback (most recent call last):
>> File "/opt/cloud/bin/update_config.py", line 20, in 
>>   from merge import QueueFile
>> File "/opt/cloud/bin/merge.py", line 23, in 
>>   import cs_ip
>> File "/opt/cloud/bin/cs_ip.py", line 19, in 
>>   from netaddr import *
>> ImportError: No module named netaddr
>> 
>> 2015-04-02 09:26:33,862 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) null
>> 
>> 2015-04-02 09:26:39,999 ERROR [c.c.v.VirtualMachineManagerImpl]
>> (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) Failed to
>> start instance VM[DomainRouter|r-10-VM]
>> com.cloud.utils.exception.ExecutionException: Unable to start
>> VM[DomainRouter|r-10-VM] due to error in finalizeStart, not retrying
>> at
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1076)
>> at
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4503)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:606)
>> at
>> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>> at
>> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4659)
>> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
>> at
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>> at
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>> at
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>> at
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>> at
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>> at
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>> at
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:745)
>> 
>> 2015-04-02 09:26:40,179 ERROR [c.c.v.VmWorkJobDispatcher]
>> (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44) Unable to complete
>> AsyncJobVO {id:44, userId: 2, accountId: 2, instanceType: null, instanceId:
>> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
>> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2h

Re: master branch: VR not starting

2015-04-02 Thread Rohit Yadav
Hi,

Looks like Python netaddr package is missing, can anyone check if this gets 
installed when systemvms are baked?
I’ll try to test master and fix it next week.

> On 03-Apr-2015, at 9:34 am, Jayapal Reddy Uradi 
>  wrote:
>
> The router start is failing because of the error (import error) in executing 
> update_config.py.
>
> Template that you are using seems older version of cloudstack.
> As Abhi mentioned, Use the template which has the supported packages 
> installed.
>
> *
> (DirectAgent-142:ctx-bc757c1a) SSH execution of command
> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.3.118
> ip_associations.json has an error status code in return. result output:
> Traceback (most recent call last):
>
> Thanks,
> Jayapal
>
> On 03-Apr-2015, at 9:19 AM, Abhinandan Prateek 
>  wrote:
>
>> Looks like the system vm template that you are using are not good.
>> Try the templates from http://packages.shapeblue.com/systemvmtemplate/4.5/
>>
>>> On 02-Apr-2015, at 7:00 pm, Pierre-Luc Dion  wrote:
>>>
>>> Hi Jayapal,
>>>
>>> Here is the management server log when I create a new VPC. I have the
>>> complete log file if you want.
>>>
>>> Thanks,
>>>
>>> 2015-04-02 09:24:33,464 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-13:ctx-d346aa74 ctx-cb3cf0b3) ===END===  172.16.11.102 --
>>> GET
>>> command=createNetwork&response=json&sessionkey=QVBoxMj48NpXdjom%2FGHN7OzZBWI%3D&zoneId=6c2c1eb0-4466-4914-9c1c-ff73d716ed9a&name=asd&displayText=asd&networkOfferingId=8139494f-2036-4b06-87ea-2b635603196f&_=1427981074407
>>>
>>>
>>> 2015-04-02 09:26:33,842 ERROR [c.c.u.s.SshHelper]
>>> (DirectAgent-142:ctx-bc757c1a) SSH execution of command
>>> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.3.118
>>> ip_associations.json has an error status code in return. result output:
>>> Traceback (most recent call last):
>>> File "/opt/cloud/bin/update_config.py", line 20, in 
>>>  from merge import QueueFile
>>> File "/opt/cloud/bin/merge.py", line 23, in 
>>>  import cs_ip
>>> File "/opt/cloud/bin/cs_ip.py", line 19, in 
>>>  from netaddr import *
>>> ImportError: No module named netaddr
>>>
>>> 2015-04-02 09:26:33,862 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) null
>>>
>>> 2015-04-02 09:26:39,999 ERROR [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44 ctx-6cbd18bc) Failed to
>>> start instance VM[DomainRouter|r-10-VM]
>>> com.cloud.utils.exception.ExecutionException: Unable to start
>>> VM[DomainRouter|r-10-VM] due to error in finalizeStart, not retrying
>>> at
>>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1076)
>>> at
>>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4503)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>> at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>> at
>>> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>>> at
>>> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4659)
>>> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
>>> at
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>>> at
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>> at
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>> at
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>> at
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>> at
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>> at
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>> at java.lang.Thread.run(Thread.java:745)
>>>
>>> 2015-04-02 09:26:40,179 ERROR [c.c.v.VmWorkJobDispatcher]
>>> (Work-Job-Executor-10:ctx-15cd8652 job-43/job-44) Unable to complete
>>> AsyncJobVO {id:44, userId: 2, accountId: 2, instanceType: null, instanceId:
>>> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
>>> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMa