Hi All,
I have a simple lab setup:
1 x CSMS v4.4.1 and 1 X Xen v6.2.
ccsm01 (10.10.0.16)
cXen01 (10.10.0.14-mgmt, 10.10.1.14 storage).
Xenserver network:
nic0: management (vlan 10 access port)
nic1: vlan interfaces vlans 2 (public), 11(storage), 12(guest)
I followed the guide for Xen server system VM templates and they are
populated on the primary storage NFS (10.10.1.2:/csprimary).
Attached is an output of:
grep -i -E 'exception|unable|fail|invalid|leak|warn|error'
/var/log/cloudstack/management/management-server.log
This entry makes me think that my network setup is incorrect:
*2014-12-08 09:41:00,204 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-113:ctx-1b7ca6b6) Catch Exception: class
com.xensource.xenapi.Types$PifIsVlan due to You tried to create a VLAN on
top of another VLAN - use the underlying physical PIF/bond instead*
Any help would be much appreciated.
Cheers,
Wikus
2014-12-08 09:39:30,357 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-4:ctx-bb7dc62d job-4/job-2674 ctx-1c1671d3) VM state
transitted from :Starting to Stopped with event: OperationFailedvm's original
host id: null new host id: null host id before state transition: 1
2014-12-08 09:39:30,373 ERROR [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-4:ctx-bb7dc62d job-4/job-2674 ctx-1c1671d3) Invocation
exception, caused by: com.cloud.exception.InsufficientServerCapacityException:
Unable to create a deployment for VM[ConsoleProxy|v-2-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:39:30,374 INFO [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-4:ctx-bb7dc62d job-4/job-2674 ctx-1c1671d3) Rethrow
exception com.cloud.exception.InsufficientServerCapacityException: Unable to
create a deployment for VM[ConsoleProxy|v-2-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:39:30,374 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-4:ctx-bb7dc62d job-4/job-2674) Unable to complete AsyncJobVO
{id:2674, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd:
com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAAAnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 345052769882, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Mon Dec 08 09:39:28 GMT 2014}, job origin:4
com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[ConsoleProxy|v-2-VM]Scope=interface com.cloud.dc.DataCenter;
id=1
2014-12-08 09:39:30,375 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-4:ctx-bb7dc62d job-4/job-2674) Complete async job-2674,
jobStatus: FAILED, resultCode: 0, result:
rO0ABXNyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPlAgAAeHIAE2phdmEubGFuZy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3dhYmxl1cY1Jzl3uMsDAARMAAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE1lc3NhZ2V0ABJMamF2YS9sYW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU3RhY2tUcmFjZUVsZW1lbnQ7TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xpc3Q7eHBxAH4AB3QAVUpvYiBmYWlsZWQgZHVlIHRvIGV4Y2VwdGlvbiBVbmFibGUgdG8gY3JlYXRlIGEgZGVwbG95bWVudCBmb3IgVk1bQ29uc29sZVByb3h5fHYtMi1WTV11cgAeW0xqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnQ7AkYqPDz9IjkCAAB4cAAAAA1zcgAbamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50YQnFmiY23YUCAARJAApsaW5lTnVtYmVyTAAOZGVjbGFyaW5nQ2xhc3NxAH4ABEwACGZpbGVOYW1lcQB-AARMAAptZXRob2ROYW1lcQB-AAR4cAAAAHJ0ACBjb20uY2xvdWQudm0uVm1Xb3JrSm9iRGlzcGF0Y2hlcnQAGFZtV29ya0pvYkRpc3BhdGNoZXIuamF2YXQABnJ1bkpvYnNxAH4ACwAAAfd0AD9vcmcuYXBhY2hlLmNsb3Vkc3RhY2suZnJhbWV3b3JrLmpvYnMuaW1wbC5Bc3luY0pvYk1hbmFnZXJJbXBsJDV0ABhBc3luY0pvYk1hbmFnZXJJbXBsLmphdmF0AAxydW5JbkNvbnRleHRzcQB-AAsAAAAxdAA-b3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5NYW5hZ2VkQ29udGV4dFJ1bm5hYmxlJDF0ABtNYW5hZ2VkQ29udGV4dFJ1bm5hYmxlLmphdmF0AANydW5zcQB-AAsAAAA4dABCb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dCQxdAAaRGVmYXVsdE1hbmFnZWRDb250ZXh0LmphdmF0AARjYWxsc3EAfgALAAAAZ3QAQG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHRxAH4AGnQAD2NhbGxXaXRoQ29udGV4dHNxAH4ACwAAADVxAH4AHXEAfgAadAAOcnVuV2l0aENvbnRleHRzcQB-AAsAAAAudAA8b3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5NYW5hZ2VkQ29udGV4dFJ1bm5hYmxlcQB-ABZxAH4AF3NxAH4ACwAAAcxxAH4AEXEAfgAScQB-ABdzcQB-AAsAAAHXdAAuamF2YS51dGlsLmNvbmN1cnJlbnQuRXhlY3V0b3JzJFJ1bm5hYmxlQWRhcHRlcnQADkV4ZWN1dG9ycy5qYXZhcQB-ABtzcQB-AAsAAAEGdAAfamF2YS51dGlsLmNvbmN1cnJlbnQuRnV0dXJlVGFza3QAD0Z1dHVyZVRhc2suamF2YXEAfgAXc3EAfgALAAAEeXQAJ2phdmEudXRpbC5jb25jdXJyZW50LlRocmVhZFBvb2xFeGVjdXRvcnQAF1RocmVhZFBvb2xFeGVjdXRvci5qYXZhdAAJcnVuV29ya2Vyc3EAfgALAAACZ3QALmphdmEudXRpbC5jb25jdXJyZW50LlRocmVhZFBvb2xFeGVjdXRvciRXb3JrZXJxAH4ALHEAfgAXc3EAfgALAAAC6XQAEGphdmEubGFuZy5UaHJlYWR0AAtUaHJlYWQuamF2YXEAfgAXc3IAJmphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVMaXN0_A8lMbXsjhACAAFMAARsaXN0cQB-AAZ4cgAsamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUNvbGxlY3Rpb24ZQgCAy173HgIAAUwAAWN0ABZMamF2YS91dGlsL0NvbGxlY3Rpb247eHBzcgATamF2YS51dGlsLkFycmF5TGlzdHiB0h2Zx2GdAwABSQAEc2l6ZXhwAAAAAHcEAAAAAHhxAH4AOHg
2014-12-08 09:39:30,414 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-150:ctx-6282c630 job-3/job-2673 ctx-8089b37f) VM state
transitted from :Starting to Stopped with event: OperationFailedvm's original
host id: null new host id: null host id before state transition: 1
2014-12-08 09:39:30,428 WARN [c.c.v.SystemVmLoadScanner]
(consoleproxy-1:ctx-ca6faf19) Unexpected exception Job failed due to exception
Unable to create a deployment for VM[ConsoleProxy|v-2-VM]
java.lang.RuntimeException: Job failed due to exception Unable to create a
deployment for VM[ConsoleProxy|v-2-VM]
2014-12-08 09:39:30,460 ERROR [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-150:ctx-6282c630 job-3/job-2673 ctx-8089b37f) Invocation
exception, caused by: com.cloud.exception.InsufficientServerCapacityException:
Unable to create a deployment for
VM[SecondaryStorageVm|s-530-VM]Scope=interface com.cloud.dc.DataCenter; id=1
2014-12-08 09:39:30,461 INFO [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-150:ctx-6282c630 job-3/job-2673 ctx-8089b37f) Rethrow
exception com.cloud.exception.InsufficientServerCapacityException: Unable to
create a deployment for VM[SecondaryStorageVm|s-530-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:39:30,461 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-150:ctx-6282c630 job-3/job-2673) Unable to complete
AsyncJobVO {id:2673, userId: 1, accountId: 1, instanceType: null, instanceId:
null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAACEnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 345052769882, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Mon Dec 08 09:39:28 GMT 2014}, job origin:3
com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[SecondaryStorageVm|s-530-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:39:30,462 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-150:ctx-6282c630 job-3/job-2673) Complete async job-2673,
jobStatus: FAILED, resultCode: 0, result:
rO0ABXNyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPlAgAAeHIAE2phdmEubGFuZy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3dhYmxl1cY1Jzl3uMsDAARMAAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE1lc3NhZ2V0ABJMamF2YS9sYW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU3RhY2tUcmFjZUVsZW1lbnQ7TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xpc3Q7eHBxAH4AB3QAXUpvYiBmYWlsZWQgZHVlIHRvIGV4Y2VwdGlvbiBVbmFibGUgdG8gY3JlYXRlIGEgZGVwbG95bWVudCBmb3IgVk1bU2Vjb25kYXJ5U3RvcmFnZVZtfHMtNTMwLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAADXNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAETAAIZmlsZU5hbWVxAH4ABEwACm1ldGhvZE5hbWVxAH4ABHhwAAAAcnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgALAAAB93QAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4ACwAAADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4ACwAAADh0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-AAsAAABndABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgAadAAPY2FsbFdpdGhDb250ZXh0c3EAfgALAAAANXEAfgAdcQB-ABp0AA5ydW5XaXRoQ29udGV4dHNxAH4ACwAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AFnEAfgAXc3EAfgALAAABzHEAfgARcQB-ABJxAH4AF3NxAH4ACwAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AG3NxAH4ACwAAAQZ0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ABdzcQB-AAsAAAR5dAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJzcQB-AAsAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgAscQB-ABdzcQB-AAsAAALpdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ABdzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ABnhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlvbjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHEAfgA4eA
2014-12-08 09:39:30,503 WARN [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-da58df7e) Exception while trying to start secondary storage vm
java.lang.RuntimeException: Job failed due to exception Unable to create a
deployment for VM[SecondaryStorageVm|s-530-VM]
2014-12-08 09:39:30,503 INFO [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-da58df7e) Unable to start secondary storage vm for standby
capacity, secStorageVm vm Id : 530, will recycle it and start a new one
2014-12-08 09:39:30,514 WARN [c.c.u.d.Merovingian2]
(secstorage-1:ctx-da58df7e) Was unable to find lock for the key vm_instance530
and thread id 401732798
2014-12-08 09:39:45,729 WARN [o.a.c.alerts] (HA-5:ctx-33ef0592) alertType::
13 // dataCenterId:: 0 // podId:: 0 // clusterId:: null // message:: No usage
server process running
2014-12-08 09:39:52,899 WARN [c.c.a.m.DirectAgentAttache]
(DirectAgentCronJob-414:ctx-a7672f34) Unable to get current status on
1(cxen01.conclusum.net)
2014-12-08 09:39:58,888 WARN [c.c.u.d.Merovingian2]
(consoleproxy-1:ctx-adf613b2) Was unable to find lock for the key vm_instance2
and thread id 110787335
2014-12-08 09:39:58,935 WARN [c.c.u.d.Merovingian2]
(secstorage-1:ctx-e2e79d75) Was unable to find lock for the key vm_instance531
and thread id 401732798
2014-12-08 09:40:00,168 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-224:ctx-387a1112) Catch Exception: class
com.xensource.xenapi.Types$PifIsVlan due to You tried to create a VLAN on top
of another VLAN - use the underlying physical PIF/bond instead
2014-12-08 09:40:00,168 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-224:ctx-387a1112) Unable to start v-2-VM due to
2014-12-08 09:40:00,186 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-224:ctx-387a1112) Unable to clean up VBD due to
You gave an invalid object reference. The object may have recently been
deleted. The class parameter gives the type of reference given, and the handle
parameter echoes the bad value given.
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1496)
2014-12-08 09:40:00,190 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-224:ctx-387a1112) Unable to clean up VBD due to
You gave an invalid object reference. The object may have recently been
deleted. The class parameter gives the type of reference given, and the handle
parameter echoes the bad value given.
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1496)
2014-12-08 09:40:00,191 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-224:ctx-387a1112) Seq 1-1501387525774645997: Cancelling because
one of the answers is false and it is stop on error.
2014-12-08 09:40:00,192 DEBUG [c.c.a.t.Request] (DirectAgent-224:ctx-387a1112)
Seq 1-1501387525774645997: Processing: { Ans: , MgmtId: 345052769882, via: 1,
Ver: v1, Flags: 10,
[{"com.cloud.agent.api.StartAnswer":{"vm":{"id":2,"name":"v-2-VM","bootloader":"PyGrub","type":"ConsoleProxy","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":1073741824,"maxRam":1073741824,"arch":"x86_64","os":"Debian
GNU/Linux 7(32-bit)","platformEmulator":"Debian Wheezy 7.0
(32-bit)","bootArgs":" template=domP type=consoleproxy host=10.10.0.16
port=8250 name=v-2-VM zone=1 pod=1 guid=Proxy.2 proxy_vm=2
disable_rp_filter=true eth2ip=192.168.0.11 eth2mask=255.255.255.0
gateway=192.168.0.1 eth0ip=169.254.0.53 eth0mask=255.255.0.0 eth1ip=10.10.0.139
eth1mask=255.255.255.0 mgmtcidr=10.10.0.0/24 localgw=10.10.0.1
internaldns1=10.10.0.11
dns1=8.8.8.8","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"8f0c0515beb50a7b","params":{},"uuid":"6ec8592e-6913-461f-a8f7-eed1ada1e61c","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"25290675-6dea-481e-bc4c-5ff6a6a42800","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"01c90513-f9b5-3ecb-b9d2-4b504e8562c9","id":5,"poolType":"NetworkFilesystem","host":"10.10.1.2","path":"/csprimary","port":2049,"url":"NetworkFilesystem://10.10.1.2/csprimary/?ROLE=Primary&STOREUUID=01c90513-f9b5-3ecb-b9d2-4b504e8562c9"}},"name":"ROOT-2","size":2621440000,"path":"3cf35eae-28ce-45cb-9a75-8c67f33418db","volumeId":2,"vmName":"v-2-VM","accountId":1,"format":"VHD","id":2,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"3cf35eae-28ce-45cb-9a75-8c67f33418db","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.10.1.2","volumeSize":"2621440000"}}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"ad37748c-9599-49fc-a5d3-52b148289a70","ip":"192.168.0.11","netmask":"255.255.255.0","gateway":"192.168.0.1","mac":"06:67:0c:00:00:34","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://2","isolationUri":"vlan://2","isSecurityGroupEnabled":false,"name":"wan"},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"22452b33-f574-4975-ba98-c85505bb622f","ip":"169.254.0.53","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:35","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"7ea03122-e661-4cab-8ecf-79ee177333ae","ip":"10.10.0.139","netmask":"255.255.255.0","gateway":"10.10.0.1","mac":"06:76:30:00:00:28","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false,"name":"nic0"}]},"_iqnToPath":{},"result":false,"details":"Unable
to start v-2-VM due to ","wait":0}}] }
2014-12-08 09:40:00,205 INFO [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-152:ctx-1a0d47a7 job-4/job-2676 ctx-9491ae8a) Unable to
start VM on Host[-1-Routing] due to Unable to start v-2-VM due to
2014-12-08 09:40:00,323 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-152:ctx-1a0d47a7 job-4/job-2676 ctx-9491ae8a) VM state
transitted from :Starting to Stopped with event: OperationFailedvm's original
host id: null new host id: null host id before state transition: 1
2014-12-08 09:40:00,338 ERROR [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-152:ctx-1a0d47a7 job-4/job-2676 ctx-9491ae8a) Invocation
exception, caused by: com.cloud.exception.InsufficientServerCapacityException:
Unable to create a deployment for VM[ConsoleProxy|v-2-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:40:00,339 INFO [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-152:ctx-1a0d47a7 job-4/job-2676 ctx-9491ae8a) Rethrow
exception com.cloud.exception.InsufficientServerCapacityException: Unable to
create a deployment for VM[ConsoleProxy|v-2-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:40:00,339 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-152:ctx-1a0d47a7 job-4/job-2676) Unable to complete
AsyncJobVO {id:2676, userId: 1, accountId: 1, instanceType: null, instanceId:
null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAAAnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 345052769882, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Mon Dec 08 09:39:58 GMT 2014}, job origin:4
com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[ConsoleProxy|v-2-VM]Scope=interface com.cloud.dc.DataCenter;
id=1
2014-12-08 09:40:00,340 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-152:ctx-1a0d47a7 job-4/job-2676) Complete async job-2676,
jobStatus: FAILED, resultCode: 0, result:
rO0ABXNyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPlAgAAeHIAE2phdmEubGFuZy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3dhYmxl1cY1Jzl3uMsDAARMAAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE1lc3NhZ2V0ABJMamF2YS9sYW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU3RhY2tUcmFjZUVsZW1lbnQ7TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xpc3Q7eHBxAH4AB3QAVUpvYiBmYWlsZWQgZHVlIHRvIGV4Y2VwdGlvbiBVbmFibGUgdG8gY3JlYXRlIGEgZGVwbG95bWVudCBmb3IgVk1bQ29uc29sZVByb3h5fHYtMi1WTV11cgAeW0xqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnQ7AkYqPDz9IjkCAAB4cAAAAA1zcgAbamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50YQnFmiY23YUCAARJAApsaW5lTnVtYmVyTAAOZGVjbGFyaW5nQ2xhc3NxAH4ABEwACGZpbGVOYW1lcQB-AARMAAptZXRob2ROYW1lcQB-AAR4cAAAAHJ0ACBjb20uY2xvdWQudm0uVm1Xb3JrSm9iRGlzcGF0Y2hlcnQAGFZtV29ya0pvYkRpc3BhdGNoZXIuamF2YXQABnJ1bkpvYnNxAH4ACwAAAfd0AD9vcmcuYXBhY2hlLmNsb3Vkc3RhY2suZnJhbWV3b3JrLmpvYnMuaW1wbC5Bc3luY0pvYk1hbmFnZXJJbXBsJDV0ABhBc3luY0pvYk1hbmFnZXJJbXBsLmphdmF0AAxydW5JbkNvbnRleHRzcQB-AAsAAAAxdAA-b3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5NYW5hZ2VkQ29udGV4dFJ1bm5hYmxlJDF0ABtNYW5hZ2VkQ29udGV4dFJ1bm5hYmxlLmphdmF0AANydW5zcQB-AAsAAAA4dABCb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dCQxdAAaRGVmYXVsdE1hbmFnZWRDb250ZXh0LmphdmF0AARjYWxsc3EAfgALAAAAZ3QAQG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHRxAH4AGnQAD2NhbGxXaXRoQ29udGV4dHNxAH4ACwAAADVxAH4AHXEAfgAadAAOcnVuV2l0aENvbnRleHRzcQB-AAsAAAAudAA8b3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5NYW5hZ2VkQ29udGV4dFJ1bm5hYmxlcQB-ABZxAH4AF3NxAH4ACwAAAcxxAH4AEXEAfgAScQB-ABdzcQB-AAsAAAHXdAAuamF2YS51dGlsLmNvbmN1cnJlbnQuRXhlY3V0b3JzJFJ1bm5hYmxlQWRhcHRlcnQADkV4ZWN1dG9ycy5qYXZhcQB-ABtzcQB-AAsAAAEGdAAfamF2YS51dGlsLmNvbmN1cnJlbnQuRnV0dXJlVGFza3QAD0Z1dHVyZVRhc2suamF2YXEAfgAXc3EAfgALAAAEeXQAJ2phdmEudXRpbC5jb25jdXJyZW50LlRocmVhZFBvb2xFeGVjdXRvcnQAF1RocmVhZFBvb2xFeGVjdXRvci5qYXZhdAAJcnVuV29ya2Vyc3EAfgALAAACZ3QALmphdmEudXRpbC5jb25jdXJyZW50LlRocmVhZFBvb2xFeGVjdXRvciRXb3JrZXJxAH4ALHEAfgAXc3EAfgALAAAC6XQAEGphdmEubGFuZy5UaHJlYWR0AAtUaHJlYWQuamF2YXEAfgAXc3IAJmphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVMaXN0_A8lMbXsjhACAAFMAARsaXN0cQB-AAZ4cgAsamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUNvbGxlY3Rpb24ZQgCAy173HgIAAUwAAWN0ABZMamF2YS91dGlsL0NvbGxlY3Rpb247eHBzcgATamF2YS51dGlsLkFycmF5TGlzdHiB0h2Zx2GdAwABSQAEc2l6ZXhwAAAAAHcEAAAAAHhxAH4AOHg
2014-12-08 09:40:00,383 WARN [c.c.v.SystemVmLoadScanner]
(consoleproxy-1:ctx-adf613b2) Unexpected exception Job failed due to exception
Unable to create a deployment for VM[ConsoleProxy|v-2-VM]
java.lang.RuntimeException: Job failed due to exception Unable to create a
deployment for VM[ConsoleProxy|v-2-VM]
2014-12-08 09:40:01,061 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-112:ctx-d26a95d7) Catch Exception: class
com.xensource.xenapi.Types$PifIsVlan due to You tried to create a VLAN on top
of another VLAN - use the underlying physical PIF/bond instead
2014-12-08 09:40:01,062 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-112:ctx-d26a95d7) Unable to start s-531-VM due to
2014-12-08 09:40:01,079 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-112:ctx-d26a95d7) Unable to clean up VBD due to
You gave an invalid object reference. The object may have recently been
deleted. The class parameter gives the type of reference given, and the handle
parameter echoes the bad value given.
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1496)
2014-12-08 09:40:01,083 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-112:ctx-d26a95d7) Unable to clean up VBD due to
You gave an invalid object reference. The object may have recently been
deleted. The class parameter gives the type of reference given, and the handle
parameter echoes the bad value given.
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1496)
2014-12-08 09:40:01,084 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-112:ctx-d26a95d7) Seq 1-1501387525774646000: Cancelling because
one of the answers is false and it is stop on error.
2014-12-08 09:40:01,085 DEBUG [c.c.a.t.Request] (DirectAgent-112:ctx-d26a95d7)
Seq 1-1501387525774646000: Processing: { Ans: , MgmtId: 345052769882, via: 1,
Ver: v1, Flags: 10,
[{"com.cloud.agent.api.StartAnswer":{"vm":{"id":531,"name":"s-531-VM","bootloader":"PyGrub","type":"SecondaryStorageVm","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":536870912,"maxRam":536870912,"arch":"x86_64","os":"Debian
GNU/Linux 7(32-bit)","platformEmulator":"Debian Wheezy 7.0
(32-bit)","bootArgs":" template=domP type=secstorage host=10.10.0.16 port=8250
name=s-531-VM zone=1 pod=1 guid=s-531-VM
resource=com.cloud.storage.resource.PremiumSecondaryStorageResource
instance=SecStorage sslcopy=false role=templateProcessor mtu=1500
eth2ip=192.168.0.10 eth2mask=255.255.255.0 gateway=192.168.0.1
public.network.device=eth2 eth0ip=169.254.1.249 eth0mask=255.255.0.0
eth1ip=10.10.0.119 eth1mask=255.255.255.0 mgmtcidr=10.10.0.0/24
localgw=10.10.0.1 private.network.device=eth1 eth3ip=10.10.1.146
eth3mask=255.255.255.0 storageip=10.10.1.146 storagenetmask=255.255.255.0
storagegateway=10.10.1.1 internaldns1=10.10.0.11
dns1=8.8.8.8","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"d240ee3b9f748a3c","params":{},"uuid":"dbf36bd4-cbb1-44a5-ba44-fe8b6083fb1f","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"1ba7ba63-f2f3-4e9b-a0f5-3568595ed207","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"01c90513-f9b5-3ecb-b9d2-4b504e8562c9","id":5,"poolType":"NetworkFilesystem","host":"10.10.1.2","path":"/csprimary","port":2049,"url":"NetworkFilesystem://10.10.1.2/csprimary/?ROLE=Primary&STOREUUID=01c90513-f9b5-3ecb-b9d2-4b504e8562c9"}},"name":"ROOT-531","size":2621440000,"path":"bcec513d-6073-4eb0-9158-5c8d6b617f3a","volumeId":531,"vmName":"s-531-VM","accountId":1,"format":"VHD","id":531,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"bcec513d-6073-4eb0-9158-5c8d6b617f3a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.10.1.2","volumeSize":"2621440000"}}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"ad37748c-9599-49fc-a5d3-52b148289a70","ip":"192.168.0.10","netmask":"255.255.255.0","gateway":"192.168.0.1","mac":"06:13:d8:00:00:33","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://2","isolationUri":"vlan://2","isSecurityGroupEnabled":false,"name":"wan"},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"22452b33-f574-4975-ba98-c85505bb622f","ip":"169.254.1.249","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:01:f9","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"7ea03122-e661-4cab-8ecf-79ee177333ae","ip":"10.10.0.119","netmask":"255.255.255.0","gateway":"10.10.0.1","mac":"06:09:74:00:00:14","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false,"name":"nic0"},{"deviceId":3,"networkRateMbps":-1,"defaultNic":false,"uuid":"67d34637-f805-4959-8899-0bd1878e74a0","ip":"10.10.1.146","netmask":"255.255.255.0","gateway":"10.10.1.1","mac":"06:31:18:00:00:6b","broadcastType":"Storage","type":"Storage","broadcastUri":"storage://11","isSecurityGroupEnabled":false,"name":"san"}]},"_iqnToPath":{},"result":false,"details":"Unable
to start s-531-VM due to ","wait":0}}] }
2014-12-08 09:40:01,097 INFO [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-153:ctx-22ba2d76 job-3/job-2677 ctx-c9297be9) Unable to
start VM on Host[-1-Routing] due to Unable to start s-531-VM due to
2014-12-08 09:40:01,236 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-153:ctx-22ba2d76 job-3/job-2677 ctx-c9297be9) VM state
transitted from :Starting to Stopped with event: OperationFailedvm's original
host id: null new host id: null host id before state transition: 1
2014-12-08 09:40:01,251 ERROR [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-153:ctx-22ba2d76 job-3/job-2677 ctx-c9297be9) Invocation
exception, caused by: com.cloud.exception.InsufficientServerCapacityException:
Unable to create a deployment for
VM[SecondaryStorageVm|s-531-VM]Scope=interface com.cloud.dc.DataCenter; id=1
2014-12-08 09:40:01,251 INFO [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-153:ctx-22ba2d76 job-3/job-2677 ctx-c9297be9) Rethrow
exception com.cloud.exception.InsufficientServerCapacityException: Unable to
create a deployment for VM[SecondaryStorageVm|s-531-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:40:01,251 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-153:ctx-22ba2d76 job-3/job-2677) Unable to complete
AsyncJobVO {id:2677, userId: 1, accountId: 1, instanceType: null, instanceId:
null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAACE3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 345052769882, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Mon Dec 08 09:39:58 GMT 2014}, job origin:3
com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[SecondaryStorageVm|s-531-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:40:01,252 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-153:ctx-22ba2d76 job-3/job-2677) Complete async job-2677,
jobStatus: FAILED, resultCode: 0, result:
rO0ABXNyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPlAgAAeHIAE2phdmEubGFuZy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3dhYmxl1cY1Jzl3uMsDAARMAAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE1lc3NhZ2V0ABJMamF2YS9sYW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU3RhY2tUcmFjZUVsZW1lbnQ7TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xpc3Q7eHBxAH4AB3QAXUpvYiBmYWlsZWQgZHVlIHRvIGV4Y2VwdGlvbiBVbmFibGUgdG8gY3JlYXRlIGEgZGVwbG95bWVudCBmb3IgVk1bU2Vjb25kYXJ5U3RvcmFnZVZtfHMtNTMxLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAADXNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAETAAIZmlsZU5hbWVxAH4ABEwACm1ldGhvZE5hbWVxAH4ABHhwAAAAcnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgALAAAB93QAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4ACwAAADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4ACwAAADh0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-AAsAAABndABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgAadAAPY2FsbFdpdGhDb250ZXh0c3EAfgALAAAANXEAfgAdcQB-ABp0AA5ydW5XaXRoQ29udGV4dHNxAH4ACwAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AFnEAfgAXc3EAfgALAAABzHEAfgARcQB-ABJxAH4AF3NxAH4ACwAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AG3NxAH4ACwAAAQZ0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ABdzcQB-AAsAAAR5dAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJzcQB-AAsAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgAscQB-ABdzcQB-AAsAAALpdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ABdzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ABnhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlvbjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHEAfgA4eA
2014-12-08 09:40:01,292 WARN [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-e2e79d75) Exception while trying to start secondary storage vm
java.lang.RuntimeException: Job failed due to exception Unable to create a
deployment for VM[SecondaryStorageVm|s-531-VM]
2014-12-08 09:40:01,293 INFO [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-e2e79d75) Unable to start secondary storage vm for standby
capacity, secStorageVm vm Id : 531, will recycle it and start a new one
2014-12-08 09:40:28,816 WARN [c.c.u.d.Merovingian2]
(secstorage-1:ctx-71cca896) Was unable to find lock for the key vm_instance531
and thread id 401732798
2014-12-08 09:40:28,887 WARN [c.c.u.d.Merovingian2]
(consoleproxy-1:ctx-2575170f) Was unable to find lock for the key vm_instance2
and thread id 110787335
2014-12-08 09:40:30,155 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-225:ctx-ea19769f) Catch Exception: class
com.xensource.xenapi.Types$PifIsVlan due to You tried to create a VLAN on top
of another VLAN - use the underlying physical PIF/bond instead
2014-12-08 09:40:30,156 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-225:ctx-ea19769f) Unable to start v-2-VM due to
2014-12-08 09:40:30,197 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-225:ctx-ea19769f) Unable to clean up VBD due to
You gave an invalid object reference. The object may have recently been
deleted. The class parameter gives the type of reference given, and the handle
parameter echoes the bad value given.
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1496)
2014-12-08 09:40:30,205 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-225:ctx-ea19769f) Unable to clean up VBD due to
You gave an invalid object reference. The object may have recently been
deleted. The class parameter gives the type of reference given, and the handle
parameter echoes the bad value given.
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1496)
2014-12-08 09:40:30,206 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-225:ctx-ea19769f) Seq 1-1501387525774646004: Cancelling because
one of the answers is false and it is stop on error.
2014-12-08 09:40:30,207 DEBUG [c.c.a.t.Request] (DirectAgent-225:ctx-ea19769f)
Seq 1-1501387525774646004: Processing: { Ans: , MgmtId: 345052769882, via: 1,
Ver: v1, Flags: 10,
[{"com.cloud.agent.api.StartAnswer":{"vm":{"id":2,"name":"v-2-VM","bootloader":"PyGrub","type":"ConsoleProxy","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":1073741824,"maxRam":1073741824,"arch":"x86_64","os":"Debian
GNU/Linux 7(32-bit)","platformEmulator":"Debian Wheezy 7.0
(32-bit)","bootArgs":" template=domP type=consoleproxy host=10.10.0.16
port=8250 name=v-2-VM zone=1 pod=1 guid=Proxy.2 proxy_vm=2
disable_rp_filter=true eth2ip=192.168.0.11 eth2mask=255.255.255.0
gateway=192.168.0.1 eth0ip=169.254.3.180 eth0mask=255.255.0.0
eth1ip=10.10.0.105 eth1mask=255.255.255.0 mgmtcidr=10.10.0.0/24
localgw=10.10.0.1 internaldns1=10.10.0.11
dns1=8.8.8.8","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"8f0c0515beb50a7b","params":{},"uuid":"6ec8592e-6913-461f-a8f7-eed1ada1e61c","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"25290675-6dea-481e-bc4c-5ff6a6a42800","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"01c90513-f9b5-3ecb-b9d2-4b504e8562c9","id":5,"poolType":"NetworkFilesystem","host":"10.10.1.2","path":"/csprimary","port":2049,"url":"NetworkFilesystem://10.10.1.2/csprimary/?ROLE=Primary&STOREUUID=01c90513-f9b5-3ecb-b9d2-4b504e8562c9"}},"name":"ROOT-2","size":2621440000,"path":"3cf35eae-28ce-45cb-9a75-8c67f33418db","volumeId":2,"vmName":"v-2-VM","accountId":1,"format":"VHD","id":2,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"3cf35eae-28ce-45cb-9a75-8c67f33418db","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.10.1.2","volumeSize":"2621440000"}}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"ad37748c-9599-49fc-a5d3-52b148289a70","ip":"192.168.0.11","netmask":"255.255.255.0","gateway":"192.168.0.1","mac":"06:67:0c:00:00:34","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://2","isolationUri":"vlan://2","isSecurityGroupEnabled":false,"name":"wan"},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"22452b33-f574-4975-ba98-c85505bb622f","ip":"169.254.3.180","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:03:b4","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"7ea03122-e661-4cab-8ecf-79ee177333ae","ip":"10.10.0.105","netmask":"255.255.255.0","gateway":"10.10.0.1","mac":"06:73:ec:00:00:06","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false,"name":"nic0"}]},"_iqnToPath":{},"result":false,"details":"Unable
to start v-2-VM due to ","wait":0}}] }
2014-12-08 09:40:30,217 INFO [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-157:ctx-3f8405c1 job-4/job-2679 ctx-ae96b9df) Unable to
start VM on Host[-1-Routing] due to Unable to start v-2-VM due to
2014-12-08 09:40:30,227 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-450:ctx-fe73bb87) Catch Exception: class
com.xensource.xenapi.Types$PifIsVlan due to You tried to create a VLAN on top
of another VLAN - use the underlying physical PIF/bond instead
2014-12-08 09:40:30,228 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-450:ctx-fe73bb87) Unable to start s-531-VM due to
2014-12-08 09:40:30,251 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-450:ctx-fe73bb87) Unable to clean up VBD due to
You gave an invalid object reference. The object may have recently been
deleted. The class parameter gives the type of reference given, and the handle
parameter echoes the bad value given.
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1496)
2014-12-08 09:40:30,256 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-450:ctx-fe73bb87) Unable to clean up VBD due to
You gave an invalid object reference. The object may have recently been
deleted. The class parameter gives the type of reference given, and the handle
parameter echoes the bad value given.
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1496)
2014-12-08 09:40:30,257 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-450:ctx-fe73bb87) Seq 1-1501387525774646005: Cancelling because
one of the answers is false and it is stop on error.
2014-12-08 09:40:30,259 DEBUG [c.c.a.t.Request] (DirectAgent-450:ctx-fe73bb87)
Seq 1-1501387525774646005: Processing: { Ans: , MgmtId: 345052769882, via: 1,
Ver: v1, Flags: 10,
[{"com.cloud.agent.api.StartAnswer":{"vm":{"id":531,"name":"s-531-VM","bootloader":"PyGrub","type":"SecondaryStorageVm","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":536870912,"maxRam":536870912,"arch":"x86_64","os":"Debian
GNU/Linux 7(32-bit)","platformEmulator":"Debian Wheezy 7.0
(32-bit)","bootArgs":" template=domP type=secstorage host=10.10.0.16 port=8250
name=s-531-VM zone=1 pod=1 guid=s-531-VM
resource=com.cloud.storage.resource.PremiumSecondaryStorageResource
instance=SecStorage sslcopy=false role=templateProcessor mtu=1500
eth2ip=192.168.0.10 eth2mask=255.255.255.0 gateway=192.168.0.1
public.network.device=eth2 eth0ip=169.254.3.86 eth0mask=255.255.0.0
eth1ip=10.10.0.148 eth1mask=255.255.255.0 mgmtcidr=10.10.0.0/24
localgw=10.10.0.1 private.network.device=eth1 eth3ip=10.10.1.120
eth3mask=255.255.255.0 storageip=10.10.1.120 storagenetmask=255.255.255.0
storagegateway=10.10.1.1 internaldns1=10.10.0.11
dns1=8.8.8.8","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"d240ee3b9f748a3c","params":{},"uuid":"dbf36bd4-cbb1-44a5-ba44-fe8b6083fb1f","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"1ba7ba63-f2f3-4e9b-a0f5-3568595ed207","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"01c90513-f9b5-3ecb-b9d2-4b504e8562c9","id":5,"poolType":"NetworkFilesystem","host":"10.10.1.2","path":"/csprimary","port":2049,"url":"NetworkFilesystem://10.10.1.2/csprimary/?ROLE=Primary&STOREUUID=01c90513-f9b5-3ecb-b9d2-4b504e8562c9"}},"name":"ROOT-531","size":2621440000,"path":"bcec513d-6073-4eb0-9158-5c8d6b617f3a","volumeId":531,"vmName":"s-531-VM","accountId":1,"format":"VHD","id":531,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"bcec513d-6073-4eb0-9158-5c8d6b617f3a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.10.1.2","volumeSize":"2621440000"}}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"ad37748c-9599-49fc-a5d3-52b148289a70","ip":"192.168.0.10","netmask":"255.255.255.0","gateway":"192.168.0.1","mac":"06:13:d8:00:00:33","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://2","isolationUri":"vlan://2","isSecurityGroupEnabled":false,"name":"wan"},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"22452b33-f574-4975-ba98-c85505bb622f","ip":"169.254.3.86","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:03:56","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"7ea03122-e661-4cab-8ecf-79ee177333ae","ip":"10.10.0.148","netmask":"255.255.255.0","gateway":"10.10.0.1","mac":"06:88:38:00:00:31","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false,"name":"nic0"},{"deviceId":3,"networkRateMbps":-1,"defaultNic":false,"uuid":"67d34637-f805-4959-8899-0bd1878e74a0","ip":"10.10.1.120","netmask":"255.255.255.0","gateway":"10.10.1.1","mac":"06:13:b0:00:00:51","broadcastType":"Storage","type":"Storage","broadcastUri":"storage://11","isSecurityGroupEnabled":false,"name":"san"}]},"_iqnToPath":{},"result":false,"details":"Unable
to start s-531-VM due to ","wait":0}}] }
2014-12-08 09:40:30,276 INFO [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-155:ctx-8f4cc2f9 job-3/job-2678 ctx-4343fe7d) Unable to
start VM on Host[-1-Routing] due to Unable to start s-531-VM due to
2014-12-08 09:40:30,368 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-157:ctx-3f8405c1 job-4/job-2679 ctx-ae96b9df) VM state
transitted from :Starting to Stopped with event: OperationFailedvm's original
host id: null new host id: null host id before state transition: 1
2014-12-08 09:40:30,390 ERROR [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-157:ctx-3f8405c1 job-4/job-2679 ctx-ae96b9df) Invocation
exception, caused by: com.cloud.exception.InsufficientServerCapacityException:
Unable to create a deployment for VM[ConsoleProxy|v-2-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:40:30,391 INFO [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-157:ctx-3f8405c1 job-4/job-2679 ctx-ae96b9df) Rethrow
exception com.cloud.exception.InsufficientServerCapacityException: Unable to
create a deployment for VM[ConsoleProxy|v-2-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:40:30,391 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-157:ctx-3f8405c1 job-4/job-2679) Unable to complete
AsyncJobVO {id:2679, userId: 1, accountId: 1, instanceType: null, instanceId:
null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAAAnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 345052769882, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Mon Dec 08 09:40:28 GMT 2014}, job origin:4
com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[ConsoleProxy|v-2-VM]Scope=interface com.cloud.dc.DataCenter;
id=1
2014-12-08 09:40:30,392 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-157:ctx-3f8405c1 job-4/job-2679) Complete async job-2679,
jobStatus: FAILED, resultCode: 0, result:
rO0ABXNyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPlAgAAeHIAE2phdmEubGFuZy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3dhYmxl1cY1Jzl3uMsDAARMAAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE1lc3NhZ2V0ABJMamF2YS9sYW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU3RhY2tUcmFjZUVsZW1lbnQ7TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xpc3Q7eHBxAH4AB3QAVUpvYiBmYWlsZWQgZHVlIHRvIGV4Y2VwdGlvbiBVbmFibGUgdG8gY3JlYXRlIGEgZGVwbG95bWVudCBmb3IgVk1bQ29uc29sZVByb3h5fHYtMi1WTV11cgAeW0xqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnQ7AkYqPDz9IjkCAAB4cAAAAA1zcgAbamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50YQnFmiY23YUCAARJAApsaW5lTnVtYmVyTAAOZGVjbGFyaW5nQ2xhc3NxAH4ABEwACGZpbGVOYW1lcQB-AARMAAptZXRob2ROYW1lcQB-AAR4cAAAAHJ0ACBjb20uY2xvdWQudm0uVm1Xb3JrSm9iRGlzcGF0Y2hlcnQAGFZtV29ya0pvYkRpc3BhdGNoZXIuamF2YXQABnJ1bkpvYnNxAH4ACwAAAfd0AD9vcmcuYXBhY2hlLmNsb3Vkc3RhY2suZnJhbWV3b3JrLmpvYnMuaW1wbC5Bc3luY0pvYk1hbmFnZXJJbXBsJDV0ABhBc3luY0pvYk1hbmFnZXJJbXBsLmphdmF0AAxydW5JbkNvbnRleHRzcQB-AAsAAAAxdAA-b3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5NYW5hZ2VkQ29udGV4dFJ1bm5hYmxlJDF0ABtNYW5hZ2VkQ29udGV4dFJ1bm5hYmxlLmphdmF0AANydW5zcQB-AAsAAAA4dABCb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dCQxdAAaRGVmYXVsdE1hbmFnZWRDb250ZXh0LmphdmF0AARjYWxsc3EAfgALAAAAZ3QAQG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHRxAH4AGnQAD2NhbGxXaXRoQ29udGV4dHNxAH4ACwAAADVxAH4AHXEAfgAadAAOcnVuV2l0aENvbnRleHRzcQB-AAsAAAAudAA8b3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5NYW5hZ2VkQ29udGV4dFJ1bm5hYmxlcQB-ABZxAH4AF3NxAH4ACwAAAcxxAH4AEXEAfgAScQB-ABdzcQB-AAsAAAHXdAAuamF2YS51dGlsLmNvbmN1cnJlbnQuRXhlY3V0b3JzJFJ1bm5hYmxlQWRhcHRlcnQADkV4ZWN1dG9ycy5qYXZhcQB-ABtzcQB-AAsAAAEGdAAfamF2YS51dGlsLmNvbmN1cnJlbnQuRnV0dXJlVGFza3QAD0Z1dHVyZVRhc2suamF2YXEAfgAXc3EAfgALAAAEeXQAJ2phdmEudXRpbC5jb25jdXJyZW50LlRocmVhZFBvb2xFeGVjdXRvcnQAF1RocmVhZFBvb2xFeGVjdXRvci5qYXZhdAAJcnVuV29ya2Vyc3EAfgALAAACZ3QALmphdmEudXRpbC5jb25jdXJyZW50LlRocmVhZFBvb2xFeGVjdXRvciRXb3JrZXJxAH4ALHEAfgAXc3EAfgALAAAC6XQAEGphdmEubGFuZy5UaHJlYWR0AAtUaHJlYWQuamF2YXEAfgAXc3IAJmphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVMaXN0_A8lMbXsjhACAAFMAARsaXN0cQB-AAZ4cgAsamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUNvbGxlY3Rpb24ZQgCAy173HgIAAUwAAWN0ABZMamF2YS91dGlsL0NvbGxlY3Rpb247eHBzcgATamF2YS51dGlsLkFycmF5TGlzdHiB0h2Zx2GdAwABSQAEc2l6ZXhwAAAAAHcEAAAAAHhxAH4AOHg
2014-12-08 09:40:30,427 WARN [c.c.v.SystemVmLoadScanner]
(consoleproxy-1:ctx-2575170f) Unexpected exception Job failed due to exception
Unable to create a deployment for VM[ConsoleProxy|v-2-VM]
java.lang.RuntimeException: Job failed due to exception Unable to create a
deployment for VM[ConsoleProxy|v-2-VM]
2014-12-08 09:40:30,466 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-155:ctx-8f4cc2f9 job-3/job-2678 ctx-4343fe7d) VM state
transitted from :Starting to Stopped with event: OperationFailedvm's original
host id: null new host id: null host id before state transition: 1
2014-12-08 09:40:30,483 ERROR [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-155:ctx-8f4cc2f9 job-3/job-2678 ctx-4343fe7d) Invocation
exception, caused by: com.cloud.exception.InsufficientServerCapacityException:
Unable to create a deployment for
VM[SecondaryStorageVm|s-531-VM]Scope=interface com.cloud.dc.DataCenter; id=1
2014-12-08 09:40:30,484 INFO [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-155:ctx-8f4cc2f9 job-3/job-2678 ctx-4343fe7d) Rethrow
exception com.cloud.exception.InsufficientServerCapacityException: Unable to
create a deployment for VM[SecondaryStorageVm|s-531-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:40:30,484 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-155:ctx-8f4cc2f9 job-3/job-2678) Unable to complete
AsyncJobVO {id:2678, userId: 1, accountId: 1, instanceType: null, instanceId:
null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAACE3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 345052769882, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Mon Dec 08 09:40:28 GMT 2014}, job origin:3
com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[SecondaryStorageVm|s-531-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:40:30,494 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-155:ctx-8f4cc2f9 job-3/job-2678) Complete async job-2678,
jobStatus: FAILED, resultCode: 0, result:
rO0ABXNyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPlAgAAeHIAE2phdmEubGFuZy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3dhYmxl1cY1Jzl3uMsDAARMAAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE1lc3NhZ2V0ABJMamF2YS9sYW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU3RhY2tUcmFjZUVsZW1lbnQ7TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xpc3Q7eHBxAH4AB3QAXUpvYiBmYWlsZWQgZHVlIHRvIGV4Y2VwdGlvbiBVbmFibGUgdG8gY3JlYXRlIGEgZGVwbG95bWVudCBmb3IgVk1bU2Vjb25kYXJ5U3RvcmFnZVZtfHMtNTMxLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAADXNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAETAAIZmlsZU5hbWVxAH4ABEwACm1ldGhvZE5hbWVxAH4ABHhwAAAAcnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgALAAAB93QAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4ACwAAADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4ACwAAADh0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-AAsAAABndABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgAadAAPY2FsbFdpdGhDb250ZXh0c3EAfgALAAAANXEAfgAdcQB-ABp0AA5ydW5XaXRoQ29udGV4dHNxAH4ACwAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AFnEAfgAXc3EAfgALAAABzHEAfgARcQB-ABJxAH4AF3NxAH4ACwAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AG3NxAH4ACwAAAQZ0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ABdzcQB-AAsAAAR5dAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJzcQB-AAsAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgAscQB-ABdzcQB-AAsAAALpdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ABdzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ABnhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlvbjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHEAfgA4eA
2014-12-08 09:40:30,535 WARN [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-71cca896) Exception while trying to start secondary storage vm
java.lang.RuntimeException: Job failed due to exception Unable to create a
deployment for VM[SecondaryStorageVm|s-531-VM]
2014-12-08 09:40:30,535 INFO [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-71cca896) Unable to start secondary storage vm for standby
capacity, secStorageVm vm Id : 531, will recycle it and start a new one
2014-12-08 09:40:30,544 WARN [c.c.u.d.Merovingian2]
(secstorage-1:ctx-71cca896) Was unable to find lock for the key vm_instance531
and thread id 401732798
2014-12-08 09:40:52,899 WARN [c.c.a.m.DirectAgentAttache]
(DirectAgentCronJob-414:ctx-e1fdbb8a) Unable to get current status on
1(cxen01.conclusum.net)
2014-12-08 09:40:58,893 WARN [c.c.u.d.Merovingian2]
(consoleproxy-1:ctx-0543d3a5) Was unable to find lock for the key vm_instance2
and thread id 110787335
2014-12-08 09:40:58,982 WARN [c.c.u.d.Merovingian2]
(secstorage-1:ctx-46c60fff) Was unable to find lock for the key vm_instance532
and thread id 401732798
2014-12-08 09:41:00,204 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-113:ctx-1b7ca6b6) Catch Exception: class
com.xensource.xenapi.Types$PifIsVlan due to You tried to create a VLAN on top
of another VLAN - use the underlying physical PIF/bond instead
2014-12-08 09:41:00,205 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-113:ctx-1b7ca6b6) Unable to start v-2-VM due to
2014-12-08 09:41:00,222 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-113:ctx-1b7ca6b6) Unable to clean up VBD due to
You gave an invalid object reference. The object may have recently been
deleted. The class parameter gives the type of reference given, and the handle
parameter echoes the bad value given.
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1496)
2014-12-08 09:41:00,226 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-113:ctx-1b7ca6b6) Unable to clean up VBD due to
You gave an invalid object reference. The object may have recently been
deleted. The class parameter gives the type of reference given, and the handle
parameter echoes the bad value given.
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1496)
2014-12-08 09:41:00,227 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-113:ctx-1b7ca6b6) Seq 1-1501387525774646010: Cancelling because
one of the answers is false and it is stop on error.
2014-12-08 09:41:00,228 DEBUG [c.c.a.t.Request] (DirectAgent-113:ctx-1b7ca6b6)
Seq 1-1501387525774646010: Processing: { Ans: , MgmtId: 345052769882, via: 1,
Ver: v1, Flags: 10,
[{"com.cloud.agent.api.StartAnswer":{"vm":{"id":2,"name":"v-2-VM","bootloader":"PyGrub","type":"ConsoleProxy","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":1073741824,"maxRam":1073741824,"arch":"x86_64","os":"Debian
GNU/Linux 7(32-bit)","platformEmulator":"Debian Wheezy 7.0
(32-bit)","bootArgs":" template=domP type=consoleproxy host=10.10.0.16
port=8250 name=v-2-VM zone=1 pod=1 guid=Proxy.2 proxy_vm=2
disable_rp_filter=true eth2ip=192.168.0.11 eth2mask=255.255.255.0
gateway=192.168.0.1 eth0ip=169.254.3.186 eth0mask=255.255.0.0
eth1ip=10.10.0.125 eth1mask=255.255.255.0 mgmtcidr=10.10.0.0/24
localgw=10.10.0.1 internaldns1=10.10.0.11
dns1=8.8.8.8","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"8f0c0515beb50a7b","params":{},"uuid":"6ec8592e-6913-461f-a8f7-eed1ada1e61c","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"25290675-6dea-481e-bc4c-5ff6a6a42800","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"01c90513-f9b5-3ecb-b9d2-4b504e8562c9","id":5,"poolType":"NetworkFilesystem","host":"10.10.1.2","path":"/csprimary","port":2049,"url":"NetworkFilesystem://10.10.1.2/csprimary/?ROLE=Primary&STOREUUID=01c90513-f9b5-3ecb-b9d2-4b504e8562c9"}},"name":"ROOT-2","size":2621440000,"path":"3cf35eae-28ce-45cb-9a75-8c67f33418db","volumeId":2,"vmName":"v-2-VM","accountId":1,"format":"VHD","id":2,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"3cf35eae-28ce-45cb-9a75-8c67f33418db","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.10.1.2","volumeSize":"2621440000"}}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"ad37748c-9599-49fc-a5d3-52b148289a70","ip":"192.168.0.11","netmask":"255.255.255.0","gateway":"192.168.0.1","mac":"06:67:0c:00:00:34","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://2","isolationUri":"vlan://2","isSecurityGroupEnabled":false,"name":"wan"},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"22452b33-f574-4975-ba98-c85505bb622f","ip":"169.254.3.186","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:03:ba","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"7ea03122-e661-4cab-8ecf-79ee177333ae","ip":"10.10.0.125","netmask":"255.255.255.0","gateway":"10.10.0.1","mac":"06:a0:70:00:00:1a","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false,"name":"nic0"}]},"_iqnToPath":{},"result":false,"details":"Unable
to start v-2-VM due to ","wait":0}}] }
2014-12-08 09:41:00,241 INFO [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-8:ctx-99cde515 job-4/job-2681 ctx-eebbaf19) Unable to start
VM on Host[-1-Routing] due to Unable to start v-2-VM due to
2014-12-08 09:41:00,359 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-99cde515 job-4/job-2681 ctx-eebbaf19) VM state
transitted from :Starting to Stopped with event: OperationFailedvm's original
host id: null new host id: null host id before state transition: 1
2014-12-08 09:41:00,378 ERROR [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-8:ctx-99cde515 job-4/job-2681 ctx-eebbaf19) Invocation
exception, caused by: com.cloud.exception.InsufficientServerCapacityException:
Unable to create a deployment for VM[ConsoleProxy|v-2-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:41:00,378 INFO [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-8:ctx-99cde515 job-4/job-2681 ctx-eebbaf19) Rethrow
exception com.cloud.exception.InsufficientServerCapacityException: Unable to
create a deployment for VM[ConsoleProxy|v-2-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:41:00,378 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-8:ctx-99cde515 job-4/job-2681) Unable to complete AsyncJobVO
{id:2681, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd:
com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAAAnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 345052769882, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Mon Dec 08 09:40:58 GMT 2014}, job origin:4
com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[ConsoleProxy|v-2-VM]Scope=interface com.cloud.dc.DataCenter;
id=1
2014-12-08 09:41:00,379 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-8:ctx-99cde515 job-4/job-2681) Complete async job-2681,
jobStatus: FAILED, resultCode: 0, result:
rO0ABXNyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPlAgAAeHIAE2phdmEubGFuZy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3dhYmxl1cY1Jzl3uMsDAARMAAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE1lc3NhZ2V0ABJMamF2YS9sYW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU3RhY2tUcmFjZUVsZW1lbnQ7TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xpc3Q7eHBxAH4AB3QAVUpvYiBmYWlsZWQgZHVlIHRvIGV4Y2VwdGlvbiBVbmFibGUgdG8gY3JlYXRlIGEgZGVwbG95bWVudCBmb3IgVk1bQ29uc29sZVByb3h5fHYtMi1WTV11cgAeW0xqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnQ7AkYqPDz9IjkCAAB4cAAAAA1zcgAbamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50YQnFmiY23YUCAARJAApsaW5lTnVtYmVyTAAOZGVjbGFyaW5nQ2xhc3NxAH4ABEwACGZpbGVOYW1lcQB-AARMAAptZXRob2ROYW1lcQB-AAR4cAAAAHJ0ACBjb20uY2xvdWQudm0uVm1Xb3JrSm9iRGlzcGF0Y2hlcnQAGFZtV29ya0pvYkRpc3BhdGNoZXIuamF2YXQABnJ1bkpvYnNxAH4ACwAAAfd0AD9vcmcuYXBhY2hlLmNsb3Vkc3RhY2suZnJhbWV3b3JrLmpvYnMuaW1wbC5Bc3luY0pvYk1hbmFnZXJJbXBsJDV0ABhBc3luY0pvYk1hbmFnZXJJbXBsLmphdmF0AAxydW5JbkNvbnRleHRzcQB-AAsAAAAxdAA-b3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5NYW5hZ2VkQ29udGV4dFJ1bm5hYmxlJDF0ABtNYW5hZ2VkQ29udGV4dFJ1bm5hYmxlLmphdmF0AANydW5zcQB-AAsAAAA4dABCb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dCQxdAAaRGVmYXVsdE1hbmFnZWRDb250ZXh0LmphdmF0AARjYWxsc3EAfgALAAAAZ3QAQG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHRxAH4AGnQAD2NhbGxXaXRoQ29udGV4dHNxAH4ACwAAADVxAH4AHXEAfgAadAAOcnVuV2l0aENvbnRleHRzcQB-AAsAAAAudAA8b3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5NYW5hZ2VkQ29udGV4dFJ1bm5hYmxlcQB-ABZxAH4AF3NxAH4ACwAAAcxxAH4AEXEAfgAScQB-ABdzcQB-AAsAAAHXdAAuamF2YS51dGlsLmNvbmN1cnJlbnQuRXhlY3V0b3JzJFJ1bm5hYmxlQWRhcHRlcnQADkV4ZWN1dG9ycy5qYXZhcQB-ABtzcQB-AAsAAAEGdAAfamF2YS51dGlsLmNvbmN1cnJlbnQuRnV0dXJlVGFza3QAD0Z1dHVyZVRhc2suamF2YXEAfgAXc3EAfgALAAAEeXQAJ2phdmEudXRpbC5jb25jdXJyZW50LlRocmVhZFBvb2xFeGVjdXRvcnQAF1RocmVhZFBvb2xFeGVjdXRvci5qYXZhdAAJcnVuV29ya2Vyc3EAfgALAAACZ3QALmphdmEudXRpbC5jb25jdXJyZW50LlRocmVhZFBvb2xFeGVjdXRvciRXb3JrZXJxAH4ALHEAfgAXc3EAfgALAAAC6XQAEGphdmEubGFuZy5UaHJlYWR0AAtUaHJlYWQuamF2YXEAfgAXc3IAJmphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVMaXN0_A8lMbXsjhACAAFMAARsaXN0cQB-AAZ4cgAsamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUNvbGxlY3Rpb24ZQgCAy173HgIAAUwAAWN0ABZMamF2YS91dGlsL0NvbGxlY3Rpb247eHBzcgATamF2YS51dGlsLkFycmF5TGlzdHiB0h2Zx2GdAwABSQAEc2l6ZXhwAAAAAHcEAAAAAHhxAH4AOHg
2014-12-08 09:41:00,410 WARN [c.c.v.SystemVmLoadScanner]
(consoleproxy-1:ctx-0543d3a5) Unexpected exception Job failed due to exception
Unable to create a deployment for VM[ConsoleProxy|v-2-VM]
java.lang.RuntimeException: Job failed due to exception Unable to create a
deployment for VM[ConsoleProxy|v-2-VM]
2014-12-08 09:41:01,065 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-454:ctx-08dda6c2) Catch Exception: class
com.xensource.xenapi.Types$PifIsVlan due to You tried to create a VLAN on top
of another VLAN - use the underlying physical PIF/bond instead
2014-12-08 09:41:01,066 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-454:ctx-08dda6c2) Unable to start s-532-VM due to
2014-12-08 09:41:01,083 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-454:ctx-08dda6c2) Unable to clean up VBD due to
You gave an invalid object reference. The object may have recently been
deleted. The class parameter gives the type of reference given, and the handle
parameter echoes the bad value given.
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1496)
2014-12-08 09:41:01,087 WARN [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-454:ctx-08dda6c2) Unable to clean up VBD due to
You gave an invalid object reference. The object may have recently been
deleted. The class parameter gives the type of reference given, and the handle
parameter echoes the bad value given.
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1496)
2014-12-08 09:41:01,088 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-454:ctx-08dda6c2) Seq 1-1501387525774646013: Cancelling because
one of the answers is false and it is stop on error.
2014-12-08 09:41:01,089 DEBUG [c.c.a.t.Request] (DirectAgent-454:ctx-08dda6c2)
Seq 1-1501387525774646013: Processing: { Ans: , MgmtId: 345052769882, via: 1,
Ver: v1, Flags: 10,
[{"com.cloud.agent.api.StartAnswer":{"vm":{"id":532,"name":"s-532-VM","bootloader":"PyGrub","type":"SecondaryStorageVm","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":536870912,"maxRam":536870912,"arch":"x86_64","os":"Debian
GNU/Linux 7(32-bit)","platformEmulator":"Debian Wheezy 7.0
(32-bit)","bootArgs":" template=domP type=secstorage host=10.10.0.16 port=8250
name=s-532-VM zone=1 pod=1 guid=s-532-VM
resource=com.cloud.storage.resource.PremiumSecondaryStorageResource
instance=SecStorage sslcopy=false role=templateProcessor mtu=1500
eth2ip=192.168.0.10 eth2mask=255.255.255.0 gateway=192.168.0.1
public.network.device=eth2 eth0ip=169.254.0.187 eth0mask=255.255.0.0
eth1ip=10.10.0.137 eth1mask=255.255.255.0 mgmtcidr=10.10.0.0/24
localgw=10.10.0.1 private.network.device=eth1 eth3ip=10.10.1.120
eth3mask=255.255.255.0 storageip=10.10.1.120 storagenetmask=255.255.255.0
storagegateway=10.10.1.1 internaldns1=10.10.0.11
dns1=8.8.8.8","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"c4b49f613a7b808a","params":{},"uuid":"2e4ae517-37d2-40bb-860f-bd84b9aab30a","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"82c423dc-9744-4ce6-a23e-d1b98d64653f","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"01c90513-f9b5-3ecb-b9d2-4b504e8562c9","id":5,"poolType":"NetworkFilesystem","host":"10.10.1.2","path":"/csprimary","port":2049,"url":"NetworkFilesystem://10.10.1.2/csprimary/?ROLE=Primary&STOREUUID=01c90513-f9b5-3ecb-b9d2-4b504e8562c9"}},"name":"ROOT-532","size":2621440000,"path":"563b4a2f-9803-4329-a042-d926ad132e6e","volumeId":532,"vmName":"s-532-VM","accountId":1,"format":"VHD","id":532,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"563b4a2f-9803-4329-a042-d926ad132e6e","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.10.1.2","volumeSize":"2621440000"}}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"ad37748c-9599-49fc-a5d3-52b148289a70","ip":"192.168.0.10","netmask":"255.255.255.0","gateway":"192.168.0.1","mac":"06:ab:66:00:00:33","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://2","isolationUri":"vlan://2","isSecurityGroupEnabled":false,"name":"wan"},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"22452b33-f574-4975-ba98-c85505bb622f","ip":"169.254.0.187","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:bb","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"7ea03122-e661-4cab-8ecf-79ee177333ae","ip":"10.10.0.137","netmask":"255.255.255.0","gateway":"10.10.0.1","mac":"06:b7:1e:00:00:26","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false,"name":"nic0"},{"deviceId":3,"networkRateMbps":-1,"defaultNic":false,"uuid":"67d34637-f805-4959-8899-0bd1878e74a0","ip":"10.10.1.120","netmask":"255.255.255.0","gateway":"10.10.1.1","mac":"06:21:3c:00:00:51","broadcastType":"Storage","type":"Storage","broadcastUri":"storage://11","isSecurityGroupEnabled":false,"name":"san"}]},"_iqnToPath":{},"result":false,"details":"Unable
to start s-532-VM due to ","wait":0}}] }
2014-12-08 09:41:01,101 INFO [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-158:ctx-13ba7739 job-3/job-2682 ctx-475ecc21) Unable to
start VM on Host[-1-Routing] due to Unable to start s-532-VM due to
2014-12-08 09:41:01,232 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-158:ctx-13ba7739 job-3/job-2682 ctx-475ecc21) VM state
transitted from :Starting to Stopped with event: OperationFailedvm's original
host id: null new host id: null host id before state transition: 1
2014-12-08 09:41:01,249 ERROR [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-158:ctx-13ba7739 job-3/job-2682 ctx-475ecc21) Invocation
exception, caused by: com.cloud.exception.InsufficientServerCapacityException:
Unable to create a deployment for
VM[SecondaryStorageVm|s-532-VM]Scope=interface com.cloud.dc.DataCenter; id=1
2014-12-08 09:41:01,249 INFO [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-158:ctx-13ba7739 job-3/job-2682 ctx-475ecc21) Rethrow
exception com.cloud.exception.InsufficientServerCapacityException: Unable to
create a deployment for VM[SecondaryStorageVm|s-532-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:41:01,249 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-158:ctx-13ba7739 job-3/job-2682) Unable to complete
AsyncJobVO {id:2682, userId: 1, accountId: 1, instanceType: null, instanceId:
null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAACFHQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 345052769882, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Mon Dec 08 09:40:58 GMT 2014}, job origin:3
com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[SecondaryStorageVm|s-532-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
2014-12-08 09:41:01,250 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-158:ctx-13ba7739 job-3/job-2682) Complete async job-2682,
jobStatus: FAILED, resultCode: 0, result:
rO0ABXNyABpqYXZhLmxhbmcuUnVudGltZUV4Y2VwdGlvbp5fBkcKNIPlAgAAeHIAE2phdmEubGFuZy5FeGNlcHRpb27Q_R8-GjscxAIAAHhyABNqYXZhLmxhbmcuVGhyb3dhYmxl1cY1Jzl3uMsDAARMAAVjYXVzZXQAFUxqYXZhL2xhbmcvVGhyb3dhYmxlO0wADWRldGFpbE1lc3NhZ2V0ABJMamF2YS9sYW5nL1N0cmluZztbAApzdGFja1RyYWNldAAeW0xqYXZhL2xhbmcvU3RhY2tUcmFjZUVsZW1lbnQ7TAAUc3VwcHJlc3NlZEV4Y2VwdGlvbnN0ABBMamF2YS91dGlsL0xpc3Q7eHBxAH4AB3QAXUpvYiBmYWlsZWQgZHVlIHRvIGV4Y2VwdGlvbiBVbmFibGUgdG8gY3JlYXRlIGEgZGVwbG95bWVudCBmb3IgVk1bU2Vjb25kYXJ5U3RvcmFnZVZtfHMtNTMyLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAADXNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAETAAIZmlsZU5hbWVxAH4ABEwACm1ldGhvZE5hbWVxAH4ABHhwAAAAcnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgALAAAB93QAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4ACwAAADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4ACwAAADh0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-AAsAAABndABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgAadAAPY2FsbFdpdGhDb250ZXh0c3EAfgALAAAANXEAfgAdcQB-ABp0AA5ydW5XaXRoQ29udGV4dHNxAH4ACwAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AFnEAfgAXc3EAfgALAAABzHEAfgARcQB-ABJxAH4AF3NxAH4ACwAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AG3NxAH4ACwAAAQZ0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ABdzcQB-AAsAAAR5dAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJzcQB-AAsAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgAscQB-ABdzcQB-AAsAAALpdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ABdzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ABnhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlvbjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHEAfgA4eA
2014-12-08 09:41:01,280 WARN [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-46c60fff) Exception while trying to start secondary storage vm
java.lang.RuntimeException: Job failed due to exception Unable to create a
deployment for VM[SecondaryStorageVm|s-532-VM]
2014-12-08 09:41:01,281 INFO [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-46c60fff) Unable to start secondary storage vm for standby
capacity, secStorageVm vm Id : 532, will recycle it and start a new one
