"com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[SecondaryStorageVm|s-52-VM]Scope=interface
com.cloud.dc.DataCenter; id=1"
???????????????????????????????????????????????????????????????? - -
------------------ ???????? ------------------
??????: "????????";<79112...@qq.com>;
????????: 2015??8??17??(??????) ????11:21
??????: "users-cn"<users-cn@cloudstack.apache.org>;
????: ?????? RE: CloudStack????????????vm????????
------------------ ???????? ------------------
??????: "??????";<mengjic...@outlook.com>;
????????: 2015??8??13??(??????) ????10:21
??????: "users-cn@cloudstack.apache.org"<users-cn@cloudstack.apache.org>;
????: RE: CloudStack????????????vm????????
HI Tony ????????????????????????????????1.
????????????????????????????????2. ????????????????mount
nfs??????????????mount????????????????????3.
??????????????????????????????????????????????????????????????
??????????????????????
Date: Wed, 12 Aug 2015 10:53:36 +0800
From: xutao3...@sina.com
To: users-cn@cloudstack.apache.org
Subject: CloudStack????????????vm????????
????????????????????vm????????????????????????????
tail -100f /var/log/cloudstack/management/management-server.log
2015-08-12 10:46:04,414 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-89:ctx-8e8e74c8 job-1/job-265) Unable to complete AsyncJobVO
{id:265, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd:
com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAANHQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 75489454944000, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Wed Aug 12 10:45:59 CST 2015}, job origin:1
com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[SecondaryStorageVm|s-52-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:947)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4480)
at sun.reflect.GeneratedMethodAccessor254.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
at
com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4636)
at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
2015-08-12 10:46:04,416 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-89:ctx-8e8e74c8 job-1/job-265) Complete async job-265,
jobStatus: FAILED, resultCode: 0, result:
rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdABAVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1NlY29uZGFyeVN0b3JhZ2VWbXxzLTUyLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIABEkACmxpbmVOdW1iZXJMAA5kZWNsYXJpbmdDbGFzc3EAfgAKTAAIZmlsZU5hbWVxAH4ACkwACm1ldGhvZE5hbWVxAH4ACnhwAAADs3QAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHNxAH4AEQAAEYBxAH4AE3EAfgAUcQB-ABVzcQB-ABH_____dAAmc3VuLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IyNTRwdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AGXNxAH4AEQAAAl50ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAZc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEhxxAH4AE3EAfgAUcQB-ACNzcQB-ABEAAABndAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIZdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADN0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADZxAH4AM3QADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAvcQB-ADBzcQB-ABEAAAHucQB-ACpxAH4AK3EAfgAwc3EAfgARAAAB13QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA0c3EAfgARAAABBnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AMHNxAH4AEQAABHl0ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAmd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEVxAH4AMHNxAH4AEQAAAuh0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AMHNyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFF4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFMAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlctZnO985yvPOAgAAeHAA
2015-08-12 10:46:04,418 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-89:ctx-8e8e74c8 job-1/job-265) Publish async job-265
complete on message bus
2015-08-12 10:46:04,418 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-89:ctx-8e8e74c8 job-1/job-265) Wake up jobs related to
job-265
2015-08-12 10:46:04,418 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-89:ctx-8e8e74c8 job-1/job-265) Update db status for job-265
2015-08-12 10:46:04,419 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-89:ctx-8e8e74c8 job-1/job-265) Wake up jobs joined with
job-265 and disjoin all subjobs created from job- 265
2015-08-12 10:46:04,474 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-89:ctx-8e8e74c8 job-1/job-265) Done executing
com.cloud.vm.VmWorkStart for job-265
2015-08-12 10:46:04,476 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Work-Job-Executor-89:ctx-8e8e74c8 job-1/job-265) Remove job-265 from job
monitoring
2015-08-12 10:46:04,541 WARN [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-3701c279) Exception while trying to start secondary storage vm
com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[SecondaryStorageVm|s-52-VM]Scope=interface
com.cloud.dc.DataCenter; id=1
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:947)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4480)
at sun.reflect.GeneratedMethodAccessor254.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
at
com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4636)
at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
2015-08-12 10:46:04,542 INFO [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-3701c279) Unable to start secondary storage vm for standby
capacity, secStorageVm vm Id : 52, will recycle it and start a new one
2015-08-12 10:46:04,542 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter]
(secstorage-1:ctx-3701c279) received secondary storage vm alert
2015-08-12 10:46:04,542 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter]
(secstorage-1:ctx-3701c279) Secondary Storage Vm creation failure, zone:
kjt_cloud
2015-08-12 10:46:04,543 WARN [o.a.c.alerts] (secstorage-1:ctx-3701c279)
alertType:: 19 // dataCenterId:: 1 // podId:: null // clusterId:: null //
message:: Secondary Storage Vm creation failure. zone: kjt_cloud, error
details: null
2015-08-12 10:46:04,569 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-4c0ec8a8) Begin cleanup expired async-jobs
2015-08-12 10:46:04,574 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-4c0ec8a8) End cleanup expired async-jobs
2015-08-12 10:46:04,595 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl]
(secstorage-1:ctx-3701c279) Primary secondary storage is not even started, wait
until next turn
2015-08-12 10:46:05,568 DEBUG [c.c.s.StatsCollector]
(StatsCollector-3:ctx-3f84ca28) StorageCollector is running...
2015-08-12 10:46:05,572 DEBUG [c.c.s.StatsCollector]
(StatsCollector-3:ctx-3f84ca28) There is no secondary storage VM for secondary
storage host nfs://10.10.3.26/storage/secondary
2015-08-12 10:46:05,595 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-3f84ca28)
Seq 1-2016768208131850686: Received: { Ans: , MgmtId: 75489454944000, via: 1,
Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
2015-08-12 10:46:14,570 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-bb417496) Begin cleanup expired async-jobs
2015-08-12 10:46:14,576 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-bb417496) End cleanup expired async-jobs
2015-08-12 10:46:14,577 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-c9201eea) Found 0 routers to update status.
2015-08-12 10:46:14,579 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-c9201eea) Found 0 networks to update RvR status.
2015-08-12 10:46:24,570 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-85e2d556) Begin cleanup expired async-jobs
2015-08-12 10:46:24,576 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-85e2d556) End cleanup expired async-jobs
2015-08-12 10:46:28,903 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-97ba0aca) Zone 1 is ready to launch secondary storage VM
2015-08-12 10:46:28,908 INFO [o.a.c.s.PremiumSecondaryStorageManagerImpl]
(secstorage-1:ctx-97ba0aca) No running secondary storage vms found in
datacenter id=1, starting one
2015-08-12 10:46:28,923 INFO [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-97ba0aca) Found a stopped secondary storage vm, bring it up
to running pool. secStorageVm vm id : 52
2015-08-12 10:46:28,944 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(secstorage-1:ctx-97ba0aca) Sync job-266 execution on object VmWorkJobQueue.52
2015-08-12 10:46:28,998 DEBUG [c.c.c.ConsoleProxyManagerImpl]
(consoleproxy-1:ctx-a08f039c) Zone 1 is ready to launch console proxy
2015-08-12 10:46:28,998 DEBUG [c.c.c.ConsoleProxyManagerImpl]
(consoleproxy-1:ctx-a08f039c) Expand console proxy standby capacity for zone
kjt_cloud
2015-08-12 10:46:29,007 INFO [c.c.c.ConsoleProxyManagerImpl]
(consoleproxy-1:ctx-a08f039c) Found a stopped console proxy, bring it up to
running pool. proxy vm id : 2
2015-08-12 10:46:29,029 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(consoleproxy-1:ctx-a08f039c) Sync job-267 execution on object VmWorkJobQueue.2
2015-08-12 10:46:30,619 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-8939b438) Execute sync-queue item: SyncQueueItemVO
{id:255, queueId: 254, contentType: AsyncJob, contentId: 266, lastProcessMsid:
75489454944000, lastprocessNumber: 2, lastProcessTime: Wed Aug 12 10:46:30 CST
2015, created: Wed Aug 12 10:46:28 CST 2015}
2015-08-12 10:46:30,620 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-8939b438) Schedule queued job-266
