sureshanaparti opened a new issue, #12995:
URL: https://github.com/apache/cloudstack/issues/12995

   ### problem
   
   VM deployment failed with "Unable to apply dhcp entry on router".
   
   ```
   2026-04-10 06:52:52,342 DEBUG [c.c.a.t.Request] (AgentManager-Handler-13:[]) 
(logid:) Seq 2-2648116580893851763: Processing:  { Ans: , MgmtId: 
32986137363417, via: 2, Ver: v1, Flags: 10, 
[{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - failed: Error 
during SCP transfer.","null - failed: java.io.IOException: Stream closed
        at 
java.base/java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:168)
        at 
java.base/java.io.BufferedInputStream.read(BufferedInputStream.java:334)
        at java.base/sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:287)
        at java.base/sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:330)
        at java.base/sun.nio.cs.StreamDecoder.read(StreamDecoder.java:190)
        at java.base/java.io.InputStreamReader.read(InputStreamReader.java:177)
        at java.base/java.io.BufferedReader.fill(BufferedReader.java:162)
        at java.base/java.io.BufferedReader.readLine(BufferedReader.java:329)
        at java.base/java.io.BufferedReader.readLine(BufferedReader.java:396)
        at 
com.cloud.utils.script.OutputInterpreter.processError(OutputInterpreter.java:41)
        at com.cloud.utils.script.Script.execute(Script.java:355)
        at 
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeInVR(LibvirtComputingResource.java:563)
        at 
com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.applyConfigToVR(VirtualRoutingResource.java:303)
        at 
com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.applyConfig(VirtualRoutingResource.java:318)
        at 
com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.executeRequest(VirtualRoutingResource.java:165)
        at 
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtNetworkElementCommandWrapper.execute(LibvirtNetworkElementCommandWrapper.java:35)
        at 
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtNetworkElementCommandWrapper.execute(LibvirtNetworkElementCommandWrapper.java:29)
        at 
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78)
        at 
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1973)
        at com.cloud.agent.Agent.processRequest(Agent.java:778)
        at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1193)
        at com.cloud.utils.nio.Task.call(Task.java:83)
        at com.cloud.utils.nio.Task.call(Task.java:29)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base/java.lang.Thread.run(Thread.java:840)
   "],"result":"false","wait":"0","bypassHostMaintenance":"false"}}] }
   2026-04-10 06:52:52,343 DEBUG [c.c.a.t.Request] 
(Work-Job-Executor-4:[ctx-7c349757, job-50/job-52, ctx-0c0a5786]) 
(logid:795b7086) Seq 2-2648116580893851763: Received:  { Ans: , MgmtId: 
32986137363417, via: 2(ref-trl-11538-k-Mol8-suresh-anaparti-kvm2), Ver: v1, 
Flags: 10, { GroupAnswer } }
   2026-04-10 06:52:52,343 WARN  [c.c.v.ClusteredVirtualMachineManagerImpl] 
(Work-Job-Executor-4:[ctx-7c349757, job-50/job-52, ctx-0c0a5786]) 
(logid:795b7086) Unable to contact resource. 
com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is 
unreachable: Unable to apply dhcp entry on router 
        at 
org.apache.cloudstack.network.topology.BasicNetworkTopology.applyRules(BasicNetworkTopology.java:404)
        at 
org.apache.cloudstack.network.topology.AdvancedNetworkTopology.applyDhcpEntry(AdvancedNetworkTopology.java:173)
        at 
com.cloud.network.element.VirtualRouterElement.applyDhcpEntries(VirtualRouterElement.java:1087)
        at 
com.cloud.network.element.VirtualRouterElement.addDhcpEntry(VirtualRouterElement.java:1055)
        at 
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepareElement(NetworkOrchestrator.java:1838)
        at 
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepareNic(NetworkOrchestrator.java:2213)
        at 
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepare(NetworkOrchestrator.java:2142)
        at 
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1286)
        at 
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:5497)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:569)
        at 
com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:102)
        at 
com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:5621)
        at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:99)
        at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:661)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
        at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:609)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base/java.lang.Thread.run(Thread.java:840)
   
   2026-04-10 06:52:52,344 DEBUG [c.c.d.D.ExcludeList] 
(Work-Job-Executor-4:[ctx-7c349757, job-50/job-52, ctx-0c0a5786]) 
(logid:795b7086) Adding DataCenter [1] to the avoid set due to [Resource 
[DataCenter:1] is unreachable: Unable to apply dhcp entry on router ].
   ...
   2026-04-10 06:52:52,694 ERROR [c.c.v.VmWorkJobHandlerProxy] 
(Work-Job-Executor-4:[ctx-7c349757, job-50/job-52, ctx-0c0a5786]) 
(logid:795b7086) Invocation exception, caused by: 
com.cloud.exception.InsufficientServerCapacityException: Unable to create a 
deployment for VM instance 
{"id":9,"instanceName":"i-2-9-VM","state":"Starting","type":"User","uuid":"4896bc5b-ad62-4ac4-91ec-35038afb63d0"}Scope=interface
 com.cloud.dc.DataCenter; id=1
   2026-04-10 06:52:52,694 INFO  [c.c.v.VmWorkJobHandlerProxy] 
(Work-Job-Executor-4:[ctx-7c349757, job-50/job-52, ctx-0c0a5786]) 
(logid:795b7086) Rethrow exception 
com.cloud.exception.InsufficientServerCapacityException: Unable to create a 
deployment for VM instance 
{"id":9,"instanceName":"i-2-9-VM","state":"Starting","type":"User","uuid":"4896bc5b-ad62-4ac4-91ec-35038afb63d0"}Scope=interface
 com.cloud.dc.DataCenter; id=1
   2026-04-10 06:52:52,694 DEBUG [c.c.v.VmWorkJobDispatcher] 
(Work-Job-Executor-4:[ctx-7c349757, job-50/job-52]) (logid:795b7086) Done with 
run of VM work job: com.cloud.vm.VmWorkStart for VM 9, job origin: 50
   2026-04-10 06:52:52,694 ERROR [c.c.v.VmWorkJobDispatcher] 
(Work-Job-Executor-4:[ctx-7c349757, job-50/job-52]) (logid:795b7086) Unable to 
complete AsyncJob 
{"accountId":2,"cmd":"com.cloud.vm.VmWorkStart","cmdInfo":"rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAACXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3JkdAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw","cm
 dVersion":0,"completeMsid":null,"created":"Fri Apr 10 06:52:51 UTC 
2026","id":52,"initMsid":32986137363417,"instanceId":null,"instanceType":null,"lastPolled":null,"lastUpdated":null,"processStatus":0,"removed":null,"result":null,"resultCode":0,"status":"IN_PROGRESS","userId":2,"uuid":"d4cd3d05-3ea4-47c2-b009-7e95c43e7dc6"},
 job origin: 50 com.cloud.exception.InsufficientServerCapacityException: Unable 
to create a deployment for VM instance 
{"id":9,"instanceName":"i-2-9-VM","state":"Starting","type":"User","uuid":"4896bc5b-ad62-4ac4-91ec-35038afb63d0"}Scope=interface
 com.cloud.dc.DataCenter; id=1
        at 
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1261)
        at 
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:5497)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:569)
        at 
com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:102)
        at 
com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:5621)
        at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:99)
        at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:661)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
        at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:609)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base/java.lang.Thread.run(Thread.java:840)
   ```
   
   ```
   2026-04-10 06:53:42,899 DEBUG [c.c.a.t.Request] (AgentManager-Handler-13:[]) 
(logid:) Seq 2-2648116580893851767: Processing:  { Ans: , MgmtId: 
32986137363417, via: 2, Ver: v1, Flags: 10, 
[{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - failed: Error 
during SCP transfer.","null - failed: java.io.IOException: Stream closed
        at 
java.base/java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:168)
        at 
java.base/java.io.BufferedInputStream.read(BufferedInputStream.java:334)
        at java.base/sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:287)
        at java.base/sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:330)
        at java.base/sun.nio.cs.StreamDecoder.read(StreamDecoder.java:190)
        at java.base/java.io.InputStreamReader.read(InputStreamReader.java:177)
        at java.base/java.io.BufferedReader.fill(BufferedReader.java:162)
        at java.base/java.io.BufferedReader.readLine(BufferedReader.java:329)
        at java.base/java.io.BufferedReader.readLine(BufferedReader.java:396)
        at 
com.cloud.utils.script.OutputInterpreter.processError(OutputInterpreter.java:41)
        at com.cloud.utils.script.Script.execute(Script.java:355)
        at 
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeInVR(LibvirtComputingResource.java:563)
        at 
com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.applyConfigToVR(VirtualRoutingResource.java:303)
        at 
com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.applyConfig(VirtualRoutingResource.java:318)
        at 
com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.executeRequest(VirtualRoutingResource.java:165)
        at 
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtNetworkElementCommandWrapper.execute(LibvirtNetworkElementCommandWrapper.java:35)
        at 
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtNetworkElementCommandWrapper.execute(LibvirtNetworkElementCommandWrapper.java:29)
        at 
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78)
        at 
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1973)
        at com.cloud.agent.Agent.processRequest(Agent.java:778)
        at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1193)
        at com.cloud.utils.nio.Task.call(Task.java:83)
        at com.cloud.utils.nio.Task.call(Task.java:29)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base/java.lang.Thread.run(Thread.java:840)
   "],"result":"false","wait":"0","bypassHostMaintenance":"false"}}] }
   2026-04-10 06:53:42,899 DEBUG [c.c.a.t.Request] 
(Work-Job-Executor-5:[ctx-46295efc, job-53/job-54, ctx-f489f07d]) 
(logid:a1472051) Seq 2-2648116580893851767: Received:  { Ans: , MgmtId: 
32986137363417, via: 2(ref-trl-11538-k-Mol8-suresh-anaparti-kvm2), Ver: v1, 
Flags: 10, { GroupAnswer } }
   2026-04-10 06:53:42,899 WARN  [c.c.v.ClusteredVirtualMachineManagerImpl] 
(Work-Job-Executor-5:[ctx-46295efc, job-53/job-54, ctx-f489f07d]) 
(logid:a1472051) Unable to contact resource. 
com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is 
unreachable: Unable to apply dhcp entry on router 
        at 
org.apache.cloudstack.network.topology.BasicNetworkTopology.applyRules(BasicNetworkTopology.java:404)
        at 
org.apache.cloudstack.network.topology.AdvancedNetworkTopology.applyDhcpEntry(AdvancedNetworkTopology.java:173)
        at 
com.cloud.network.element.VirtualRouterElement.applyDhcpEntries(VirtualRouterElement.java:1087)
        at 
com.cloud.network.element.VirtualRouterElement.addDhcpEntry(VirtualRouterElement.java:1055)
        at 
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepareElement(NetworkOrchestrator.java:1838)
        at 
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepareNic(NetworkOrchestrator.java:2213)
        at 
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepare(NetworkOrchestrator.java:2142)
        at 
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1286)
        at 
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:5497)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:569)
        at 
com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:102)
        at 
com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:5621)
        at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:99)
        at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:661)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
        at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:609)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base/java.lang.Thread.run(Thread.java:840)
   
   2026-04-10 06:53:42,900 DEBUG [c.c.d.D.ExcludeList] 
(Work-Job-Executor-5:[ctx-46295efc, job-53/job-54, ctx-f489f07d]) 
(logid:a1472051) Adding DataCenter [1] to the avoid set due to [Resource 
[DataCenter:1] is unreachable: Unable to apply dhcp entry on router ].
   ...
   2026-04-10 06:53:43,249 ERROR [c.c.v.VmWorkJobHandlerProxy] 
(Work-Job-Executor-5:[ctx-46295efc, job-53/job-54, ctx-f489f07d]) 
(logid:a1472051) Invocation exception, caused by: 
com.cloud.exception.InsufficientServerCapacityException: Unable to create a 
deployment for VM instance 
{"id":10,"instanceName":"i-2-10-VM","state":"Starting","type":"User","uuid":"dfec9ff5-5dce-4f75-927b-7a2948353111"}Scope=interface
 com.cloud.dc.DataCenter; id=1
   2026-04-10 06:53:43,250 INFO  [c.c.v.VmWorkJobHandlerProxy] 
(Work-Job-Executor-5:[ctx-46295efc, job-53/job-54, ctx-f489f07d]) 
(logid:a1472051) Rethrow exception 
com.cloud.exception.InsufficientServerCapacityException: Unable to create a 
deployment for VM instance 
{"id":10,"instanceName":"i-2-10-VM","state":"Starting","type":"User","uuid":"dfec9ff5-5dce-4f75-927b-7a2948353111"}Scope=interface
 com.cloud.dc.DataCenter; id=1
   2026-04-10 06:53:43,250 DEBUG [c.c.v.VmWorkJobDispatcher] 
(Work-Job-Executor-5:[ctx-46295efc, job-53/job-54]) (logid:a1472051) Done with 
run of VM work job: com.cloud.vm.VmWorkStart for VM 10, job origin: 53
   2026-04-10 06:53:43,250 ERROR [c.c.v.VmWorkJobDispatcher] 
(Work-Job-Executor-5:[ctx-46295efc, job-53/job-54]) (logid:a1472051) Unable to 
complete AsyncJob 
{"accountId":2,"cmd":"com.cloud.vm.VmWorkStart","cmdInfo":"rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAACnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAXBzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAAFzcQB-AAgAAAAAAAAAAnBwcHEAfgAKcHNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACR
 
gAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAAAAx3CAAAABAAAAABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt4cA","cmdVersion":0,"completeMsid":null,"created":"Fri
 Apr 10 06:53:41 UTC 
2026","id":54,"initMsid":32986137363417,"instanceId":null,"instanceType":null,"lastPolled":null,"lastUpdated":null,"processStatus":0,"removed":null,"result":null,"resultCode":0,"status":"IN_PROGRESS","userId":2,"uuid":"0a9b51e6-9817-4241-ae96-a0140de75587"},
 job origin: 53 com.cloud.exception.InsufficientServerCapacityException: Unable 
to create a deployment for VM instance 
{"id":10,"instanceName":"i-2-10-VM","state":"Starting","type":"User","uuid":"dfec9ff5-5dce-4f75-927b-7a2948353111"}Scope=interface
 com.cloud.dc.DataCenter; id=1
        at 
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1261)
        at 
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:5497)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:569)
        at 
com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:102)
        at 
com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:5621)
        at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:99)
        at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:661)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at 
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at 
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
        at 
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:609)
        at 
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
        at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base/java.lang.Thread.run(Thread.java:840)
   ```
   
   
   ### versions
   
   ACS 4.20.3 RC4 + Advanced Zone + KVM hypervisor 
   
   ### The steps to reproduce the bug
   
   1. Create a isolated network and deploy a VM on it
   2. Deploy another VM, and notice the issue
   
   
   ### What to do about it?
   
   Expecting VM deployment to succeed when there is enough capacity.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to