Hi Piotr, When attempting to add the NIC did you stop the instance?
I've found to add additional volumes I had to stop the instance to avoid this error. That being said, I've definitely added a NIC while the instance is running. Thanks, Alex [photo]<http://www.ussignal.com> Alex Dietrich Senior Network Engineer, US Signal 616-233-5094<tel:616-233-5094> | www.ussignal.com<https://www.ussignal.com> | adietr...@ussignal.com<mailto:adietr...@ussignal.com> 201 Ionia Ave SW, Grand Rapids, MI 49503<https://maps.google.com/?q=201%20Ionia%20Ave%20SW,%20Grand%20Rapids,%20MI%2049503> [linkedin]<https://www.linkedin.com/company/us-signal/> [facebook]<https://www.facebook.com/ussignalcom/> [youtube]<https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw> IMPORTANT: The contents of this email are confidential. Information is intended for the named recipient(s) only. If you have received this email by mistake, please notify the sender immediately and do not disclose the contents to anyone or make copies thereof. [__tpx__] ________________________________ From: Piotr Pisz <pi...@piszki.pl> Sent: Sunday, July 14, 2024 4:38:02 PM To: users@cloudstack.apache.org <users@cloudstack.apache.org> Subject: error: No more available PCI slot EXTERNAL Hi, I have a little problem, I'm trying to add an additional network card to the VM and I get the message below. This VM is running docker and several services. To other VMs without docker I can add a second NIC without any problem. The environment is KVM U22 and VM U24 CS 4.19 advanced zone without security groups. Maybe someone has encountered something similar? Regards, Piotr 2024-07-14 22:26:21,310 DEBUG [c.c.a.t.Request] (AgentManager-Handler-7:null) (logid:) Seq 4-3337448798858281554: Processing: { Ans: , MgmtId: 94770532512064, via: 4, Ver: v1, Flags: 110, [{"com.cloud.agent.api.PlugNicAnswer":{"result":"false","details":" Plug Nic failed due to org.libvirt.LibvirtException: internal error: No more available PCI slots","wait":"0","bypassHostMaintenance":"false"}}] } 2024-07-14 22:26:21,310 DEBUG [c.c.a.m.AgentAttache] (AgentManager-Handler-7:null) (logid:) Seq 4-3337448798858281554: No more commands found 2024-07-14 22:26:21,310 DEBUG [c.c.a.t.Request] (Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081) (logid:e94b73b2) Seq 4-3337448798858281554: Received: { Ans: , MgmtId: 94770532512064, via: 4(sdb.dco.webdisk.io), Ver: v1, Flags: 110, { PlugNicAnswer } } 2024-07-14 22:26:21,310 WARN [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081) (logid:e94b73b2) Unable to plug nic for vm i-4-24-VM 2024-07-14 22:26:21,311 WARN [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081) (logid:e94b73b2) Failed to plug nic to the vm VM instance {"id":24,"instanceName":"i-4-24-VM","type":"User","uuid":"a1276a23-44ab-4da3-b6d9-f86d8014cc04"} in network Network {"id": 208, "name": "Interconnect-VLAN", "uuid": "1887531b-8938-4a1f-869f-8ff8b344211e", "networkofferingid": 17} 2024-07-14 22:26:21,311 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081) (logid:e94b73b2) Removing nic NicProfile {"broadcastUri":"vlan:\/\/105","iPv4Address":null,"id":57,"reservationId":null,"vmId":24} from vm VM instance {"id":24,"instanceName":"i-4-24-VM","type":"User","uuid":"a1276a23-44ab-4da3-b6d9-f86d8014cc04"} as nic plug failed on the backend 2024-07-14 22:26:21,319 DEBUG [c.c.n.NetworkModelImpl] (Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081) (logid:e94b73b2) Service SecurityGroup is not supported in the network id=208 2024-07-14 22:26:21,326 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081) (logid:e94b73b2) Changing active number of nics for network id=208 on -1 2024-07-14 22:26:21,360 DEBUG [c.c.n.NetworkModelImpl] (Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081) (logid:e94b73b2) Service SecurityGroup is not supported in the network id=208 2024-07-14 22:26:21,373 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081) (logid:e94b73b2) Removed nic id=57 2024-07-14 22:26:21,375 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081) (logid:e94b73b2) Revoving nic secondary ip entry ... 2024-07-14 22:26:21,376 DEBUG [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081) (logid:e94b73b2) Done executing VM work job: com.cloud.vm.VmWorkAddVmToNetwork{"networkId":208,"requstedNicProfile":{"id":0,"networkId":0,"vmId":0,"macAddress":"02:01:00:d0:00:08","mode":"Dhcp","format":"Ip4","isolationUri":"vlan://105","broadcastUri":"vlan://105","strategy":"Start","defaultNic":false,"isSecurityGroupEnabled":false,"iPv4Dns1":"8.8.8.8"},"userId":2,"accountId":2,"vmId":24,"handlerName":"VirtualMachineManagerImpl"} 2024-07-14 22:26:21,378 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081) (logid:e94b73b2) Complete async job-256, jobStatus: SUCCEEDED, resultCode: 0, result: null 2024-07-14 22:26:21,380 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081) (logid:e94b73b2) Publish async job-256 complete on message bus 2024-07-14 22:26:21,380 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081) (logid:e94b73b2) Wake up jobs related to job-256 2024-07-14 22:26:21,380 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081) (logid:e94b73b2) Update db status for job-256 2024-07-14 22:26:21,382 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081) (logid:e94b73b2) Wake up jobs joined with job-256 and disjoin all subjobs created from job- 256 2024-07-14 22:26:21,398 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-21:ctx-0720514a job-255/job-256) (logid:e94b73b2) Done with run of VM work job: com.cloud.vm.VmWorkAddVmToNetwork for VM 24, job origin: 255 2024-07-14 22:26:21,398 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-21:ctx-0720514a job-255/job-256) (logid:e94b73b2) Done executing com.cloud.vm.VmWorkAddVmToNetwork for job-256 2024-07-14 22:26:21,400 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-21:ctx-0720514a job-255/job-256) (logid:e94b73b2) Remove job-256 from job monitoring 2024-07-14 22:26:21,442 WARN [c.c.v.VirtualMachineManagerImpl] (API-Job-Executor-39:ctx-e93b4cde job-255 ctx-90fb667e) (logid:e94b73b2) Could not get a nic with Network {"id": 208, "name": "Interconnect-VLAN", "uuid": "1887531b-8938-4a1f-869f-8ff8b344211e", "networkofferingid": 17} 2024-07-14 22:26:21,455 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-39:ctx-e93b4cde job-255) (logid:e94b73b2) Unexpected exception while executing org.apache.cloudstack.api.command.admin.vm.AddNicToVMCmdByAdmin java.lang.RuntimeException: null job execution result at com.cloud.vm.VirtualMachineManagerImpl.addVmToNetwork(VirtualMachineManagerImpl.java:4009) at com.cloud.vm.UserVmManagerImpl.addNicToVirtualMachine(UserVmManagerImpl.java:1455) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:52) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215) at com.sun.proxy.$Proxy199.addNicToVirtualMachine(Unknown Source) at org.apache.cloudstack.api.command.user.vm.AddNicToVMCmd.execute(AddNicToVMCmd.java:173) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:172) at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:112) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:654) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:48) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:45) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:602) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) 2024-07-14 22:26:21,458 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-39:ctx-e93b4cde job-255) (logid:e94b73b2) Complete async job-255, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"530","errortext":"null job execution result"}