Hello Guys,
We have recently upgraded our XenServer from 7.1 to 8.2. We are using CloudStack 4.16.1. But after the upgradation my status of host is showing alert. I have gone through the logs getting below error. Can someone help me out for this. ————————————————————— rZCUKmFN6d4veFOrfeDI3u_9aDd-feyXbqPD-9Ua0Le6m9_Y7LciAVHmSw&command=listSystemVms&response=json&signatureVersion=3&expires=2022-06-01T08%3A43%3A33%2B0000&signature=x7KQg4LW2XPtTf%2BHHVn0Fm599xA%3D 2022-06-01 14:00:51,613 DEBUG [c.c.u.s.SSHCmdHelper] (DirectAgent-13:ctx-797e05c2) (logid:3256e16e) Executing cmd: rm -f /opt/xensource/sm/hostvmstats.py /opt/xensource/bin/copy_vhd_to_secondarystorage.sh /opt/xensource/bin/copy_vhd_from_secondarystorage.sh /opt/xensource/bin/create_privatetemplate_from_snapshot.sh /opt/xensource/bin/vhd-util /opt/cloud/bin/copy_vhd_to_secondarystorage.sh /opt/cloud/bin/copy_vhd_from_secondarystorage.sh /opt/cloud/bin/create_privatetemplate_from_snapshot.sh /opt/cloud/bin/vhd-util 2022-06-01 14:00:52,750 DEBUG [c.c.a.ApiServlet] (qtp1850777594-19:ctx-5c391d12) (logid:fb2dbf4b) ===START=== 172.31.29.44 -- GET listall=True&apiKey=W0EWPYRPQu51YPDQ8s_0b4wDDuSqrZCUKmFN6d4veFOrfeDI3u_9aDd-feyXbqPD-9Ua0Le6m9_Y7LciAVHmSw&command=listVpnConnections&response=json&signatureVersion=3&expires=2022-06-01T08%3A43%3A35%2B0000&signature=TBKYjvgMLESFTna9iXeGTJdKtc0%3D 2022-06-01 14:00:52,756 DEBUG [c.c.a.ApiServer] (qtp1850777594-19:ctx-5c391d12 ctx-9cd12123) (logid:fb2dbf4b) CIDRs from which account 'Acct[0d808973-19be-11eb-9555-005056961200-admin] -- Account {"id": 2, "name": "admin", "uuid": "0d808973-19be-11eb-9555-005056961200"}' is allowed to perform API calls: 0.0.0.0/0,::/0 2022-06-01 14:00:52,761 DEBUG [c.c.a.ApiServlet] (qtp1850777594-19:ctx-5c391d12 ctx-9cd12123 ctx-6326bb8c) (logid:fb2dbf4b) ===END=== 172.31.29.44 -- GET listall=True&apiKey=W0EWPYRPQu51YPDQ8s_0b4wDDuSqrZCUKmFN6d4veFOrfeDI3u_9aDd-feyXbqPD-9Ua0Le6m9_Y7LciAVHmSw&command=listVpnConnections&response=json&signatureVersion=3&expires=2022-06-01T08%3A43%3A35%2B0000&signature=TBKYjvgMLESFTna9iXeGTJdKtc0%3D 2022-06-01 14:00:52,862 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-13:ctx-797e05c2) (logid:3256e16e) Host 172.31.21.5 OpaqueRef:d1a2d70a-25bd-37b3-c581-2249ccf88fc0: Host 172.31.21.5 is already setup. 2022-06-01 14:00:52,868 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-13:ctx-797e05c2) (logid:3256e16e) callHostPlugin failed for cmd: setIptables with args due to The requested plugin could not be found. 2022-06-01 14:00:52,869 WARN [c.c.h.x.r.w.x.CitrixSetupCommandWrapper] (DirectAgent-13:ctx-797e05c2) (logid:3256e16e) Unable to setup com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for cmd: setIptables with args due to The requested plugin could not be found. at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:367) at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.setIptables(CitrixResourceBase.java:4706) at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixSetupCommandWrapper.execute(CitrixSetupCommandWrapper.java:63) at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixSetupCommandWrapper.execute(CitrixSetupCommandWrapper.java:45) at com.cloud.hypervisor.xenserver.resource.wrapper.xenbase.CitrixRequestWrapper.execute(CitrixRequestWrapper.java:122) at com.cloud.hypervisor.xenserver.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:1758) at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:315) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:48) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:45) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) 2022-06-01 14:00:52,869 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-13:ctx-797e05c2) (logid:3256e16e) Seq 1-2294302535168557057: Response Received: 2022-06-01 14:00:52,869 DEBUG [c.c.a.t.Request] (DirectAgent-13:ctx-797e05c2) (logid:3256e16e) Seq 1-2294302535168557057: Processing: { Ans: , MgmtId: 345050108278, via: 1(demonew), Ver: v1, Flags: 110, [{"com.cloud.agent.api.SetupAnswer":{"_reconnect":"true","result":"false","details":"callHostPlugin failed for cmd: setIptables with args due to The requested plugin could not be found.","wait":"0","bypassHostMaintenance":"false"}}] } 2022-06-01 14:00:52,871 DEBUG [c.c.a.m.AgentAttache] (DirectAgent-13:ctx-797e05c2) (logid:3256e16e) Seq 1-2294302535168557057: No more commands found 2022-06-01 14:00:52,871 DEBUG [c.c.a.t.Request] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Seq 1-2294302535168557057: Received: { Ans: , MgmtId: 345050108278, via: 1(demonew), Ver: v1, Flags: 110, { SetupAnswer } } 2022-06-01 14:00:52,871 WARN [c.c.h.x.d.XcpServerDiscoverer] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Unable to setup agent 1 due to callHostPlugin failed for cmd: setIptables with args due to The requested plugin could not be found. 2022-06-01 14:00:52,871 INFO [c.c.u.e.CSExceptionErrorCode] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Could not find exception: com.cloud.exception.ConnectionException in error code list for exceptions 2022-06-01 14:00:52,871 WARN [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Monitor XcpServerDiscoverer says there is an error in the connect process for 1 due to Reinitialize agent after setup. 2022-06-01 14:00:52,871 INFO [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Host 1 is disconnecting with event AgentDisconnected 2022-06-01 14:00:52,876 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) The next status of agent 1is Alert, current status is Connecting 2022-06-01 14:00:52,876 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Deregistering link for 1 with state Alert 2022-06-01 14:00:52,876 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Remove Agent : 1 2022-06-01 14:00:52,876 DEBUG [c.c.a.m.DirectAgentAttache] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Processing disconnect 1(demonew) 2022-06-01 14:00:52,876 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.hypervisor.xenserver.discoverer.XcpServerDiscoverer 2022-06-01 14:00:52,876 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.hypervisor.hyperv.discoverer.HypervServerDiscoverer 2022-06-01 14:00:52,876 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.storage.listener.StoragePoolMonitor 2022-06-01 14:00:52,878 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: org.apache.cloudstack.engine.orchestration.NetworkOrchestrator 2022-06-01 14:00:52,879 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.network.security.SecurityGroupListener 2022-06-01 14:00:52,879 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.hypervisor.vmware.manager.VmwareManagerImpl 2022-06-01 14:00:52,879 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.vm.ClusteredVirtualMachineManagerImpl 2022-06-01 14:00:52,879 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.hypervisor.vmware.manager.VmwareManagerImpl 2022-06-01 14:00:52,879 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.vm.ClusteredVirtualMachineManagerImpl 2022-06-01 14:00:52,879 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.storage.secondary.SecondaryStorageListener 2022-06-01 14:00:52,879 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.deploy.DeploymentPlanningManagerImpl 2022-06-01 14:00:52,879 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.agent.manager.AgentManagerImpl$BehindOnPingListener 2022-06-01 14:00:52,879 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.agent.manager.AgentManagerImpl$SetHostParamsListener 2022-06-01 14:00:52,879 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.storage.upload.UploadListener 2022-06-01 14:00:52,879 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor 2022-06-01 14:00:52,879 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl 2022-06-01 14:00:52,879 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.consoleproxy.ConsoleProxyListener 2022-06-01 14:00:52,879 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.storage.download.DownloadListener 2022-06-01 14:00:52,879 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor 2022-06-01 14:00:52,880 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.network.router.VirtualNetworkApplianceManagerImpl 2022-06-01 14:00:52,880 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.capacity.StorageCapacityListener 2022-06-01 14:00:52,880 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.capacity.ComputeCapacityListener 2022-06-01 14:00:52,880 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.network.NetworkUsageManagerImpl$DirectNetworkStatsListener 2022-06-01 14:00:52,880 DEBUG [c.c.n.NetworkUsageManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Disconnected called on 1 with status Alert 2022-06-01 14:00:52,880 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.storage.LocalStoragePoolListener 2022-06-01 14:00:52,880 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.hypervisor.kvm.discoverer.KvmServerDiscoverer 2022-06-01 14:00:52,880 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Sending Disconnect to listener: com.cloud.hypervisor.kvm.discoverer.LxcServerDiscoverer 2022-06-01 14:00:52,880 DEBUG [c.c.a.m.AgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Transition:[Resource state = Enabled, Agent event = AgentDisconnected, Host id = 1, name = demonew] 2022-06-01 14:00:52,882 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Notifying other nodes of to disconnect 2022-06-01 14:00:52,883 WARN [c.c.r.ResourceManagerImpl] (AgentTaskPool-10:ctx-2116547d) (logid:3256e16e) Unable to connect due to com.cloud.exception.ConnectionException: Reinitialize agent after setup. at com.cloud.hypervisor.xenserver.discoverer.XcpServerDiscoverer.processConnect(XcpServerDiscoverer.java:637) at com.cloud.agent.manager.AgentManagerImpl.notifyMonitorsOfConnection(AgentManagerImpl.java:564) at com.cloud.agent.manager.AgentManagerImpl.handleDirectConnectAgent(AgentManagerImpl.java:1535) at com.cloud.resource.ResourceManagerImpl.createHostAndAgent(ResourceManagerImpl.java:2377) at com.cloud.resource.ResourceManagerImpl.createHostAndAgent(ResourceManagerImpl.java:2510) at jdk.internal.reflect.GeneratedMethodAccessor636.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215) at com.sun.proxy.$Proxy194.createHostAndAgent(Unknown Source) at com.cloud.agent.manager.AgentManagerImpl$SimulateStartTask.runInContext(AgentManagerImpl.java:1159) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:48) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:45) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) Vivek Kumar Sr. Manager - Cloud & DevOps TechOps | Indiqus Technologies + 91 7503460090 <tel:++91+7503460090> vivek.ku...@indiqus.com <mailto:vivek.ku...@indiqus.com> www.indiqus.com <https://www.indiqus.com/> -- This message is intended only for the use of the individual or entity to which it is addressed and may contain confidential and/or privileged information. If you are not the intended recipient, please delete the original message and any copy of it from your computer system. You are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited unless proper authorization has been obtained for such action. If you have received this communication in error, please notify the sender immediately. Although IndiQus attempts to sweep e-mail and attachments for viruses, it does not guarantee that both are virus-free and accepts no liability for any damage sustained as a result of viruses.