Hi,
i am running into problems within my new setup - and i currently don't know
where to look for to debug this.
Environment:
Newly installed
CS 4.15.2
Ubuntu 20.04 + KVM
1x Management Server + 1 Host
Deploying Advanced Networking Zone
Up to this point everything is running fine. Didn't found errors in the log
files.
However: When enabling the zone the SSVM and CSVM are changeing to started
but never reach "running".
Taking a look into the agent.log i stumbled upon this ("..." = repetion of
entries):
2021-09-24 01:01:55,311 INFO [utils.nio.NioClient] (main:null) (logid:)
SSL: Handshake done
2021-09-24 01:01:55,311 INFO [utils.nio.NioClient] (main:null) (logid:)
Connected to 172.17.1.2:8250
2021-09-24 01:01:55,373 INFO [kvm.storage.LibvirtStorageAdaptor]
(Agent-Handler-1:null) (logid:) Attempting to create storage pool
8362564e-11fd-4dd8-bae1-f90d53e52dab (Filesystem) in libvirt
2021-09-24 01:01:55,379 ERROR [kvm.resource.LibvirtConnection]
(Agent-Handler-1:null) (logid:) Connection with libvirtd is broken: invalid
connection pointer in virConnectGetVersion
2021-09-24 01:01:55,381 WARN [kvm.storage.LibvirtStorageAdaptor]
(Agent-Handler-1:null) (logid:) Storage pool
8362564e-11fd-4dd8-bae1-f90d53e52dab was not found running in libvirt. Need
to create it.
2021-09-24 01:01:55,381 INFO [kvm.storage.LibvirtStorageAdaptor]
(Agent-Handler-1:null) (logid:) Didn't find an existing storage pool
8362564e-11fd-4dd8-bae1-f90d53e52dab by UUID, checking for pools with
duplicate paths
2021-09-24 01:01:55,383 INFO [kvm.storage.LibvirtStorageAdaptor]
(Agent-Handler-1:null) (logid:) Trying to fetch storage pool
8362564e-11fd-4dd8-bae1-f90d53e52dab from libvirt
2021-09-24 01:01:55,424 INFO [cloud.serializer.GsonHelper]
(Agent-Handler-1:null) (logid:) Default Builder inited.
2021-09-24 01:01:55,470 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
(logid:) Proccess agent startup answer, agent id = 0
2021-09-24 01:01:55,471 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
(logid:) Set agent id 0
2021-09-24 01:01:55,476 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
(logid:) Startup Response Received: agent id = 0
2021-09-24 01:01:55,701 INFO [cloud.agent.Agent]
(agentRequest-Handler-3:null) (logid:9e52178e) Processing agent ready
command, agent id = 1
2021-09-24 01:01:55,702 INFO [cloud.agent.Agent]
(agentRequest-Handler-3:null) (logid:9e52178e) Set agent id 1
2021-09-24 01:01:55,707 INFO [cloud.agent.Agent]
(agentRequest-Handler-3:null) (logid:9e52178e) Ready command is processed
for agent id = 1
2021-09-24 01:01:55,807 INFO [cloud.agent.Agent]
(agentRequest-Handler-4:null) (logid:9e52178e) Processing agent ready
command, agent id = 1
2021-09-24 01:01:55,807 INFO [cloud.agent.Agent]
(agentRequest-Handler-4:null) (logid:9e52178e) Set agent id 1
2021-09-24 01:01:55,808 INFO [cloud.agent.Agent]
(agentRequest-Handler-4:null) (logid:9e52178e) Processed new management
server list: 172.17.1.2@static
2021-09-24 01:01:55,809 INFO [cloud.agent.Agent]
(agentRequest-Handler-4:null) (logid:9e52178e) Ready command is processed
for agent id = 1
2021-09-24 01:02:24,490 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:b81c6af6) Attempting to create storage
pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b (NetworkFilesystem) in libvirt
2021-09-24 01:02:24,510 WARN [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:b81c6af6) Storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b was not found running in libvirt. Need
to create it.
2021-09-24 01:02:24,510 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:b81c6af6) Didn't find an existing
storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b by UUID, checking for
pools with duplicate paths
2021-09-24 01:02:24,708 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:b81c6af6) Trying to fetch storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:02:40,975 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-3:null) (logid:74acba6b) Trying to fetch storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:02:41,001 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-3:null) (logid:74acba6b) Asking libvirt to refresh
storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
...
2021-09-24 01:08:41,382 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-1:null) (logid:94789a51) Trying to fetch storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:08:41,405 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-1:null) (logid:94789a51) Asking libvirt to refresh
storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
2021-09-24 01:08:52,046 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Attempting to create storage
pool a93ac95f-6a93-30b3-b4ee-822203da20bb (NetworkFilesystem) in libvirt
2021-09-24 01:08:52,066 WARN [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Storage pool
a93ac95f-6a93-30b3-b4ee-822203da20bb was not found running in libvirt. Need
to create it.
2021-09-24 01:08:52,066 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Didn't find an existing
storage pool a93ac95f-6a93-30b3-b4ee-822203da20bb by UUID, checking for
pools with duplicate paths
2021-09-24 01:08:52,192 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage pool
a93ac95f-6a93-30b3-b4ee-822203da20bb from libvirt
2021-09-24 01:08:52,212 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:08:52,218 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:08:52,223 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Attempting to create volume
3bf5af85-ca39-4e92-9149-1d7107983af0 (NetworkFilesystem) in pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b with size (2.44 GB) 2621440000
2021-09-24 01:09:41,425 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-3:null) (logid:0b231655) Trying to fetch storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:09:41,449 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-3:null) (logid:0b231655) Asking libvirt to refresh
storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
...
2021-09-24 02:08:47,897 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-1:null) (logid:95f136df) Trying to fetch storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 02:08:47,921 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-1:null) (logid:95f136df) Asking libvirt to refresh
storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
2021-09-24 02:08:52,245 WARN [utils.script.Script] (Script-8:null)
(logid:) Interrupting script.
2021-09-24 02:08:52,247 WARN [utils.script.Script]
(agentRequest-Handler-5:null) (logid:3da47ae9) Timed out: qemu-img info
/mnt/a93ac95f-6a93-30b3-b4ee-822203da20bb/3bf5af85-ca39-4e92-9149-1d7107983af0.qcow2
. Output is:
2021-09-24 02:08:52,248 ERROR [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Failed to fetch the
information of file
/mnt/a93ac95f-6a93-30b3-b4ee-822203da20bb/3bf5af85-ca39-4e92-9149-1d7107983af0.qcow2
the error was: timeout
So currently i am a bit stunned as i don't really know on how to move on
from this point as everything else seems running / accessable.
Thanks in advance!
