Hello all,
Have a perplexing problem with the console function. I can launch consoles
without any issue but after about 10 seconds or so the console will freeze and
then disconnect shortly thereafter. I can relaunch the console and the same
event occurs. Any help to point me in the direction of resolving this is
appreciated.
Some detail:
CS 16.0
Management and Agent Firewalls are disabled
Can ping the public IP’s assigned to consoles and when console is up I can ping
back to my browsers address
Same symptoms on multiple browser types
Have disabled novnc and have same results
A snippet of the management logs:
2021-12-09 17:54:41,027 DEBUG [c.c.s.ConsoleProxyServlet]
(qtp2063763486-338:null) (logid:) Port info 192.168.110.129
2021-12-09 17:54:41,027 INFO [c.c.s.ConsoleProxyServlet]
(qtp2063763486-338:null) (logid:) Parse host info returned from executing
GetVNCPortCommand. host info: 192.168.110.129
2021-12-09 17:54:41,034 DEBUG [c.c.s.ConsoleProxyServlet]
(qtp2063763486-338:null) (logid:) Compose console url:
//172.16.1.2/resource/noVNC/vnc.html?autoconnect=true&port=8080&token=Tg19XlwRmIvDMUgrhjPASFEyJFK8tbCF734GWBjpgssBdqsn1JcBKJe0WfGj9A6Bc8FlCmC5zRf9KcAc9HmC_RnqOjtVgonVYlzAQ0pbBojSLHKKwwv68yXyXyj53CMYxBp75-sY5CZI7VsjEI3oweJyr8Soig4KXfzaVvktLh4orgL44QoR2m_KTElhkt_APmazCoMAFK82Sm3QRrQM9xIDJ5wndoAnBe7d_-qdYa-6EnYMiGp2bAB1GYMF88Wqlm0o98dPstgdNQzZTXEvt_bvKH0lXdRD8VYs-Z8TH1uimKbL_bnjUXuJHm15hdZm
2021-12-09 17:54:41,034 DEBUG [c.c.s.ConsoleProxyServlet]
(qtp2063763486-338:null) (logid:) the console url is ::
<html><title>v-1-VM</title><frameset><frame
src="//172.16.1.2/resource/noVNC/vnc.html?autoconnect=true&port=8080&token=Tg19XlwRmIvDMUgrhjPASFEyJFK8tbCF734GWBjpgssBdqsn1JcBKJe0WfGj9A6Bc8FlCmC5zRf9KcAc9HmC_RnqOjtVgonVYlzAQ0pbBojSLHKKwwv68yXyXyj53CMYxBp75-sY5CZI7VsjEI3oweJyr8Soig4KXfzaVvktLh4orgL44QoR2m_KTElhkt_APmazCoMAFK82Sm3QRrQM9xIDJ5wndoAnBe7d_-qdYa-6EnYMiGp2bAB1GYMF88Wqlm0o98dPstgdNQzZTXEvt_bvKH0lXdRD8VYs-Z8TH1uimKbL_bnjUXuJHm15hdZm"></frame></frameset></html>
2021-12-09 17:54:41,192 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-9:null) (logid:) SeqA 2-610: Processing Seq 2-610: { Cmd
, MgmtId: -1, via: 2, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleAccessAuthenticationCommand":{"_host":"192.168.110.129","_port":"5900","_vmId":"90037422-3b2e-4d72-bbb9-b55c7621c137","_sid":"6DSI5KehKwLK-4MoVd_LWA","_ticket":"dvOoDSrKGm7MjZjKtyw8r/QynSI=","_isReauthenticating":"false","wait":"0","bypassHostMaintenance":"false"}}]
}
2021-12-09 17:54:41,192 DEBUG [c.c.c.AgentHookBase]
(AgentManager-Handler-9:null) (logid:) Console authentication. Ticket in url
for 192.168.110.129:5900-90037422-3b2e-4d72-bbb9-b55c7621c137 is
dvOoDSrKGm7MjZjKtyw8r/QynSI=
2021-12-09 17:54:41,193 DEBUG [c.c.c.AgentHookBase]
(AgentManager-Handler-9:null) (logid:) Console authentication. Ticket in 1
minute boundary for 192.168.110.129:5900-90037422-3b2e-4d72-bbb9-b55c7621c137
is dvOoDSrKGm7MjZjKtyw8r/QynSI=
2021-12-09 17:54:41,199 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-9:null) (logid:) SeqA 2-610: Sending Seq 2-610: { Ans: ,
MgmtId: 3232263808, via: 2, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.ConsoleAccessAuthenticationAnswer":{"_success":"true","_isReauthenticating":"false","_port":"0","result":"true","wait":"0","bypassHostMaintenance":"false"}}]
}
2021-12-09 17:54:41,205 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-11:null) (logid:) SeqA 2-611: Processing Seq 2-611: {
Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"1","_loadInfo":"{
"connections": [
{
"id": 11,
"clientInfo": "",
"host": "192.168.110.129",
"port": 5900,
"tag": "90037422-3b2e-4d72-bbb9-b55c7621c137",
"createTime": 1639090481205,
"lastUsedTime": 1639090481205
}
]
}","wait":"0","bypassHostMaintenance":"false"}}] }
2021-12-09 17:54:41,234 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-11:null) (logid:) SeqA 2-611: Sending Seq 2-611: { Ans:
, MgmtId: 3232263808, via: 2, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":"true","wait":"0","bypassHostMaintenance":"false"}}]
}
2021-12-09 17:54:42,347 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-6:ctx-a3c35eda) (logid:b26972af) HA health check
task is running...
2021-12-09 17:54:43,004 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-10:null) (logid:) Ping from 3(s-2-VM)
2021-12-09 17:54:43,072 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-12:null) (logid:) Ping from Routing host
1(agent01.cloudnet.xcubia.com)
2021-12-09 17:54:43,072 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(AgentManager-Handler-12:null) (logid:) Process host VM state report from ping
process. host: 1
2021-12-09 17:54:43,081 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(AgentManager-Handler-12:null) (logid:) Process VM state report. host: 1,
number of records in report: 3
2021-12-09 17:54:43,081 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(AgentManager-Handler-12:null) (logid:) VM state report. host: 1, vm id: 1,
power state: PowerOn
2021-12-09 17:54:43,084 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(AgentManager-Handler-12:null) (logid:) VM state report. host: 1, vm id: 2,
power state: PowerOn
2021-12-09 17:54:43,087 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(AgentManager-Handler-12:null) (logid:) VM state report. host: 1, vm id: 12,
power state: PowerOn
2021-12-09 17:54:43,095 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(AgentManager-Handler-12:null) (logid:) Done with process of VM state report.
host: 1
2021-12-09 17:54:43,351 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-13:null) (logid:) Ping from 2(v-1-VM)
2021-12-09 17:54:46,349 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-2:ctx-9a56fee7) (logid:71776f63) HA health check
task is running...
2021-12-09 17:54:47,588 DEBUG [c.c.c.ConsoleProxyManagerImpl]
(consoleproxy-1:ctx-254f0d41) (logid:2311588e) Zone 1 is ready to launch
console proxy
2021-12-09 17:54:48,601 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-14:null) (logid:) SeqA 2-613: Processing Seq 2-613: {
Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"1","_loadInfo":"{
"connections": [
{
"id": 11,
"clientInfo": "",
"host": "192.168.110.129",
"port": 5900,
"tag": "90037422-3b2e-4d72-bbb9-b55c7621c137",
"createTime": 1639090481205,
"lastUsedTime": 1639090488358
}
]
}","wait":"0","bypassHostMaintenance":"false"}}] }
2021-12-09 17:54:48,628 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-14:null) (logid:) SeqA 2-613: Sending Seq 2-613: { Ans:
, MgmtId: 3232263808, via: 2, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":"true","wait":"0","bypassHostMaintenance":"false"}}]
}
2021-12-09 17:54:50,351 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-1:ctx-fdceb5fb) (logid:9dbb7012) HA health check
task is running...
2021-12-09 17:54:54,354 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-6:ctx-4b04df62) (logid:cfc5f8f7) HA health check
task is running...
2021-12-09 17:54:54,400 DEBUG [c.c.s.StatsCollector]
(StatsCollector-5:ctx-f0b2b4e2) (logid:89f692be) AutoScaling Monitor is
running...
2021-12-09 17:54:55,969 DEBUG [c.c.s.StatsCollector]
(StatsCollector-6:ctx-b236dec5) (logid:61902e82) HostStatsCollector is
running...
2021-12-09 17:54:55,987 DEBUG [c.c.a.t.Request] (StatsCollector-6:ctx-b236dec5)
(logid:61902e82) Seq 1-3022478299919024344: Received: { Ans: , MgmtId:
3232263808, via: 1(agent01.cloudnet.xcubia.com), Ver: v1, Flags: 10, {
GetHostStatsAnswer } }
2021-12-09 17:54:57,366 DEBUG [c.c.s.StatsCollector]
(secstorage-1:ctx-d11d067b) (logid:5e563268) Verifying image storage [1].
Capacity: total=[1 TB], used=[32 GB], threshold=[89.99999761581421%].
2021-12-09 17:54:57,376 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-d11d067b) (logid:5e563268) Zone [1] is ready to launch
secondary storage VM.
2021-12-09 17:54:58,356 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-2:ctx-ed45c8ea) (logid:75bea433) HA health check
task is running...
2021-12-09 17:54:58,602 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-1:null) (logid:) SeqA 2-614: Processing Seq 2-614: { Cmd
, MgmtId: -1, via: 2, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"1","_loadInfo":"{
"connections": [
{
"id": 11,
"clientInfo": "",
"host": "192.168.110.129",
"port": 5900,
"tag": "90037422-3b2e-4d72-bbb9-b55c7621c137",
"createTime": 1639090481205,
"lastUsedTime": 1639090498242
}
]
}","wait":"0","bypassHostMaintenance":"false"}}] }
2021-12-09 17:54:58,624 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-1:null) (logid:) SeqA 2-614: Sending Seq 2-614: { Ans: ,
MgmtId: 3232263808, via: 2, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":"true","wait":"0","bypassHostMaintenance":"false"}}]
}
2021-12-09 17:54:58,808 DEBUG [c.c.a.t.Request] (StatsCollector-4:ctx-7cb1fc88)
(logid:c97ff379) Seq 1-3022478299919024345: Received: { Ans: , MgmtId:
3232263808, via: 1(agent01.cloudnet.xcubia.com), Ver: v1, Flags: 10, {
GetVmStatsAnswer } }
2021-12-09 17:54:58,814 DEBUG [c.c.s.StatsCollector]
(StatsCollector-4:ctx-7cb1fc88) (logid:c97ff379) Increment saved values of
NetworkReadKBs, NetworkWriteKBs, DiskWriteKBs, DiskReadKBs, DiskReadIOs,
DiskWriteIOs, with current metrics for VM with ID [12]. To change this process,
check value of 'vm.stats.increment.metrics.in.memory' configuration.
2021-12-09 17:55:02,358 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-1:ctx-657b9b7a) (logid:17fdb3ed) HA health check
task is running...
2021-12-09 17:55:06,360 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-6:ctx-6c836e44) (logid:57ad74c6) HA health check
task is running...
2021-12-09 17:55:07,588 DEBUG [c.c.c.ConsoleProxyManagerImpl]
(consoleproxy-1:ctx-1fa6de95) (logid:b26da7c5) Zone 1 is ready to launch
console proxy
2021-12-09 17:55:08,644 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-4:null) (logid:) SeqA 2-615: Processing Seq 2-615: { Cmd
, MgmtId: -1, via: 2, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"1","_loadInfo":"{
"connections": [
{
"id": 11,
"clientInfo": "",
"host": "192.168.110.129",
"port": 5900,
"tag": "90037422-3b2e-4d72-bbb9-b55c7621c137",
"createTime": 1639090481205,
"lastUsedTime": 1639090508523
}
]
}","wait":"0","bypassHostMaintenance":"false"}}] }
2021-12-09 17:55:08,660 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-4:null) (logid:) SeqA 2-615: Sending Seq 2-615: { Ans: ,
MgmtId: 3232263808, via: 2, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":"true","wait":"0","bypassHostMaintenance":"false"}}]
}
2021-12-09 17:55:09,200 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-976edb91) (logid:d4cde46a) Found 0 routers to update
status.
2021-12-09 17:55:09,202 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-976edb91) (logid:d4cde46a) Found 0 VPC's to update
Redundant State.
2021-12-09 17:55:09,204 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-976edb91) (logid:d4cde46a) Found 0 networks to
update RvR status.
2021-12-09 17:55:09,357 DEBUG [c.c.s.StatsCollector]
(StatsCollector-1:ctx-6b9088e7) (logid:38f0ec55) StorageCollector is running...
2021-12-09 17:55:09,371 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru]
(StatsCollector-1:ctx-6b9088e7) (logid:38f0ec55) getCommandHostDelegation:
class com.cloud.agent.api.GetStorageStatsCommand
2021-12-09 17:55:09,371 DEBUG [c.c.h.XenServerGuru]
(StatsCollector-1:ctx-6b9088e7) (logid:38f0ec55) We are returning the default
host to execute commands because the command is not of Copy type.
2021-12-09 17:55:09,413 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-6b9088e7)
(logid:38f0ec55) Seq 3-7587720947189153900: Received: { Ans: , MgmtId:
3232263808, via: 3(s-2-VM), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
2021-12-09 17:55:09,417 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru]
(StatsCollector-1:ctx-6b9088e7) (logid:38f0ec55) getCommandHostDelegation:
class com.cloud.agent.api.GetStorageStatsCommand
2021-12-09 17:55:09,417 DEBUG [c.c.h.XenServerGuru]
(StatsCollector-1:ctx-6b9088e7) (logid:38f0ec55) We are returning the default
host to execute commands because the command is not of Copy type.
2021-12-09 17:55:09,503 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-6b9088e7)
(logid:38f0ec55) Seq 1-3022478299919024346: Received: { Ans: , MgmtId:
3232263808, via: 1(agent01.cloudnet.xcubia.com), Ver: v1, Flags: 10, {
GetStorageStatsAnswer } }
2021-12-09 17:55:10,362 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-2:ctx-ff98ad7d) (logid:1228f005) HA health check
task is running...
2021-12-09 17:55:13,605 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-5:null) (logid:) SeqA 2-616: Processing Seq 2-616: { Cmd
, MgmtId: -1, via: 2, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"1","_loadInfo":"{
"connections": [
{
"id": 11,
"clientInfo": "",
"host": "192.168.110.129",
"port": 5900,
"tag": "90037422-3b2e-4d72-bbb9-b55c7621c137",
"createTime": 1639090481205,
"lastUsedTime": 1639090513440
}
]
}","wait":"0","bypassHostMaintenance":"false"}}] }
2021-12-09 17:55:13,631 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-5:null) (logid:) SeqA 2-616: Sending Seq 2-616: { Ans: ,
MgmtId: 3232263808, via: 2, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":"true","wait":"0","bypassHostMaintenance":"false"}}]
}
2021-12-09 17:55:14,262 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
Timer:ctx-8022b3fe) (logid:5ff33f53) Resetting hosts suitable for reconnect
2021-12-09 17:55:14,264 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
Timer:ctx-8022b3fe) (logid:5ff33f53) Completed resetting hosts suitable for
reconnect
2021-12-09 17:55:14,264 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
Timer:ctx-8022b3fe) (logid:5ff33f53) Acquiring hosts for clusters already owned
by this management server
2021-12-09 17:55:14,265 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
Timer:ctx-8022b3fe) (logid:5ff33f53) Completed acquiring hosts for clusters
already owned by this management server
2021-12-09 17:55:14,265 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
Timer:ctx-8022b3fe) (logid:5ff33f53) Acquiring hosts for clusters not owned by
any management server
2021-12-09 17:55:14,266 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
Timer:ctx-8022b3fe) (logid:5ff33f53) Completed acquiring hosts for clusters not
owned by any management server
2021-12-09 17:55:14,364 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-1:ctx-ccc5e9b9) (logid:30690ecc) HA health check
task is running...
2021-12-09 17:55:18,366 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-6:ctx-2f2961a4) (logid:2472ea42) HA health check
task is running...
2021-12-09 17:55:22,368 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-2:ctx-59825fcd) (logid:a500cb09) HA health check
task is running...
2021-12-09 17:55:23,604 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-6:null) (logid:) SeqA 2-617: Processing Seq 2-617: { Cmd
, MgmtId: -1, via: 2, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"1","_loadInfo":"{
"connections": [
{
"id": 11,
"clientInfo": "",
"host": "192.168.110.129",
"port": 5900,
"tag": "90037422-3b2e-4d72-bbb9-b55c7621c137",
"createTime": 1639090481205,
"lastUsedTime": 1639090514781
}
]
}","wait":"0","bypassHostMaintenance":"false"}}] }
2021-12-09 17:55:23,628 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-6:null) (logid:) SeqA 2-617: Sending Seq 2-617: { Ans: ,
MgmtId: 3232263808, via: 2, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":"true","wait":"0","bypassHostMaintenance":"false"}}]
}
2021-12-09 17:55:26,369 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-1:ctx-05f6b51f) (logid:80eaf354) HA health check
task is running...
2021-12-09 17:55:27,366 DEBUG [c.c.s.StatsCollector]
(secstorage-1:ctx-a7ca22c7) (logid:427a9ce8) Verifying image storage [1].
Capacity: total=[1 TB], used=[32 GB], threshold=[89.99999761581421%].
2021-12-09 17:55:27,376 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-a7ca22c7) (logid:427a9ce8) Zone [1] is ready to launch
secondary storage VM.
2021-12-09 17:55:27,588 DEBUG [c.c.c.ConsoleProxyManagerImpl]
(consoleproxy-1:ctx-51b80f4f) (logid:5412c787) Zone 1 is ready to launch
console proxy
2021-12-09 17:55:30,371 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-6:ctx-882c28a5) (logid:93fc84d5) HA health check
task is running...
2021-12-09 17:55:33,646 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-8:null) (logid:) SeqA 2-618: Processing Seq 2-618: { Cmd
, MgmtId: -1, via: 2, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"1","_loadInfo":"{
"connections": [
{
"id": 11,
"clientInfo": "",
"host": "192.168.110.129",
"port": 5900,
"tag": "90037422-3b2e-4d72-bbb9-b55c7621c137",
"createTime": 1639090481205,
"lastUsedTime": 1639090514781
}
]
}","wait":"0","bypassHostMaintenance":"false"}}] }
2021-12-09 17:55:33,673 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-8:null) (logid:) SeqA 2-618: Sending Seq 2-618: { Ans: ,
MgmtId: 3232263808, via: 2, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":"true","wait":"0","bypassHostMaintenance":"false"}}]
}
2021-12-09 17:55:34,373 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-2:ctx-385e5811) (logid:bcff320b) HA health check
task is running...
2021-12-09 17:55:38,376 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-1:ctx-46466343) (logid:1159a005) HA health check
task is running...
2021-12-09 17:55:39,195 DEBUG [c.c.n.ExternalDeviceUsageManagerImpl]
(ExternalNetworkMonitor-1:ctx-926a4ebe) (logid:104c38f5) External devices are
not used. Skipping external device usage collection
2021-12-09 17:55:39,198 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterMonitor-1:ctx-dd790c5e) (logid:aba1fd3a) Found 0 running routers.
2021-12-09 17:55:39,200 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-71c7b36b) (logid:6b93d6cf) Found 0 routers to update
status.
2021-12-09 17:55:39,202 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-71c7b36b) (logid:6b93d6cf) Found 0 VPC's to update
Redundant State.
2021-12-09 17:55:39,204 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-71c7b36b) (logid:6b93d6cf) Found 0 networks to
update RvR status.
2021-12-09 17:55:39,238 DEBUG [o.a.c.b.BackupManagerImpl]
(BackupPollTask:ctx-fa9c931e) (logid:51b33a12) Backup backup.poll is being
called at 2021-12-09 22:55:39 GMT
2021-12-09 17:55:39,265 INFO [c.c.r.ResourceLimitManagerImpl]
(ResourceCountChecker-1:ctx-45b0ae86) (logid:74289c0b) Started resource
counters recalculation periodic task.
2021-12-09 17:55:39,532 DEBUG [c.c.s.s.SnapshotSchedulerImpl]
(SnapshotPollTask:ctx-ffde82d9) (logid:eb11d30b) Snapshot scheduler.poll is
being called at 2021-12-09 22:55:39 GMT
2021-12-09 17:55:39,534 DEBUG [c.c.s.s.SnapshotSchedulerImpl]
(SnapshotPollTask:ctx-ffde82d9) (logid:eb11d30b) Got 0 snapshots to be executed
at 2021-12-09 22:55:39 GMT
2021-12-09 17:55:42,378 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-6:ctx-48ad1879) (logid:e372f283) HA health check
task is running...
2021-12-09 17:55:43,004 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-9:null) (logid:) Ping from 3(s-2-VM)
2021-12-09 17:55:43,069 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-11:null) (logid:) Ping from Routing host
1(agent01.cloudnet.xcubia.com)
2021-12-09 17:55:43,070 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(AgentManager-Handler-11:null) (logid:) Process host VM state report from ping
process. host: 1
2021-12-09 17:55:43,080 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(AgentManager-Handler-11:null) (logid:) Process VM state report. host: 1,
number of records in report: 3
2021-12-09 17:55:43,080 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(AgentManager-Handler-11:null) (logid:) VM state report. host: 1, vm id: 1,
power state: PowerOn
2021-12-09 17:55:43,084 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(AgentManager-Handler-11:null) (logid:) VM state report. host: 1, vm id: 2,
power state: PowerOn
2021-12-09 17:55:43,088 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(AgentManager-Handler-11:null) (logid:) VM state report. host: 1, vm id: 12,
power state: PowerOn
2021-12-09 17:55:43,097 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(AgentManager-Handler-11:null) (logid:) Done with process of VM state report.
host: 1
2021-12-09 17:55:43,311 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-10:null) (logid:) Ping from 2(v-1-VM)
2021-12-09 17:55:43,605 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-12:null) (logid:) SeqA 2-620: Processing Seq 2-620: {
Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"1","_loadInfo":"{
"connections": [
{
"id": 11,
"clientInfo": "",
"host": "192.168.110.129",
"port": 5900,
"tag": "90037422-3b2e-4d72-bbb9-b55c7621c137",
"createTime": 1639090481205,
"lastUsedTime": 1639090514781
}
]
}","wait":"0","bypassHostMaintenance":"false"}}] }
2021-12-09 17:55:43,623 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-12:null) (logid:) SeqA 2-620: Sending Seq 2-620: { Ans:
, MgmtId: 3232263808, via: 2, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":"true","wait":"0","bypassHostMaintenance":"false"}}]
}
2021-12-09 17:55:44,456 DEBUG [o.a.c.b.BackupManagerImpl]
(BackgroundTaskPollManager-2:ctx-4f1e1aaf) (logid:3368886d) Backup Sync Task is
not enabled in zone [1]. Skipping this zone!
2021-12-09 17:55:46,380 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-5:ctx-4b373598) (logid:7edb21e3) HA health check
task is running...
2021-12-09 17:55:47,588 DEBUG [c.c.c.ConsoleProxyManagerImpl]
(consoleproxy-1:ctx-d8103d30) (logid:985e1590) Zone 1 is ready to launch
console proxy
2021-12-09 17:55:48,647 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-13:null) (logid:) SeqA 2-621: Processing Seq 2-621: {
Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"1","_loadInfo":"{
"connections": [
{
"id": 11,
"clientInfo": "",
"host": "192.168.110.129",
"port": 5900,
"tag": "90037422-3b2e-4d72-bbb9-b55c7621c137",
"createTime": 1639090481205,
"lastUsedTime": 1639090514781
}
]
}","wait":"0","bypassHostMaintenance":"false"}}] }
2021-12-09 17:55:48,680 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-13:null) (logid:) SeqA 2-621: Sending Seq 2-621: { Ans:
, MgmtId: 3232263808, via: 2, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":"true","wait":"0","bypassHostMaintenance":"false"}}]
}
2021-12-09 17:55:50,382 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-3:ctx-65fac840) (logid:24d3d025) HA health check
task is running...
2021-12-09 17:55:54,384 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-4:ctx-e2dd9fc3) (logid:fb712db0) HA health check
task is running...
2021-12-09 17:55:54,403 DEBUG [c.c.s.StatsCollector]
(StatsCollector-2:ctx-5f718f34) (logid:b416ce47) AutoScaling Monitor is
running...
2021-12-09 17:55:55,989 DEBUG [c.c.s.StatsCollector]
(StatsCollector-3:ctx-f9cc9d71) (logid:1128fcae) HostStatsCollector is
running...
2021-12-09 17:55:56,048 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-f9cc9d71)
(logid:1128fcae) Seq 1-3022478299919024347: Received: { Ans: , MgmtId:
3232263808, via: 1(agent01.cloudnet.xcubia.com), Ver: v1, Flags: 10, {
GetHostStatsAnswer } }
2021-12-09 17:55:57,367 DEBUG [c.c.s.StatsCollector]
(secstorage-1:ctx-17eb0755) (logid:21952022) Verifying image storage [1].
Capacity: total=[1 TB], used=[32 GB], threshold=[89.99999761581421%].
2021-12-09 17:55:57,377 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-17eb0755) (logid:21952022) Zone [1] is ready to launch
secondary storage VM.
2021-12-09 17:55:58,386 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-5:ctx-8471cca0) (logid:256fec1c) HA health check
task is running...
2021-12-09 17:55:58,607 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-15:null) (logid:) SeqA 2-622: Processing Seq 2-622: {
Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"1","_loadInfo":"{
"connections": [
{
"id": 11,
"clientInfo": "",
"host": "192.168.110.129",
"port": 5900,
"tag": "90037422-3b2e-4d72-bbb9-b55c7621c137",
"createTime": 1639090481205,
"lastUsedTime": 1639090514781
}
]
}","wait":"0","bypassHostMaintenance":"false"}}] }
2021-12-09 17:55:58,630 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-15:null) (logid:) SeqA 2-622: Sending Seq 2-622: { Ans:
, MgmtId: 3232263808, via: 2, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":"true","wait":"0","bypassHostMaintenance":"false"}}]
}
2021-12-09 17:55:58,906 DEBUG [c.c.a.t.Request] (StatsCollector-5:ctx-21801f27)
(logid:b85b204d) Seq 1-3022478299919024348: Received: { Ans: , MgmtId:
3232263808, via: 1(agent01.cloudnet.xcubia.com), Ver: v1, Flags: 10, {
GetVmStatsAnswer } }
2021-12-09 17:55:58,912 DEBUG [c.c.s.StatsCollector]
(StatsCollector-5:ctx-21801f27) (logid:b85b204d) Increment saved values of
NetworkReadKBs, NetworkWriteKBs, DiskWriteKBs, DiskReadKBs, DiskReadIOs,
DiskWriteIOs, with current metrics for VM with ID [12]. To change this process,
check value of 'vm.stats.increment.metrics.in.memory' configuration.
2021-12-09 17:56:02,388 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-3:ctx-8d3d3c8b) (logid:b9fadfa2) HA health check
task is running...
2021-12-09 17:56:06,390 DEBUG [o.a.c.h.HAManagerImpl]
(BackgroundTaskPollManager-4:ctx-459b78e3) (logid:799d653e) HA health check
task is running...
2021-12-09 17:56:07,589 DEBUG [c.c.c.ConsoleProxyManagerImpl]
(consoleproxy-1:ctx-12c8bb8e) (logid:91e82b26) Zone 1 is ready to launch
console proxy
2021-12-09 17:56:08,608 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-3:null) (logid:) SeqA 2-623: Processing Seq 2-623: { Cmd
, MgmtId: -1, via: 2, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":"1","_loadInfo":"{
"connections": [
{
"id": 11,
"clientInfo": "",
"host": "192.168.110.129",
"port": 5900,
"tag": "90037422-3b2e-4d72-bbb9-b55c7621c137",
"createTime": 1639090481205,
"lastUsedTime": 1639090514781
}
]
}","wait":"0","bypassHostMaintenance":"false"}}] }
2021-12-09 17:56:08,624 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-3:null) (logid:) SeqA 2-623: Sending Seq 2-623: { Ans: ,
MgmtId: 3232263808, via: 2, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":"true","wait":"0","bypassHostMaintenance":"false"}}]
}
Thanks,
Robert
