Hi, We've been playing with relayd recently - both from 4.5 and the latest snapshot.
Approximately every hour we are seeing one or two state changes logged. But I can't see reason for the change of state and there doesn't appear to be a pattern in the way that the hosts are failed. According to `relayctl sh su` we have around 30 redirects and 60 hosts. All of the check modes are TCP. The only other significant options are: timeout 1000 log updates An example of the state changes we are seeing: May 20 13:27:37 sysbuild-obsd45 relayd[30524]: host xxx.xxx.xxx.157, check tcp (10ms), state up -> down, availability 89.17% May 20 13:27:47 sysbuild-obsd45 relayd[17005]: table lb_ev5_https: 0 added, 1 deleted, 0 changed, 0 killed May 20 13:27:47 sysbuild-obsd45 relayd[30524]: host xxx.xxx.xxx.157, check tcp (23ms), state down -> up, availability 89.18% May 20 13:27:57 sysbuild-obsd45 relayd[17005]: table lb_ev5_https: 1 added, 0 deleted, 0 changed, 0 killed Obviously the host wasn't failed because the check exceeded the timeout period. Does that mean that the TCP socket returned as closed/RST within 10ms? A tcpdump of traffic from the relayd host doesn't reveal anything particularly unusual. Except that no check was attempted at 13:27:37. Would this have been skipped due to an offending check at 13:27:27? 13:26:57.051947 xxx.xxx.xxx.103.36021 > xxx.xxx.xxx.157.443: S 4024993942:4024993942(0) win 16384 <mss 1460,nop,nop,sackOK,nop,wscale 0,nop,nop,timestamp 3310083888 0> (DF) 13:26:57.052612 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.36021: S 1781097887:1781097887(0) ack 4024993943 win 5792 <mss 1460,sackOK,timestamp 1848303010 3310083888,nop,wscale 2> (DF) 13:26:57.052689 xxx.xxx.xxx.103.36021 > xxx.xxx.xxx.157.443: . ack 1 win 16384 <nop,nop,timestamp 3310083888 1848303010> (DF) 13:26:57.060215 xxx.xxx.xxx.103.36021 > xxx.xxx.xxx.157.443: F 1:1(0) ack 1 win 16384 <nop,nop,timestamp 3310083888 1848303010> (DF) 13:26:57.060920 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.36021: F 1:1(0) ack 2 win 1448 <nop,nop,timestamp 1848303012 3310083888> (DF) 13:26:57.062337 xxx.xxx.xxx.103.36021 > xxx.xxx.xxx.157.443: . ack 2 win 16384 <nop,nop,timestamp 3310083888 1848303012> (DF) 13:27:07.082681 xxx.xxx.xxx.103.1746 > xxx.xxx.xxx.157.443: S 3987093519:3987093519(0) win 16384 <mss 1460,nop,nop,sackOK,nop,wscale 0,nop,nop,timestamp 3472130146 0> (DF) 13:27:07.083370 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.1746: S 1795324639:1795324639(0) ack 3987093520 win 5792 <mss 1460,sackOK,timestamp 1848305518 3472130146,nop,wscale 2> (DF) 13:27:07.083496 xxx.xxx.xxx.103.1746 > xxx.xxx.xxx.157.443: . ack 1 win 16384 <nop,nop,timestamp 3472130146 1848305518> (DF) 13:27:07.091940 xxx.xxx.xxx.103.1746 > xxx.xxx.xxx.157.443: F 1:1(0) ack 1 win 16384 <nop,nop,timestamp 3472130146 1848305518> (DF) 13:27:07.092726 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.1746: F 1:1(0) ack 2 win 1448 <nop,nop,timestamp 1848305520 3472130146> (DF) 13:27:07.093700 xxx.xxx.xxx.103.1746 > xxx.xxx.xxx.157.443: . ack 2 win 16384 <nop,nop,timestamp 3472130146 1848305520> (DF) 13:27:17.099730 xxx.xxx.xxx.103.17697 > xxx.xxx.xxx.157.443: S 913231965:913231965(0) win 16384 <mss 1460,nop,nop,sackOK,nop,wscale 0,nop,nop,timestamp 1801123610 0> (DF) 13:27:17.100270 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.17697: S 1801344162:1801344162(0) ack 913231966 win 5792 <mss 1460,sackOK,timestamp 1848308022 1801123610,nop,wscale 2> (DF) 13:27:17.100387 xxx.xxx.xxx.103.17697 > xxx.xxx.xxx.157.443: . ack 1 win 16384 <nop,nop,timestamp 1801123610 1848308022> (DF) 13:27:17.110345 xxx.xxx.xxx.103.17697 > xxx.xxx.xxx.157.443: F 1:1(0) ack 1 win 16384 <nop,nop,timestamp 1801123610 1848308022> (DF) 13:27:17.111156 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.17697: F 1:1(0) ack 2 win 1448 <nop,nop,timestamp 1848308025 1801123610> (DF) 13:27:17.111464 xxx.xxx.xxx.103.17697 > xxx.xxx.xxx.157.443: . ack 2 win 16384 <nop,nop,timestamp 1801123610 1848308025> (DF) 13:27:27.130132 xxx.xxx.xxx.103.44072 > xxx.xxx.xxx.157.443: S 2602652962:2602652962(0) win 16384 <mss 1460,nop,nop,sackOK,nop,wscale 0,nop,nop,timestamp 490198935 0> (DF) 13:27:27.130771 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.44072: S 1805757957:1805757957(0) ack 2602652963 win 5792 <mss 1460,sackOK,timestamp 1848310530 490198935,nop,wscale 2> (DF) 13:27:27.130841 xxx.xxx.xxx.103.44072 > xxx.xxx.xxx.157.443: . ack 1 win 16384 <nop,nop,timestamp 490198935 1848310530> (DF) 13:27:27.140176 xxx.xxx.xxx.103.44072 > xxx.xxx.xxx.157.443: F 1:1(0) ack 1 win 16384 <nop,nop,timestamp 490198935 1848310530> (DF) 13:27:27.141091 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.44072: F 1:1(0) ack 2 win 1448 <nop,nop,timestamp 1848310532 490198935> (DF) 13:27:27.141354 xxx.xxx.xxx.103.44072 > xxx.xxx.xxx.157.443: . ack 2 win 16384 <nop,nop,timestamp 490198935 1848310532> (DF) 13:27:47.180243 xxx.xxx.xxx.103.15780 > xxx.xxx.xxx.157.443: S 352869815:352869815(0) win 16384 <mss 1460,nop,nop,sackOK,nop,wscale 0,nop,nop,timestamp 1128451500 0> (DF) 13:27:47.180983 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.15780: S 1835720746:1835720746(0) ack 352869816 win 5792 <mss 1460,sackOK,timestamp 1848315542 1128451500,nop,wscale 2> (DF) 13:27:47.181064 xxx.xxx.xxx.103.15780 > xxx.xxx.xxx.157.443: . ack 1 win 16384 <nop,nop,timestamp 1128451500 1848315542> (DF) 13:27:47.190720 xxx.xxx.xxx.103.15780 > xxx.xxx.xxx.157.443: F 1:1(0) ack 1 win 16384 <nop,nop,timestamp 1128451500 1848315542> (DF) 13:27:47.191539 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.15780: . ack 2 win 1448 <nop,nop,timestamp 1848315545 1128451500> (DF) 13:27:47.191677 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.15780: F 1:1(0) ack 2 win 1448 <nop,nop,timestamp 1848315545 1128451500> (DF) 13:27:47.192419 xxx.xxx.xxx.103.15780 > xxx.xxx.xxx.157.443: . ack 2 win 16384 <nop,nop,timestamp 1128451500 1848315545> (DF) 13:27:57.206911 xxx.xxx.xxx.103.14295 > xxx.xxx.xxx.157.443: S 3538246269:3538246269(0) win 16384 <mss 1460,nop,nop,sackOK,nop,wscale 0,nop,nop,timestamp 1522145855 0> (DF) 13:27:57.207676 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.14295: S 1841244545:1841244545(0) ack 3538246270 win 5792 <mss 1460,sackOK,timestamp 1848318049 1522145855,nop,wscale 2> (DF) 13:27:57.207793 xxx.xxx.xxx.103.14295 > xxx.xxx.xxx.157.443: . ack 1 win 16384 <nop,nop,timestamp 1522145855 1848318049> (DF) 13:27:57.218664 xxx.xxx.xxx.103.14295 > xxx.xxx.xxx.157.443: F 1:1(0) ack 1 win 16384 <nop,nop,timestamp 1522145855 1848318049> (DF) 13:27:57.219468 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.14295: F 1:1(0) ack 2 win 1448 <nop,nop,timestamp 1848318052 1522145855> (DF) 13:27:57.219739 xxx.xxx.xxx.103.14295 > xxx.xxx.xxx.157.443: . ack 2 win 16384 <nop,nop,timestamp 1522145855 1848318052> (DF) 13:28:07.226086 xxx.xxx.xxx.103.8496 > xxx.xxx.xxx.157.443: S 3686084883:3686084883(0) win 16384 <mss 1460,nop,nop,sackOK,nop,wscale 0,nop,nop,timestamp 461343923 0> (DF) 13:28:07.226674 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.8496: S 1854050794:1854050794(0) ack 3686084884 win 5792 <mss 1460,sackOK,timestamp 1848320553 461343923,nop,wscale 2> (DF) 13:28:07.226777 xxx.xxx.xxx.103.8496 > xxx.xxx.xxx.157.443: . ack 1 win 16384 <nop,nop,timestamp 461343923 1848320553> (DF) 13:28:07.237413 xxx.xxx.xxx.103.8496 > xxx.xxx.xxx.157.443: F 1:1(0) ack 1 win 16384 <nop,nop,timestamp 461343923 1848320553> (DF) 13:28:07.238273 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.8496: . ack 2 win 1448 <nop,nop,timestamp 1848320556 461343923> (DF) 13:28:07.238385 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.8496: F 1:1(0) ack 2 win 1448 <nop,nop,timestamp 1848320556 461343923> (DF) 13:28:07.238671 xxx.xxx.xxx.103.8496 > xxx.xxx.xxx.157.443: . ack 2 win 16384 <nop,nop,timestamp 461343923 1848320556> (DF) 13:28:17.254854 xxx.xxx.xxx.103.41233 > xxx.xxx.xxx.157.443: S 3915914431:3915914431(0) win 16384 <mss 1460,nop,nop,sackOK,nop,wscale 0,nop,nop,timestamp 2586596977 0> (DF) 13:28:17.255411 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.41233: S 1866315326:1866315326(0) ack 3915914432 win 5792 <mss 1460,sackOK,timestamp 1848323060 2586596977,nop,wscale 2> (DF) 13:28:17.255492 xxx.xxx.xxx.103.41233 > xxx.xxx.xxx.157.443: . ack 1 win 16384 <nop,nop,timestamp 2586596977 1848323060> (DF) 13:28:17.265841 xxx.xxx.xxx.103.41233 > xxx.xxx.xxx.157.443: F 1:1(0) ack 1 win 16384 <nop,nop,timestamp 2586596977 1848323060> (DF) 13:28:17.266490 xxx.xxx.xxx.157.443 > xxx.xxx.xxx.103.41233: F 1:1(0) ack 2 win 1448 <nop,nop,timestamp 1848323063 2586596977> (DF) 13:28:17.266667 xxx.xxx.xxx.103.41233 > xxx.xxx.xxx.157.443: . ack 2 win 16384 <nop,nop,timestamp 2586596977 1848323063> (DF) Thanks in advance, Dan
