On 14/03/12 21:41, Camiel Dobbelaar wrote:
This is not from just after the reboot right? The "failed state
lookup/inserts" might be interesting just after the firewalls have
stabilized.
Hi,
After upgrading today to latest -current (i386)
(f1) OpenBSD 5.1-current (GENERIC.MP) #252: Tue Apr 24 15:58:54 MDT 2012
(f2) OpenBSD 5.1-current (GENERIC) #209: Tue Apr 24 15:50:09 MDT 2012
I still have the same problem.
When the primary firewall reboots, It becomes MASTER on the carp interfaces
before the pfsync bulk transfer ends:
(f1) # egrep 'pfsync|carp' /var/log/messages
Apr 27 12:10:36 f1 /bsd: carp: carp0 demoted group carp by 1 to 129
(carpdev)
Apr 27 12:10:36 f1 /bsd: carp: carp1 demoted group carp by 1 to 130
(carpdev)
Apr 27 12:10:36 f1 /bsd: carp: carp2 demoted group carp by 1 to 131
(carpdev)
Apr 27 12:10:36 f1 /bsd: carp: carp3 demoted group carp by 1 to 132
(carpdev)
Apr 27 12:10:36 f1 /bsd: carp: pfsync0 demoted group carp by 1 to 133
(pfsync bulk start)
Apr 27 12:10:36 f1 /bsd: carp: pfsync0 demoted group pfsync by 1 to 1
(pfsync bulk start)
Apr 27 12:10:36 f1 /bsd: carp: carp0 demoted group carp by -1 to 132
(carpdev)
Apr 27 12:10:36 f1 /bsd: carp: carp3 demoted group carp by -1 to 131
(carpdev)
Apr 27 12:10:36 f1 /bsd: carp: carp2 demoted group carp by -1 to 130
(carpdev)
Apr 27 12:10:36 f1 /bsd: carp: carp1 demoted group carp by -1 to 129
(carpdev)
Apr 27 12:10:36 f1 /bsd: carp: pfsync0 demoted group carp by -1 to 128
(pfsyncdev)
Apr 27 12:10:36 f1 /bsd: carp: pfsync0 demoted group pfsync by -1 to 0
(pfsyncdev)
Apr 27 12:10:38 f1 /bsd: carp0: state transition: BACKUP -> MASTER
Apr 27 12:10:38 f1 /bsd: carp3: state transition: BACKUP -> MASTER
Apr 27 12:10:38 f1 /bsd: carp2: state transition: BACKUP -> MASTER
Apr 27 12:10:39 f1 /bsd: carp1: state transition: BACKUP -> MASTER
Apr 27 12:10:47 f1 /bsd: carp0: state transition: MASTER -> BACKUP
Apr 27 12:10:47 f1 /bsd: carp3: state transition: MASTER -> BACKUP
Apr 27 12:10:47 f1 /bsd: carp2: state transition: MASTER -> BACKUP
Apr 27 12:10:47 f1 /bsd: carp1: state transition: MASTER -> BACKUP
Apr 27 12:10:48 f1 /bsd: carp0: state transition: BACKUP -> MASTER
Apr 27 12:10:48 f1 /bsd: carp3: state transition: BACKUP -> MASTER
Apr 27 12:10:48 f1 /bsd: carp2: state transition: BACKUP -> MASTER
Apr 27 12:10:48 f1 /bsd: carp1: state transition: BACKUP -> MASTER
Manually (f1) # ifconfig -g carp carpdemote
because states are lost by now...
Apr 27 12:11:11 f1 /bsd: carp1: state transition: MASTER -> BACKUP
Apr 27 12:11:11 f1 /bsd: carp0: state transition: MASTER -> BACKUP
Apr 27 12:11:11 f1 /bsd: carp2: state transition: MASTER -> BACKUP
Apr 27 12:11:11 f1 /bsd: carp3: state transition: MASTER -> BACKUP
Apr 27 12:12:48 f1 /bsd: carp: pfsync0 demoted group carp by -1 to 0
(pfsync bulk done)
Apr 27 12:12:48 f1 /bsd: carp: pfsync0 demoted group pfsync by -1 to 0
(pfsync bulk done)
Apr 27 12:12:49 f1 /bsd: carp0: state transition: BACKUP -> MASTER
Apr 27 12:12:49 f1 /bsd: carp1: state transition: BACKUP -> MASTER
Apr 27 12:12:49 f1 /bsd: carp2: state transition: BACKUP -> MASTER
Apr 27 12:12:49 f1 /bsd: carp3: state transition: BACKUP -> MASTER
If you see on logs (************************) if goes to 0 before pfsync
bulk is done...
A few minutes after initial sync is done.
(f1) # netstat -s
pfsync:
107036 packets received (IPv4)
0 packets received (IPv6)
0 packets discarded for bad interface
0 packets discarded for bad ttl
0 packets shorter than header
0 packets discarded for bad version
0 packets discarded for bad HMAC
0 packets discarded for bad action
0 packets discarded for short packet
0 states discarded for bad values
215 stale states
15413 failed state lookup/inserts
193432 packets sent (IPv4)
(f1) # netstat -in
Name Mtu Network Address Ipkts Ierrs Opkts
Oerrs Colls
lo0 33196 <Link> 27 0 27
0 0
lo0 33196 ::1/128 ::1 27 0 27
0 0
lo0 33196 fe80::%lo0/ fe80::1%lo0 27 0 27
0 0
lo0 33196 127/8 127.0.0.1 27 0 27
0 0
em0 1500 <Link> 00:1b:21:8c:41:96 2891709 325 2848710
0 0
em0 1500 fe80::%em0/ fe80::21b:21ff:fe 2891709 325 2848710
0 0
em1 1500 <Link> 00:1b:21:8c:41:97 2850994 0 2867906
0 0
em1 1500 fe80::%em1/ fe80::21b:21ff:fe 2850994 0 2867906
0 0
em2 1500 <Link> 00:19:99:98:e4:ea 107103 87 214880
0 0
em2 1500 10.1.3.1/30 10.1.3.1 107103 87 214880
0 0
em2 1500 fe80::%em2/ fe80::219:99ff:fe 107103 87 214880
0 0
(f2) # egrep 'pfsync|carp' /var/log/messages
Apr 27 12:10:03 f2 /bsd: carp: pfsync0 demoted group carp by 1 to 1
(pfsyncdev)
Apr 27 12:10:03 f2 /bsd: carp: pfsync0 demoted group pfsync by 1 to 2
(pfsyncdev)
Apr 27 12:10:06 f2 /bsd: carp: pfsync0 demoted group carp by -1 to 0
(pfsyncdev)
Apr 27 12:10:06 f2 /bsd: carp: pfsync0 demoted group pfsync by -1 to 1
(pfsyncdev)
Apr 27 12:10:33 f2 /bsd: carp: pfsync0 demoted group carp by 1 to 1
(pfsyncdev)
Apr 27 12:10:33 f2 /bsd: carp: pfsync0 demoted group pfsync by 1 to 2
(pfsyncdev)
Apr 27 12:10:36 f2 /bsd: carp: pfsync0 demoted group carp by -1 to 0
(pfsyncdev)
Apr 27 12:10:36 f2 /bsd: carp: pfsync0 demoted group pfsync by -1 to 1
(pfsyncdev)
Apr 27 12:10:41 f2 /bsd: carp0: state transition: MASTER -> BACKUP
Apr 27 12:10:41 f2 /bsd: carp3: state transition: MASTER -> BACKUP
Apr 27 12:10:41 f2 /bsd: carp2: state transition: MASTER -> BACKUP
Apr 27 12:10:41 f2 /bsd: carp1: state transition: MASTER -> BACKUP
Apr 27 12:10:47 f2 /bsd: carp0: state transition: BACKUP -> MASTER
Apr 27 12:10:47 f2 /bsd: carp3: state transition: BACKUP -> MASTER
Apr 27 12:10:47 f2 /bsd: carp2: state transition: BACKUP -> MASTER
Apr 27 12:10:47 f2 /bsd: carp1: state transition: BACKUP -> MASTER
Apr 27 12:10:48 f2 /bsd: carp0: state transition: MASTER -> BACKUP
Apr 27 12:10:48 f2 /bsd: carp3: state transition: MASTER -> BACKUP
Apr 27 12:10:48 f2 /bsd: carp2: state transition: MASTER -> BACKUP
Apr 27 12:10:48 f2 /bsd: carp1: state transition: MASTER -> BACKUP
Apr 27 12:11:11 f2 /bsd: carp0: state transition: BACKUP -> MASTER
Apr 27 12:11:11 f2 /bsd: carp1: state transition: BACKUP -> MASTER
Apr 27 12:11:11 f2 /bsd: carp2: state transition: BACKUP -> MASTER
Apr 27 12:11:11 f2 /bsd: carp3: state transition: BACKUP -> MASTER
Apr 27 12:12:49 f2 /bsd: carp0: state transition: MASTER -> BACKUP
Apr 27 12:12:49 f2 /bsd: carp2: state transition: MASTER -> BACKUP
Apr 27 12:12:49 f2 /bsd: carp3: state transition: MASTER -> BACKUP
Apr 27 12:12:49 f2 /bsd: carp1: state transition: MASTER -> BACKUP
Apr 27 12:19:55 f2 /bsd: carp: pfsync0 demoted group carp by -1 to 0
(pfsync bulk done)
Apr 27 12:19:55 f2 /bsd: carp: pfsync0 demoted group pfsync by -1 to 0
(pfsync bulk done)
For complete thread
http://marc.info/?t=133112911700005&r=1&w=2
regards,
Giannis
