On Tue, Aug 04, 2009 at 01:20:17AM +0000, Stuart Henderson wrote:
> I don't understand what you mean by "VLAN on carp1", can you explain it
> a bit more please?
My bad. I confused things a little.
It's as you say, carpdevs set to vlan interfaces. In this case, carp1010
and carp1011 have vlan1010 and vlan1011 respectively as carpdevs, and
those vlans both have em3 as their parent interface. There is also
carp3 that has em3 as its carpdev.
So:
carp0 (index 11) carpdev em0
carp1 (index 12) carpdev em1
carp1010 (index 13) carpdev vlan1010 (which is a vlan on em3)
carp1011 (index 14) carpdev vlan1011 (which is another vlan on em3)
carp2 (index 15) carpdev em2
carp3 (index 16) carpdev em3
> Do you see the same result from other software e.g. "route -n monitor"?
> (use recent -current [or, if your dns is ok, remove the -n option] to
> display interface names rather than index numbers)
Neat. I didn't know about route monitor. So I tried again with route -n
monitor, with 4.5 GENERIC.MP.
Here's the output after setting it to master:
----
got message of size 208 on Tue Aug 4 19:45:06 2009
RTM_IFINFO: iface status change: len 208, if# 12, link: master,
flags:<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST>
got message of size 104 on Tue Aug 4 19:45:06 2009
RTM_DELETE: Delete Route: len 104, priority 0, table 0, pid: 0, seq 0, errno 3
flags:<HOST,DONE>
locks: inits:
sockaddrs: <DST>
10.0.1.250
got message of size 120 on Tue Aug 4 19:45:06 2009
RTM_ADD: Add Route: len 120, priority 0, table 0, pid: 0, seq 0, errno 0
flags:<UP,HOST,DONE>
locks: inits:
sockaddrs: <DST,GATEWAY>
10.0.1.250 10.0.1.250
got message of size 100 on Tue Aug 4 19:45:06 2009
RTM_NEWADDR: address being added to iface: len 100, metric 0, flags:
sockaddrs: <NETMASK,IFP,IFA>
ffff:ffff:ffff:ffff:: 00:00:5e:00:01:78 fe80::200:5eff:fe00:178%carp1
got message of size 136 on Tue Aug 4 19:45:06 2009
RTM_ADD: Add Route: len 136, priority 0, table 0, pid: 0, seq 0, errno 0
flags:<UP,HOST,LLINFO>
locks: inits:
sockaddrs: <DST,GATEWAY>
fe80::200:5eff:fe00:178%carp1 00:00:5e:00:01:78
got message of size 104 on Tue Aug 4 19:45:06 2009
RTM_DELETE: Delete Route: len 104, priority 0, table 0, pid: 0, seq 0, errno 3
flags:<HOST,DONE>
locks: inits:
sockaddrs: <DST>
10.0.1.15
got message of size 132 on Tue Aug 4 19:45:06 2009
RTM_ADD: Add Route: len 132, priority 0, table 0, pid: 0, seq 0, errno 17
flags:<DONE>
locks: inits:
sockaddrs: <DST,GATEWAY,NETMASK,LABEL>
10.0.1.0 10.0.1.15 255.255.255.0 default
got message of size 208 on Tue Aug 4 19:45:06 2009
RTM_IFINFO: iface status change: len 208, if# 13, link: master,
flags:<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST>
got message of size 104 on Tue Aug 4 19:45:06 2009
RTM_DELETE: Delete Route: len 104, priority 0, table 0, pid: 0, seq 0, errno 3
flags:<HOST,DONE>
locks: inits:
sockaddrs: <DST>
10.0.10.250
got message of size 120 on Tue Aug 4 19:45:06 2009
RTM_ADD: Add Route: len 120, priority 0, table 0, pid: 0, seq 0, errno 0
flags:<UP,HOST,DONE>
locks: inits:
sockaddrs: <DST,GATEWAY>
10.0.10.250 10.0.10.250
got message of size 104 on Tue Aug 4 19:45:06 2009
RTM_NEWADDR: address being added to iface: len 104, metric 0, flags:
sockaddrs: <NETMASK,IFP,IFA>
ffff:ffff:ffff:ffff:: 00:00:5e:00:01:6e fe80::200:5eff:fe00:16e%carp1010
got message of size 136 on Tue Aug 4 19:45:06 2009
RTM_ADD: Add Route: len 136, priority 0, table 0, pid: 0, seq 0, errno 0
flags:<UP,HOST,LLINFO>
locks: inits:
sockaddrs: <DST,GATEWAY>
fe80::200:5eff:fe00:16e%carp1010 00:00:5e:00:01:6e
got message of size 208 on Tue Aug 4 19:45:06 2009
RTM_IFINFO: iface status change: len 208, if# 11, link: master,
flags:<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST>
got message of size 104 on Tue Aug 4 19:45:06 2009
RTM_DELETE: Delete Route: len 104, priority 0, table 0, pid: 0, seq 0, errno 3
flags:<HOST,DONE>
locks: inits:
sockaddrs: <DST>
10.137.16.192
got message of size 120 on Tue Aug 4 19:45:06 2009
RTM_ADD: Add Route: len 120, priority 0, table 0, pid: 0, seq 0, errno 0
flags:<UP,HOST,DONE>
locks: inits:
sockaddrs: <DST,GATEWAY>
10.137.16.192 10.137.16.192
got message of size 100 on Tue Aug 4 19:45:06 2009
RTM_NEWADDR: address being added to iface: len 100, metric 0, flags:
sockaddrs: <NETMASK,IFP,IFA>
ffff:ffff:ffff:ffff:: 00:00:5e:00:01:6e fe80::200:5eff:fe00:16e%carp0
got message of size 136 on Tue Aug 4 19:45:06 2009
RTM_ADD: Add Route: len 136, priority 0, table 0, pid: 0, seq 0, errno 0
flags:<UP,HOST,LLINFO>
locks: inits:
sockaddrs: <DST,GATEWAY>
fe80::200:5eff:fe00:16e%carp0 00:00:5e:00:01:6e
got message of size 208 on Tue Aug 4 19:45:06 2009
RTM_IFINFO: iface status change: len 208, if# 14, link: master,
flags:<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST>
----
And back to slave:
----
got message of size 208 on Tue Aug 4 19:45:32 2009
RTM_IFINFO: iface status change: len 208, if# 11, link: backup,
flags:<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST>
got message of size 104 on Tue Aug 4 19:45:32 2009
RTM_DELETE: Delete Route: len 104, priority 0, table 0, pid: 0, seq 0, errno 0
flags:<HOST,DONE>
locks: inits:
sockaddrs: <DST>
10.137.16.192
got message of size 136 on Tue Aug 4 19:45:32 2009
RTM_DELETE: Delete Route: len 136, priority 0, table 0, pid: 0, seq 0, errno 0
flags:<HOST>
locks: inits:
sockaddrs: <DST,GATEWAY>
fe80::200:5eff:fe00:16e%carp0 00:00:5e:00:01:6e
got message of size 100 on Tue Aug 4 19:45:32 2009
RTM_DELADDR: address being removed from iface: len 100, metric 0, flags:
sockaddrs: <NETMASK,IFP,IFA>
ffff:ffff:ffff:ffff:: 00:00:5e:00:01:6e fe80::200:5eff:fe00:16e%carp0
got message of size 208 on Tue Aug 4 19:45:32 2009
RTM_IFINFO: iface status change: len 208, if# 15, link: backup,
flags:<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST>
got message of size 104 on Tue Aug 4 19:45:32 2009
RTM_DELETE: Delete Route: len 104, priority 0, table 0, pid: 0, seq 0, errno 0
flags:<HOST,DONE>
locks: inits:
sockaddrs: <DST>
10.0.2.250
got message of size 136 on Tue Aug 4 19:45:32 2009
RTM_DELETE: Delete Route: len 136, priority 0, table 0, pid: 0, seq 0, errno 0
flags:<HOST>
locks: inits:
sockaddrs: <DST,GATEWAY>
fe80::200:5eff:fe00:182%carp2 00:00:5e:00:01:82
got message of size 100 on Tue Aug 4 19:45:32 2009
RTM_DELADDR: address being removed from iface: len 100, metric 0, flags:
sockaddrs: <NETMASK,IFP,IFA>
ffff:ffff:ffff:ffff:: 00:00:5e:00:01:82 fe80::200:5eff:fe00:182%carp2
got message of size 208 on Tue Aug 4 19:45:32 2009
RTM_IFINFO: iface status change: len 208, if# 12, link: backup,
flags:<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST>
got message of size 104 on Tue Aug 4 19:45:32 2009
RTM_DELETE: Delete Route: len 104, priority 0, table 0, pid: 0, seq 0, errno 0
flags:<HOST,DONE>
locks: inits:
sockaddrs: <DST>
10.0.1.250
got message of size 136 on Tue Aug 4 19:45:32 2009
RTM_DELETE: Delete Route: len 136, priority 0, table 0, pid: 0, seq 0, errno 0
flags:<HOST>
locks: inits:
sockaddrs: <DST,GATEWAY>
fe80::200:5eff:fe00:178%carp1 00:00:5e:00:01:78
got message of size 100 on Tue Aug 4 19:45:32 2009
RTM_DELADDR: address being removed from iface: len 100, metric 0, flags:
sockaddrs: <NETMASK,IFP,IFA>
ffff:ffff:ffff:ffff:: 00:00:5e:00:01:78 fe80::200:5eff:fe00:178%carp1
got message of size 104 on Tue Aug 4 19:45:32 2009
RTM_DELETE: Delete Route: len 104, priority 0, table 0, pid: 0, seq 0, errno 3
flags:<HOST,DONE>
locks: inits:
sockaddrs: <DST>
10.0.1.15
got message of size 208 on Tue Aug 4 19:45:32 2009
RTM_IFINFO: iface status change: len 208, if# 16, link: backup,
flags:<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST>
got message of size 104 on Tue Aug 4 19:45:32 2009
RTM_DELETE: Delete Route: len 104, priority 0, table 0, pid: 0, seq 0, errno 0
flags:<HOST,DONE>
locks: inits:
sockaddrs: <DST>
10.0.0.250
got message of size 136 on Tue Aug 4 19:45:32 2009
RTM_DELETE: Delete Route: len 136, priority 0, table 0, pid: 0, seq 0, errno 0
flags:<HOST>
locks: inits:
sockaddrs: <DST,GATEWAY>
fe80::200:5eff:fe00:164%carp3 00:00:5e:00:01:64
----
So again it seems to miss 2/6 interfaces. In some rare occasions, when
going master, it can see all the updates, but most of the time it
catches only 4/6. When going slave, it's the opposite. Most of the time
it sees 6/6, and sometimes less than that (mostly 4/6).
Just in case, dmesg follows:
----
OpenBSD 4.5 (GENERIC.MP) #3: Tue Jun 30 18:24:15 UTC 2009
r...@obsd45.mdc.gameloft.org:/binpatch/work-binpatch-4.5/src/sys/arch/i386/compile/GENERIC.MP
cpu0: Intel(R) Xeon(R) CPU 5110 @ 1.60GHz ("GenuineIntel" 686-class) 1.61 GHz
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,TM2,CX16,xTPR
real mem = 2145316864 (2045MB)
avail mem = 2066141184 (1970MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 12/31/99, BIOS32 rev. 0 @ 0xf0000, SMBIOS
rev. 2.3 @ 0xee000 (67 entries)
bios0: vendor HP version "P58" date 05/01/2007
bios0: HP ProLiant DL360 G5
acpi0 at bios0: rev 2
acpi0: tables DSDT FACP SPCR MCFG HPET SPMI APIC
acpi0: wakeup devices
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpihpet0 at acpi0: 14318179 Hz
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: apic clock running at 266MHz
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Xeon(R) CPU 5110 @ 1.60GHz ("GenuineIntel" 686-class) 1.61 GHz
cpu1:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,TM2,CX16,xTPR
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0: apid 9 pa 0xfec80000, version 20, 24 pins
acpiprt0 at acpi0: bus 1 (IP2P)
acpiprt1 at acpi0: bus 11 (IPE1)
acpiprt2 at acpi0: bus 10 (IPE4)
acpiprt3 at acpi0: bus 16 (P2P2)
acpiprt4 at acpi0: bus 9 (PT02)
acpiprt5 at acpi0: bus 6 (PT03)
acpiprt6 at acpi0: bus 19 (PT04)
acpiprt7 at acpi0: bus 3 (NB01)
acpiprt8 at acpi0: bus 5 (NB02)
acpiprt9 at acpi0: bus 0 (PCI0)
acpicpu0 at acpi0
acpicpu1 at acpi0
acpitz0 at acpi0: critical temperature 31 degC
bios0: ROM list: 0xc0000/0xb000 0xcc400/0x4000! 0xd0400/0x1800 0xe6000/0x2000!
ipmi at mainbus0 not configured
pci0 at mainbus0 bus 0: configuration mode 1 (bios)
pchb0 at pci0 dev 0 function 0 "Intel 5000P Host" rev 0xb1
ppb0 at pci0 dev 2 function 0 "Intel 5000 PCIE" rev 0xb1
pci1 at ppb0 bus 9
ppb1 at pci1 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01
pci2 at ppb1 bus 10
ppb2 at pci2 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01
pci3 at ppb2 bus 11
ppb3 at pci2 dev 1 function 0 "Intel 6321ESB PCIE" rev 0x01
pci4 at ppb3 bus 14
ppb4 at pci2 dev 2 function 0 "Intel 6321ESB PCIE" rev 0x01
pci5 at ppb4 bus 15
ppb5 at pci1 dev 0 function 3 "Intel 6321ESB PCIE-PCIX" rev 0x01
pci6 at ppb5 bus 16
ppb6 at pci6 dev 1 function 0 "IBM 133 PCIX-PCIX" rev 0x02
pci7 at ppb6 bus 17
em0 at pci7 dev 4 function 0 "Intel PRO/1000MT QP (82546EB)" rev 0x01: apic 9
int 0 (irq 11), address 00:04:23:d2:a1:f4
em1 at pci7 dev 4 function 1 "Intel PRO/1000MT QP (82546EB)" rev 0x01: apic 9
int 1 (irq 11), address 00:04:23:d2:a1:f5
em2 at pci7 dev 6 function 0 "Intel PRO/1000MT QP (82546EB)" rev 0x01: apic 9
int 0 (irq 11), address 00:04:23:d2:a1:f6
em3 at pci7 dev 6 function 1 "Intel PRO/1000MT QP (82546EB)" rev 0x01: apic 9
int 1 (irq 11), address 00:04:23:d2:a1:f7
ppb7 at pci0 dev 3 function 0 "Intel 5000 PCIE" rev 0xb1
pci8 at ppb7 bus 6
ppb8 at pci8 dev 0 function 0 "ServerWorks PCIE-PCIX" rev 0xb4
pci9 at ppb8 bus 7
ppb9 at pci9 dev 4 function 0 "ServerWorks HT-1000 PCIX" rev 0xb2
pci10 at ppb9 bus 8
ciss0 at pci9 dev 8 function 0 "Hewlett-Packard Smart Array" rev 0x00: apic 8
int 16 (irq 11)
ciss0: 1 LD, HW rev 0, FW 1.66/1.66
scsibus0 at ciss0: 1 targets
sd0 at scsibus0 targ 0 lun 0: <HP, LOGICAL VOLUME, 1.66> SCSI3 0/direct fixed
sd0: 57195MB, 512 bytes/sec, 117136800 sec total
ppb10 at pci0 dev 4 function 0 "Intel 5000 PCIE x8" rev 0xb1
pci11 at ppb10 bus 19
ppb11 at pci0 dev 5 function 0 "Intel 5000 PCIE" rev 0xb1
pci12 at ppb11 bus 22
ppb12 at pci0 dev 6 function 0 "Intel 5000 PCIE" rev 0xb1
pci13 at ppb12 bus 2
ppb13 at pci13 dev 0 function 0 "ServerWorks PCIE-PCIX" rev 0xc3
pci14 at ppb13 bus 3
bnx0 at pci14 dev 0 function 0 "Broadcom BCM5708" rev 0x12: apic 8 int 18 (irq
11)
ppb14 at pci0 dev 7 function 0 "Intel 5000 PCIE" rev 0xb1
pci15 at ppb14 bus 4
ppb15 at pci15 dev 0 function 0 "ServerWorks PCIE-PCIX" rev 0xc3
pci16 at ppb15 bus 5
bnx1 at pci16 dev 0 function 0 "Broadcom BCM5708" rev 0x12: apic 8 int 19 (irq
11)
pchb1 at pci0 dev 16 function 0 "Intel 5000 Error Reporting" rev 0xb1
pchb2 at pci0 dev 16 function 1 "Intel 5000 Error Reporting" rev 0xb1
pchb3 at pci0 dev 16 function 2 "Intel 5000 Error Reporting" rev 0xb1
pchb4 at pci0 dev 17 function 0 "Intel 5000 Reserved" rev 0xb1
pchb5 at pci0 dev 19 function 0 "Intel 5000 Reserved" rev 0xb1
pchb6 at pci0 dev 21 function 0 "Intel 5000 FBD" rev 0xb1
pchb7 at pci0 dev 22 function 0 "Intel 5000 FBD" rev 0xb1
uhci0 at pci0 dev 29 function 0 "Intel 6321ESB USB" rev 0x09: apic 8 int 16
(irq 11)
uhci1 at pci0 dev 29 function 1 "Intel 6321ESB USB" rev 0x09: apic 8 int 17
(irq 11)
uhci2 at pci0 dev 29 function 2 "Intel 6321ESB USB" rev 0x09: apic 8 int 18
(irq 11)
uhci3 at pci0 dev 29 function 3 "Intel 6321ESB USB" rev 0x09: apic 8 int 19
(irq 11)
ehci0 at pci0 dev 29 function 7 "Intel 6321ESB USB" rev 0x09: apic 8 int 16
(irq 11)
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb16 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xd9
pci17 at ppb16 bus 1
vga1 at pci17 dev 3 function 0 "ATI ES1000" rev 0x02
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
radeondrm0 at vga1: apic 8 int 23 (irq 5)
drm0 at radeondrm0
"Compaq iLO" rev 0x03 at pci17 dev 4 function 0 not configured
"Compaq iLO" rev 0x03 at pci17 dev 4 function 2 not configured
uhci4 at pci17 dev 4 function 4 "Hewlett-Packard USB" rev 0x00: apic 8 int 22
(irq 10)
"Hewlett-Packard IPMI" rev 0x00 at pci17 dev 4 function 6 not configured
usb1 at uhci4: USB revision 1.0
uhub1 at usb1 "Hewlett-Packard UHCI root hub" rev 1.00/1.00 addr 1
ichpcib0 at pci0 dev 31 function 0 "Intel 6321ESB LPC" rev 0x09: PM disabled
pciide0 at pci0 dev 31 function 1 "Intel 6321ESB IDE" rev 0x09: DMA, channel 0
configured to compatibility, channel 1 configured to compatibility
atapiscsi0 at pciide0 channel 0 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <TEAC, DV-28E-V, C.AB> ATAPI 5/cdrom removable
cd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2
pciide0: channel 1 disabled (no drives)
usb2 at uhci0: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb3 at uhci1: USB revision 1.0
uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb4 at uhci2: USB revision 1.0
uhub4 at usb4 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb5 at uhci3: USB revision 1.0
uhub5 at usb5 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at ichpcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
com1: probed fifo depth: 0 bytes
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
mtrr: Pentium Pro MTRR support
uhidev0 at uhub1 port 1 configuration 1 interface 0 "HP Virtual Keyboard" rev
1.10/0.02 addr 2
uhidev0: iclass 3/1
ukbd0 at uhidev0: 8 modifier keys, 6 key codes, country code 33
wskbd1 at ukbd0 mux 1
wskbd1: connecting to wsdisplay0
uhidev1 at uhub1 port 1 configuration 1 interface 1 "HP Virtual Keyboard" rev
1.10/0.02 addr 2
uhidev1: iclass 3/1
ums0 at uhidev1: 3 buttons
wsmouse0 at ums0 mux 0
uhidev2 at uhub3 port 1 configuration 1 interface 0 "Tangtop USB CAT5" rev
1.10/0.01 addr 2
uhidev2: iclass 3/1
ukbd1 at uhidev2: 8 modifier keys, 6 key codes
wskbd2 at ukbd1 mux 1
wskbd2: connecting to wsdisplay0
uhidev3 at uhub3 port 1 configuration 1 interface 1 "Tangtop USB CAT5" rev
1.10/0.01 addr 2
uhidev3: iclass 3/1
ums1 at uhidev3: 3 buttons, Z dir
wsmouse1 at ums1 mux 0
uhub6 at uhub1 port 2 "HP Virtual Hub" rev 1.10/0.01 addr 3
softraid0 at root
root on sd0a swap on sd0b dump on sd0b
WARNING: / was not properly unmounted
bnx0: address 00:1b:78:76:16:a0
brgphy0 at bnx0 phy 1: BCM5708C 10/100/1000baseT PHY, rev. 6
bnx1: address 00:1b:78:76:16:9a
brgphy1 at bnx1 phy 1: BCM5708C 10/100/1000baseT PHY, rev. 6
----
Thanks,
--
Pascal
