Hi,
at some remote place i'using an axe0 to connect to the ISP's CPE in
bridge mode, which hands me a public IP. The CPE had power plug issues,
so was randomly disappearing... and required going on-site.
on the same box, i have monit from ports doing various checks and trying
to ensure connectivity and daemons keep working fine. Operations done by
monit are '/etc/netstart axe0' and 'rcctl restart unbound' when some
checks fail:
check network outside-link with interface axe0
start program "/bin/sh /etc/netstart axe0"
if failed link for 5 cycles then start
check network outside-ip with address <public.ip>
start program "/bin/sh /etc/netstart axe0"
if failed link for 5 cycles then start
check process unbound matching unbound
restart program "/usr/sbin/rcctl restart unbound"
if failed port 53 type udp protocol dns for 2 cycles then restart
this works fine, until at some point things accumulate (eg too much CPE
downtime), and even if the CPE comes back and things should come back to
normal operation mode, i get in a situation where most of the network
operations by daemons fail with 'No buffer space available', matching
the following patterns:
dhcpleased.*: bpf_send_packet: writev: No buffer space available
unbound:.*notice: send failed: No buffer space available
iked.*: ikev2_msg_send: sendtofrom: No buffer space available
from that point, i tried restarting dhcpleased, but the new process kept
getting 'No buffer space available' errors.
The only 'working workaround' i've found so far is to ifconfig axe0
down/up, which resumes normal operation mode immediately, i get my
public ip/dhcp lease, iked reconnects, unbound does its job, etc.
i can add a monit check to do the down/up dance when the aforementioned
patterns show up in var/log/messages, but i'd be curious in
investigating it. What system metric should be monitored via systat to
check for that 'buffer space' ? A leak happening because of the numerous
netstart calls ? an issue in the axe driver ?
hw is:
axe0 at uhub0 port 7 configuration 1 interface 0 "ASIX Electronics AX88772" rev
2.00/0.01 addr 2
axe0: AX88772, address 00:14:d1:da:77:4f
ukphy0 at axe0 phy 16: Generic IEEE 802.3u media interface, rev. 1: OUI
0x000ec6, model 0x0006
and sometimes does some
axe0: usb errors on rx: IOERROR
axe0 detached
but reattaches immediately, and those msgs cant be correlated to issues
with the CPE or the 'No buffer space available' messages.
Hints welcome.
Landry
OpenBSD 7.2 (GENERIC.MP) #4: Mon Dec 12 06:06:42 MST 2022
r...@syspatch-72-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 1835331584 (1750MB)
avail mem = 1762369536 (1680MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.4 @ 0xe0000 (43 entries)
bios0: vendor Apple Inc. version "MM31.88Z.00AD.B00.0907171535" date 07/17/09
bios0: Apple Inc. Macmini3,1
acpi0 at bios0: ACPI 4.0
acpi0: sleep states S0 S3 S4 S5
acpi0: tables DSDT FACP HPET APIC APIC MCFG ASF! SBST ECDT SSDT SSDT SSDT
acpi0: wakeup devices EC__(S3) OHC1(S3) EHC1(S3) OHC2(S3) EHC2(S3) GIGE(S5)
ARPT(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpihpet0 at acpi0: 25000000 Hz
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Core(TM)2 Duo CPU P7550 @ 2.26GHz, 2255.38 MHz, 06-17-0a
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,XSAVE,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
cpu0: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 3MB 64b/line
12-way L2 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
cpu0: apic clock running at 265MHz
cpu0: mwait min=64, max=64, C-substates=0.2.2.2.2.1.3, IBE
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Core(TM)2 Duo CPU P7550 @ 2.26GHz, 2255.36 MHz, 06-17-0a
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,XSAVE,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
cpu1: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 3MB 64b/line
12-way L2 cache
cpu1: smt 0, core 1, package 0
ioapic0 at mainbus0: apid 1 pa 0xfec00000, version 11, 24 pins, remapped
acpimcfg0 at acpi0
acpimcfg0: addr 0xf0000000, bus 0-255
acpiec0 at acpi0
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 2 (IXVE)
acpibtn0 at acpi0: PWRB
acpibtn1 at acpi0: SLPB
acpipci0 at acpi0 PCI0: 0x00000010 0x00000011 0x00000000memory map conflict
0xffc00000/0x400000
asmc0 at acpi0: SMC_ (smc-mcp) addr 0x300/0x20: rev 1.35f535, 154 keys
acpicmos0 at acpi0
acpicpu0 at acpi0: !C3(100@57 mwait.3@0x31), !C2(500@1 mwait@0x10), C1(1000@1
mwait), PSS
acpicpu1 at acpi0: !C3(100@57 mwait.3@0x31), !C2(500@1 mwait@0x10), C1(1000@1
mwait), PSS
cpu0: Enhanced SpeedStep 2255 MHz: speeds: 2261, 2128, 1862, 1596 MHz
pci0 at mainbus0 bus 0
0:3:5: mem address conflict 0x93400000/0x80000
pchb0 at pci0 dev 0 function 0 "NVIDIA MCP79 Host" rev 0xb1
"NVIDIA MCP79 Memory" rev 0xb1 at pci0 dev 0 function 1 not configured
pcib0 at pci0 dev 3 function 0 "NVIDIA MCP79 ISA" rev 0xb3
"NVIDIA MCP79 Memory" rev 0xb1 at pci0 dev 3 function 1 not configured
nviic0 at pci0 dev 3 function 2 "NVIDIA MCP79 SMBus" rev 0xb1
iic0 at nviic0
iic0: addr 0x48 00=11 01=60 02=4b 03=50 04=1c 05=06 08=11 09=60 0a=4b 0b=50
0c=1c 0d=06 10=11 11=60 12=4b 13=50 14=1c 15=06 18=11 19=60 1a=4b 1b=50 1c=1c
1d=06 20=11 21=60 22=4b 23=50 24=1c 25=06 28=11 29=60 2a=4b 2b=50 2c=1c 2d=06
30=11 31=60 32=4b 33=50 34=1c 35=06 38=11 39=60 3a=4b 3b=50 3c=1c 3d=06 40=11
41=60 42=4b 43=50 44=1c 45=06 48=11 49=60 4a=4b 4b=50 4c=1c 4d=06 50=11 51=60
52=4b 53=50 54=1c 55=06 58=11 59=60 5a=4b 5b=50 5c=1c 5d=06 60=11 61=60 62=4b
63=50 64=1c 65=06 68=11 69=60 6a=4b 6b=50 6c=1c 6d=06 70=11 71=60 72=4b 73=50
74=1c 75=06 78=11 79=60 7a=4b 7b=50 7c=1c 7d=06 80=11 81=60 82=4b 83=50 84=1c
85=06 88=11 89=60 8a=4b 8b=50 8c=1c 8d=06 90=11 91=60 92=4b 93=50 94=1c 95=06
98=11 99=60 9a=4b 9b=50 9c=1c 9d=06 a0=11 a1=60 a2=4b a3=50 a4=1c a5=06 a8=11
a9=60 aa=4b ab=50 ac=1c ad=06 b0=11 b1=60 b2=4b b3=50 b4=1c b5=06 b8=11 b9=60
ba=4b bb=50 bc=1c bd=06 c0=11 c1=60 c2=4b c3=50 c4=1c c5=06 c8=11 c9=60 ca=4b
cb=50 cc=1c cd=06 d0=11 d1=60 d2=4b d3=50 d4=1c d5=06 d8=11 d9=60 da=4b db=50
dc=1c dd=06 e0=11 e1=60 e2=4b e3=50 e4=1c e5=06 e8=11 e9=60 ea=4b eb=50 ec=1c
ed=06 f0=11 f1=60 f2=4b f3=50 f4=1c f5=06 f8=11 f9=60 fa=4b fb=50 fc=1c fd=06
words 00=1130 01=60a0 02=4b00 03=5000 04=1cc0 05=06d0 06=0000 07=0000
spdmem0 at iic0 addr 0x50: 1GB DDR3 SDRAM PC3-8500 SO-DIMM
spdmem1 at iic0 addr 0x51: 1GB DDR3 SDRAM PC3-8500 SO-DIMM
iic1 at nviic0
"NVIDIA MCP79 Memory" rev 0xb1 at pci0 dev 3 function 3 not configured
vendor "NVIDIA", unknown product 0x0a98 (class memory subclass RAM, rev 0xb1)
at pci0 dev 3 function 4 not configured
"NVIDIA MCP79 Co-processor" rev 0xb1 at pci0 dev 3 function 5 not configured
ohci0 at pci0 dev 4 function 0 "NVIDIA MCP79 USB" rev 0xb1: apic 1 int 11,
version 1.0, legacy support
ehci0 at pci0 dev 4 function 1 "NVIDIA MCP79 USB" rev 0xb1: apic 1 int 10
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 configuration 1 interface 0 "NVIDIA EHCI root hub" rev 2.00/1.00
addr 1
ohci1 at pci0 dev 6 function 0 "NVIDIA MCP79 USB" rev 0xb1: apic 1 int 7,
version 1.0, legacy support
ehci1 at pci0 dev 6 function 1 "NVIDIA MCP79 USB" rev 0xb1: apic 1 int 5
usb1 at ehci1: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "NVIDIA EHCI root hub" rev 2.00/1.00
addr 1
azalia0 at pci0 dev 8 function 0 "NVIDIA MCP79 HD Audio" rev 0xb1: apic 1 int 15
azalia0: codecs: Realtek ALC885
audio0 at azalia0
ppb0 at pci0 dev 9 function 0 "NVIDIA MCP79 PCIE" rev 0xb1
pci1 at ppb0 bus 1
nfe0 at pci0 dev 10 function 0 "NVIDIA MCP79 LAN" rev 0xb1: apic 1 int 14,
address 34:15:9e:18:45:58
rgephy0 at nfe0 phy 1: RTL8169S/8110S/8211 PHY, rev. 2
pciide0 at pci0 dev 11 function 0 "NVIDIA MCP79 SATA" rev 0xb1: DMA
pciide0: using apic 1 int 11 for native-PCI interrupt
wd0 at pciide0 channel 0 drive 0: <Samsung SSD 840 EVO 250GB>
wd0: 1-sector PIO, LBA48, 238475MB, 488397168 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 6
atapiscsi0 at pciide0 channel 1 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <OPTIARC, DVD RW AD-5680H, 3AHB> removable
cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 5
ppb1 at pci0 dev 16 function 0 "NVIDIA MCP79 PCIE" rev 0xb1
pci2 at ppb1 bus 2
vga1 at pci2 dev 0 function 0 "NVIDIA GeForce 9400" rev 0xb1
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
ppb2 at pci0 dev 21 function 0 "NVIDIA MCP79 PCIE" rev 0xb1: msi
pci3 at ppb2 bus 3
"Broadcom BCM4321" rev 0x05 at pci3 dev 0 function 0 not configured
ppb3 at pci0 dev 22 function 0 "NVIDIA MCP79 PCIE" rev 0xb1: msi
pci4 at ppb3 bus 4
"AT&T/Lucent FW643 1394" rev 0x07 at pci4 dev 0 function 0 not configured
isa0 at pcib0
isadma0 at isa0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
usb2 at ohci0: USB revision 1.0
uhub2 at usb2 configuration 1 interface 0 "NVIDIA OHCI root hub" rev 1.00/1.00
addr 1
usb3 at ohci1: USB revision 1.0
uhub3 at usb3 configuration 1 interface 0 "NVIDIA OHCI root hub" rev 1.00/1.00
addr 1
vmm0 at mainbus0: VMX (using slow L1TF mitigation)
axe0 at uhub0 port 7 configuration 1 interface 0 "ASIX Electronics AX88772" rev
2.00/0.01 addr 2
axe0: AX88772, address 00:14:d1:da:77:4f
ukphy0 at axe0 phy 16: Generic IEEE 802.3u media interface, rev. 1: OUI
0x000ec6, model 0x0006
uaudio0 at uhub2 port 1 configuration 1 interface 1 "ABC USB Sound Device" rev
1.10/0.10 addr 2
uaudio0: class v1, full-speed, sync, channels: 8 play, 2 rec, 25 ctls
audio1 at uaudio0
uhidev0 at uhub2 port 1 configuration 1 interface 3 "ABC USB Sound Device" rev
1.10/0.10 addr 2
uhidev0: iclass 3/0
ucc0 at uhidev0: 10 usages, 3 keys, enum
wskbd0 at ucc0 mux 1
wskbd0: connecting to wsdisplay0
uhidev1 at uhub2 port 5 configuration 1 interface 0 "Apple Computer, Inc. IR
Receiver" rev 2.00/0.16 addr 3
uhidev1: iclass 3/0, 38 report ids
uhid0 at uhidev1 reportid 36: input=4, output=0, feature=0
uhid1 at uhidev1 reportid 37: input=4, output=0, feature=0
uhid2 at uhidev1 reportid 38: input=4, output=0, feature=0
uhub4 at uhub3 port 1 configuration 1 interface 0 "Apple Inc. BRCM2046 Hub" rev
2.00/1.00 addr 2
ugen0 at uhub4 port 1 "Apple Inc. Bluetooth USB Host Controller" rev 2.00/1.80
addr 3
uhidev2 at uhub4 port 2 configuration 1 interface 0 "Apple Computer product
0x820a" rev 2.00/1.00 addr 4
uhidev2: iclass 3/1, 1 report id
ukbd0 at uhidev2 reportid 1: 8 variable keys, 6 key codes
wskbd1 at ukbd0: console keyboard, using wsdisplay0
uhidev3 at uhub4 port 3 configuration 1 interface 0 "Apple Computer product
0x820b" rev 2.00/1.00 addr 5
uhidev3: iclass 3/1, 2 report ids
ums0 at uhidev3 reportid 2: 3 buttons
wsmouse0 at ums0 mux 0
uhidev4 at uhub3 port 2 configuration 1 interface 0 "PC Sensors TEMPer" rev
1.10/0.00 addr 6
uhidev4: iclass 3/1
ukbd1 at uhidev4: 8 variable keys, 6 key codes
wskbd2 at ukbd1 mux 1
wskbd2: connecting to wsdisplay0
uhidev5 at uhub3 port 2 configuration 1 interface 1 "PC Sensors TEMPer" rev
1.10/0.00 addr 6
uhidev5: iclass 3/1
ugold0 at uhidev5
uhidev6 at uhub3 port 4 configuration 1 interface 0 "Fujitsu Component Type 6
Keyboard" rev 1.00/1.02 addr 7
uhidev6: iclass 3/1
ukbd2 at uhidev6: 8 variable keys, 6 key codes, country code 33
wskbd3 at ukbd2 mux 1
wskbd3: connecting to wsdisplay0
vscsi0 at root
scsibus2 at vscsi0: 256 targets
softraid0 at root
scsibus3 at softraid0: 256 targets
root on wd0a (0957f3aec879d14c.a) swap on wd0b dump on wd0b
WARNING: / was not properly unmounted
WARNING: bad clock chip time
WARNING: CHECK AND RESET THE DATE!
ugold0: 2 sensors type temperx (temperature and humidity)
