I have an OpenBSD 5.9 server at a colocation. It stopped accepting new connections (ping, ssh, http, whatever) yesterday night but fortunately I had one ssh session open from my workstation from which I can still access it. Funny thing is that the server has full access OUT to the internet. I can open web pages through lynx, ssh to everywhere, and so on. It just won't accept any new connections IN.
The colocation provider claim that nothing has changed at their side. (Gateway, firewall, DNS, etc.) Since the location for the server is not easily accessible, and in a worst case scenario wouldn't be accessible for many days or even a week, I'd rather try to find and solve the problem before having to resort to a reboot. (In case the machine doesn't come up again, leaving me without the one ssh session that is alive as for now.) Pflog/tcpdump shows absolutely NO activity, neither in nor out. That is strange IMO and I'm suspecting that some states in pf may be the problem. I'm tempted to do a pfctl -F all, but that may also kill the only ssh session I have open. (I'm resetting shutdown -r +60 every now and then so that the server will at least do a reboot if the ssh connection should fail.) Any ideas as to where to begin? -- Erling Westenvik $ uptime 2:39PM up 253 days, 2:15, 1 user, load averages: 0.27, 0.28, 0.22 $ dmesg OpenBSD 5.9 (GENERIC.MP) #1888: Fri Feb 26 01:20:19 MST 2016 dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP real mem = 8505982976 (8111MB) avail mem = 8243998720 (7862MB) mpath0 at root scsibus0 at mpath0: 256 targets mainbus0 at root bios0 at mainbus0: SMBIOS rev. 2.3 @ 0xfbae0 (60 entries) bios0: vendor American Megatrends Inc. version "080011" date 06/30/2006 bios0: Supermicro H8DSP-8 acpi0 at bios0: rev 0 acpi0: sleep states S0 S1 S4 S5 acpi0: tables DSDT FACP APIC OEMB SRAT acpi0: wakeup devices P1P2(S4) USB0(S1) USB1(S1) USB2(S1) PS2K(S4) PS2M(S4) BR14(S4) BR1E(S4) BR28(S4) BR3C(S4) SLPB(S4) acpitimer0 at acpi0: 3579545 Hz, 32 bits acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: AMD Opteron(tm) Processor 250, 2394.33 MHz cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SSE3,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW,LAHF cpu0: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 1MB 64b/line 16-way L2 cache cpu0: ITLB 32 4KB entries fully associative, 8 4MB entries fully associative cpu0: DTLB 32 4KB entries fully associative, 8 4MB entries fully associative cpu0: AMD erratum 89 present, BIOS upgrade may be required mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges cpu0: apic clock running at 199MHz cpu1 at mainbus0: apid 1 (application processor) cpu1: AMD Opteron(tm) Processor 250, 2394.00 MHz cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SSE3,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW,LAHF cpu1: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 1MB 64b/line 16-way L2 cache cpu1: ITLB 32 4KB entries fully associative, 8 4MB entries fully associative cpu1: DTLB 32 4KB entries fully associative, 8 4MB entries fully associative cpu1: AMD erratum 89 present, BIOS upgrade may be required ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 11, 16 pins ioapic1 at mainbus0: apid 3 pa 0xfec01000, version 11, 16 pins ioapic2 at mainbus0: apid 4 pa 0xfec02000, version 11, 16 pins acpiprt0 at acpi0: bus 0 (PCI0) acpiprt1 at acpi0: bus 1 (P0P1) acpiprt2 at acpi0: bus 2 (P1P2) acpiprt3 at acpi0: bus 3 (BR14) acpiprt4 at acpi0: bus 4 (BR1E) acpiprt5 at acpi0: bus 5 (BR28) acpiprt6 at acpi0: bus 6 (BR32) acpiprt7 at acpi0: bus 7 (BR3C) acpicpu0 at acpi0: C1(@1 halt!) acpicpu1 at acpi0: C1(@1 halt!) acpibtn0 at acpi0: PWRB acpibtn1 at acpi0: SLPB pci0 at mainbus0 bus 0 ppb0 at pci0 dev 1 function 0 "ServerWorks HT-1000 PCI" rev 0x00 pci1 at ppb0 bus 1 ppb1 at pci1 dev 13 function 0 "ServerWorks HT-1000 PCIX" rev 0xb2 pci2 at ppb1 bus 2 pciide0 at pci1 dev 14 function 0 "ServerWorks HT-1000 SATA" rev 0x00: DMA pciide0: using apic 2 int 11 for native-PCI interrupt pciide0: port 0: 1.5Gb/s wd0 at pciide0 channel 0 drive 0: <ST500DM002-1BD142> wd0: 16-sector PIO, LBA48, 476940MB, 976773168 sectors wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 6 pciide0: port 1: 1.5Gb/s wd1 at pciide0 channel 1 drive 0: <ST3500418AS> wd1: 16-sector PIO, LBA48, 476940MB, 976773168 sectors wd1(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 6 pciide0: port 2: 1.5Gb/s wd2 at pciide0 channel 2 drive 0: <SAMSUNG HD501LJ> wd2: 16-sector PIO, LBA48, 476940MB, 976773168 sectors wd2(pciide0:2:0): using PIO mode 4, Ultra-DMA mode 6 pciide0: port 3: 1.5Gb/s wd3 at pciide0 channel 3 drive 0: <SAMSUNG HD501LJ> wd3: 16-sector PIO, LBA48, 476940MB, 976773168 sectors wd3(pciide0:3:0): using PIO mode 4, Ultra-DMA mode 6 pciide1 at pci1 dev 14 function 1 "ServerWorks HT-1000 SATA" rev 0x00 piixpm0 at pci0 dev 2 function 0 "ServerWorks HT-1000" rev 0x00: polling iic0 at piixpm0 iic0: addr 0x1b 0f=18 1e=18 2d=18 3c=18 4b=18 5a=18 69=18 78=b9 87=f8 96=f9 a5=f8 b4=f1 c3=fa d2=00 e1=00 f0=18 words 00=ffff 01=ffff 02=ffff 03=ffff 04=ffff 05=ffff 06=ffff 07=ffff admcts0 at iic0 addr 0x2c pciide2 at pci0 dev 2 function 1 "ServerWorks HT-1000 IDE" rev 0x00: DMA atapiscsi0 at pciide2 channel 0 drive 1 scsibus1 at atapiscsi0: 2 targets cd0 at scsibus1 targ 0 lun 0: <MATSHITA, DVD-ROM SR-8178, PZ16> ATAPI 5/cdrom removable cd0(pciide2:0:1): using PIO mode 4, DMA mode 2, Ultra-DMA mode 2 pcib0 at pci0 dev 2 function 2 "ServerWorks HT-1000 LPC" rev 0x00 ohci0 at pci0 dev 3 function 0 "ServerWorks HT-1000 USB" rev 0x01: apic 2 int 10, version 1.0, legacy support ohci1 at pci0 dev 3 function 1 "ServerWorks HT-1000 USB" rev 0x01: apic 2 int 10, version 1.0, legacy support ehci0 at pci0 dev 3 function 2 "ServerWorks HT-1000 USB" rev 0x01: apic 2 int 10 usb0 at ehci0: USB revision 2.0 uhub0 at usb0 "ServerWorks EHCI root hub" rev 2.00/1.00 addr 1 vga1 at pci0 dev 5 function 0 "ATI Rage XL" rev 0x27 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) ppb2 at pci0 dev 8 function 0 "ServerWorks HT-2000 PCIX" rev 0xa3 pci3 at ppb2 bus 3 ppb3 at pci0 dev 9 function 0 "ServerWorks HT-2000 PCIX" rev 0xa3 pci4 at ppb3 bus 4 bge0 at pci4 dev 4 function 0 "Broadcom BCM5780" rev 0x03, BCM5714 B3 (0x8003): msi, address 00:30:48:58:bf:6a brgphy0 at bge0 phy 1: BCM5780 10/100/1000baseT/SX PHY, rev. 0 bge1 at pci4 dev 4 function 1 "Broadcom BCM5780" rev 0x03, BCM5714 B3 (0x8003): msi, address 00:30:48:58:bf:6b brgphy1 at bge1 phy 1: BCM5780 10/100/1000baseT/SX PHY, rev. 0 ppb4 at pci0 dev 10 function 0 "ServerWorks HT-2000 PCIE" rev 0xa3 pci5 at ppb4 bus 5 ppb5 at pci0 dev 11 function 0 "ServerWorks HT-2000 PCIE" rev 0xa3 pci6 at ppb5 bus 6 ppb6 at pci0 dev 12 function 0 "ServerWorks HT-2000 PCIE" rev 0xa3 pci7 at ppb6 bus 7 ppb7 at pci0 dev 13 function 0 "ServerWorks HT-2000 PCIE" rev 0xa3 pci8 at ppb7 bus 8 pchb0 at pci0 dev 24 function 0 "AMD AMD64 0Fh HyperTransport" rev 0x00 pchb1 at pci0 dev 24 function 1 "AMD AMD64 0Fh Address Map" rev 0x00 pchb2 at pci0 dev 24 function 2 "AMD AMD64 0Fh DRAM Cfg" rev 0x00 kate0 at pci0 dev 24 function 3 "AMD AMD64 0Fh Misc Cfg" rev 0x00 pchb3 at pci0 dev 25 function 0 "AMD AMD64 0Fh HyperTransport" rev 0x00 pchb4 at pci0 dev 25 function 1 "AMD AMD64 0Fh Address Map" rev 0x00 pchb5 at pci0 dev 25 function 2 "AMD AMD64 0Fh DRAM Cfg" rev 0x00 kate1 at pci0 dev 25 function 3 "AMD AMD64 0Fh Misc Cfg" rev 0x00 isa0 at pcib0 isadma0 at isa0 fdc0 at isa0 port 0x3f0/6 irq 6 drq 2 fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo pckbc0 at isa0 port 0x60/5 irq 1 irq 12 pckbd0 at pckbc0 (kbd slot) wskbd0 at pckbd0: console keyboard, using wsdisplay0 pcppi0 at isa0 port 0x61 spkr0 at pcppi0 usb1 at ohci0: USB revision 1.0 uhub1 at usb1 "ServerWorks OHCI root hub" rev 1.00/1.00 addr 1 usb2 at ohci1: USB revision 1.0 uhub2 at usb2 "ServerWorks OHCI root hub" rev 1.00/1.00 addr 1 uhub3 at uhub0 port 2 "NEC hub" rev 2.00/1.00 addr 2 uhidev0 at uhub3 port 4 configuration 1 interface 0 "Microsoft Wired Keyboard 400" rev 1.10/1.10 addr 3 uhidev0: iclass 3/1 ukbd0 at uhidev0: 8 variable keys, 6 key codes wskbd1 at ukbd0 mux 1 wskbd1: connecting to wsdisplay0 vscsi0 at root scsibus2 at vscsi0: 256 targets softraid0 at root scsibus3 at softraid0: 256 targets sd0 at scsibus3 targ 1 lun 0: <OPENBSD, SR RAID 1, 005> SCSI2 0/direct fixed sd0: 476937MB, 512 bytes/sector, 976767473 sectors root on sd0a (3dcb2e904841c164.a) swap on sd0b dump on sd0b sd1 at scsibus3 targ 2 lun 0: <OPENBSD, SR CRYPTO, 005> SCSI2 0/direct fixed sd1: 474874MB, 512 bytes/sector, 972542448 sectors wskbd1: disconnecting from wsdisplay0 wskbd1 detached ukbd0 detached uhidev0 detached uhub3 detached