I would raise it far more, since you're at 60-something percent when you peak at 22k.
2013/2/26 Peter Farmer <pfarmer...@gmail.com>: > Thanks Vadim, with "set limit state 30000" I now see the states balloon > upto nearly 22000 states at peak, and no more "state up -> down". > > > Peter > > > On 26 February 2013 17:41, Vadim Zhukov <persg...@gmail.com> wrote: > >> 26.02.2013 20:06 пользователь "Peter Farmer" <pfarmer...@gmail.com> >> написал: >> >> > >> > Hi All, >> > >> > Whilst load testing my website (being balanced via relayd) I see this >> from >> > time to time (when running "relayd -d"): >> > >> > relay www, session 2410 (1 active), 0, 195.143.230.243 -> 10.201.0.7:80, >> > done >> > relay www, session 3479 (1 active), 0, 195.143.230.242 -> 10.201.0.6:80, >> > done >> > relay www, session 2411 (1 active), 0, 195.143.230.243 -> 10.201.0.6:80, >> > done >> > relay www, session 3480 (1 active), 0, 195.143.230.242 -> 10.201.0.7:80, >> > done >> > host 10.201.0.6, check http code (0ms), state up -> down, availability >> > 92.31% >> > host 10.201.0.7, check http code (0ms), state up -> down, availability >> > 84.62% >> > relay www, session 2412 (1 active), 0, 195.143.230.242 -> :80, session >> > failed >> > relay www, session 2413 (1 active), 0, 195.143.230.243 -> :80, session >> > failed >> > relay www, session 2414 (1 active), 0, 195.143.230.242 -> :80, session >> > failed >> > >> > I also periodically see: >> > >> > relay www, session 1609 (1 active), 0, 195.143.230.243 -> 10.201.0.6:80, >> > session failed >> > >> > I know that the webservers are available because I also have a tests >> > running against each of the webservers and can see they are available all >> > the time. >> > >> > Should I be adding something to relayd.conf or should I be tuning OpenBSD >> > is anyway? There are typically between 6000 - 9000 states in the state >> > table during the test. >> >> And default PF limit is 10000. Too close to be safe. Try to set it in >> pf.conf to, e.g., 30000 first. >> >> > The ab command I am running is: >> > >> > ab -v -c100 -n100000 http://beta.digidayoff.com/ >> > >> > My relayd conf is: >> > >> > ext_addr="10.201.0.3" >> > www1="10.201.0.6" >> > www2="10.201.0.7" >> > >> > log all >> > >> > table <webhosts> { $www1 $www2 } >> > relay www { >> > listen on $ext_addr port http >> > forward to <webhosts> port http mode roundrobin check http "/" code >> 200 >> > } >> > >> > >> > My pf.conf is: >> > >> > set skip on lo >> > anchor "relayd/*" >> > pass quick on em1 proto pfsync keep state (no-sync) >> > pass on em1 proto carp keep state >> > pass # to establish keep-state >> > # By default, do not permit remote connections to X11 >> > block in on ! lo0 proto tcp to port 6000:6010 >> > >> > >> > dmesg: >> > >> > OpenBSD 5.2 (GENERIC) #309: Wed Aug 1 09:58:55 MDT 2012 >> > dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC >> > real mem = 535756800 (510MB) >> > avail mem = 499208192 (476MB) >> > mainbus0 at root >> > bios0 at mainbus0: SMBIOS rev. 2.4 @ 0xe0010 (268 entries) >> > bios0: vendor Phoenix Technologies LTD version "6.00" date 09/21/2011 >> > bios0: VMware, Inc. VMware Virtual Platform >> > acpi0 at bios0: rev 2 >> > acpi0: sleep states S0 S1 S4 S5 >> > acpi0: tables DSDT FACP BOOT APIC MCFG SRAT HPET WAET >> > acpi0: wakeup devices PCI0(S3) USB_(S1) P2P0(S3) S1F0(S3) S2F0(S3) >> S3F0(S3) >> > S4F0(S3) S5F0(S3) S6F0(S3) S7F0(S3) S8F0(S3) S9F0(S3) Z00S(S3) Z00T(S3) >> > Z00U(S3) Z00V(S3) Z00W(S3) Z00X(S3) Z00Y(S3) Z00Z(S3) Z010(S3) Z011(S3) >> > Z012(S3) Z013(S3) Z014(S3) Z015(S3) Z016(S3) Z017(S3) Z018(S3) Z019(S3) >> > Z01A(S3) Z01B(S3) Z01C(S3) Z01D(S3) Z01E(S3) P2P1(S3) S1F0(S3) S2F0(S3) >> > S3F0(S3) S4F0(S3) S5F0(S3) S6F0(S3) S7F0(S3) S8F0(S3) S9F0(S3) Z00S(S3) >> > Z00T(S3) Z00U(S3) Z00V(S3) Z00W(S3) Z00X(S3) Z00Y(S3) Z00Z(S3) Z010(S3) >> > Z011(S3) Z012(S3) Z013(S3) Z014(S3) Z015(S3) Z016(S3) Z017(S3) Z018(S3) >> > Z019(S3) Z01A(S3) Z01B(S3) Z01C(S3) Z01D(S3) Z01E(S3) P2P2(S3) S1F0(S3) >> > S2F0(S3) S3F0(S3) S4F0(S3) S5F0(S3) S6F0(S3) S7F0(S3) S8F0(S3) S9F0(S3) >> > Z00S(S3) Z00T(S3) Z00U(S3) Z00V(S3) Z00W(S3) Z00X(S3) Z00Y(S3) Z00Z(S3) >> > Z010(S3) Z011(S3) Z012(S3) Z013(S3) Z014(S3) Z015(S3) Z016(S3) Z017(S3) >> > Z018(S3) Z019(S3) Z01A(S3) Z01B(S3) Z01C(S3) Z01D(S3) Z01E(S3) P2P3(S3) >> > S1F0(S3) S2F0(S3) S3F0(S3) S4F0(S3) S5F0(S3) S6F0(S3) S7F0(S3) S8F0(S3) >> > S9F0(S3) Z00S(S3) Z00T(S3) Z00U(S3) Z00V(S3) Z00W(S3) Z00X(S3) Z00Y(S3) >> > Z00Z(S3) Z010(S3) Z011(S3) Z012(S3) Z013(S3) Z014(S3) Z015(S3) Z016(S3) >> > Z017(S3) Z018(S3) Z019(S3) Z01A(S3) Z01B(S3) Z01C(S3) Z01D(S3) Z01E(S3) >> > PE40(S3) S1F0(S3) PE50(S3) S1F0(S3) PE60(S3) S1F0(S3) PE70(S3) S1F0(S3) >> > PE80(S3) S1F0(S3) PE90(S3) S1F0(S3) PEA0(S3) S1F0(S3) PEB0(S3) S1F0(S3) >> > PEC0(S3) S1F0(S3) PED0(S3) S1F0(S3) PEE0(S3) S1F0(S3) PE41(S3) S1F0(S3) >> > PE42(S3) S1F0(S3) PE43(S3) S1F0(S3) PE44(S3) S1F0(S3) PE45(S3) S1F0(S3) >> > PE46(S3) S1F0(S3) PE47(S3) S1F0(S3) PE51(S3) S1F0(S3) PE52(S3) S1F0(S3) >> > PE53(S3) S1F0(S3) PE54(S3) S1F0(S3) PE55(S3) S1F0(S3) PE56(S3) S1F0(S3) >> > PE57(S3) S1F0(S3) PE61(S3) S1F0(S3) PE62(S3) S1F0(S3) PE63(S3) S1F0(S3) >> > PE64(S3) S1F0(S3) PE65(S3) S1F0(S3) PE66(S3) S1F0(S3) PE67(S3) S1F0(S3) >> > PE71(S3) S1F0(S3) PE72(S3) S1F0(S3) PE73(S3) S1F0(S3) PE74(S3) S1F0(S3) >> > PE75(S3) S1F0(S3) PE76(S3) S1F0(S3) PE77(S3) S1F0(S3) PE81(S3) S1F0(S3) >> > PE82(S3) S1F0(S3) PE83(S3) S1F0(S3) PE84(S3) S1F0(S3) PE85(S3) S1F0(S3) >> > PE86(S3) S1F0(S3) PE87(S3) S1F0(S3) PE91(S3) S1F0(S3) PE92(S3) S1F0(S3) >> > PE93(S3) S1F0(S3) PE94(S3) S1F0(S3) PE95(S3) S1F0(S3) PE96(S3) S1F0(S3) >> > PE97(S3) S1F0(S3) PEA1(S3) S1F0(S3) PEA2(S3) S1F0(S3) PEA3(S3) S1F0(S3) >> > PEA4(S3) S1F0(S3) PEA5(S3) S1F0(S3) PEA6(S3) S1F0(S3) PEA7(S3) S1F0(S3) >> > PEB1(S3) S1F0(S3) PEB2(S3) S1F0(S3) PEB3(S3) S1F0(S3) PEB4(S3) S1F0(S3) >> > PEB5(S3) S1F0(S3) PEB6(S3) S1F0(S3) PEB7(S3) S1F0(S3) SLPB(S4) LID_(S4) >> > acpitimer0 at acpi0: 3579545 Hz, 24 bits >> > acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat >> > cpu0 at mainbus0: apid 0 (boot processor) >> > cpu0: Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz, 2199.31 MHz >> > cpu0: >> > >> > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS > H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,SSE3,PCLMUL,SSSE3,CX16,SSE4.1,SSE4.2,POPCNT,AE > S,XSAVE,AVX,NXE,LONG,LAHF >> > cpu0: 256KB 64b/line 8-way L2 cache >> > cpu0: apic clock running at 65MHz >> > ioapic0 at mainbus0: apid 1 pa 0xfec00000, version 11, 24 pins >> > acpimcfg0 at acpi0 addr 0xe0000000, bus 0-255 >> > acpihpet0 at acpi0: 14318179 Hz >> > acpiprt0 at acpi0: bus 0 (PCI0) >> > acpicpu0 at acpi0 >> > acpibat0 at acpi0: BAT1 not present >> > acpibat1 at acpi0: BAT2 not present >> > acpiac0 at acpi0: AC unit online >> > acpibtn0 at acpi0: SLPB >> > acpibtn1 at acpi0: LID_ >> > vmt0 at mainbus0 >> > pci0 at mainbus0 bus 0 >> > pchb0 at pci0 dev 0 function 0 "Intel 82443BX AGP" rev 0x01 >> > ppb0 at pci0 dev 1 function 0 "Intel 82443BX AGP" rev 0x01 >> > pci1 at ppb0 bus 1 >> > pcib0 at pci0 dev 7 function 0 "Intel 82371AB PIIX4 ISA" rev 0x08 >> > pciide0 at pci0 dev 7 function 1 "Intel 82371AB IDE" rev 0x01: DMA, >> channel >> > 0 configured to compatibility, channel 1 configured to compatibility >> > wd0 at pciide0 channel 0 drive 0: <VMware Virtual IDE Hard Drive> >> > wd0: 64-sector PIO, LBA, 10240MB, 20971520 sectors >> > wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2 >> > pciide0: channel 1 disabled (no drives) >> > piixpm0 at pci0 dev 7 function 3 "Intel 82371AB Power" rev 0x08: SMBus >> > disabled >> > "VMware Virtual Machine Communication Interface" rev 0x10 at pci0 dev 7 >> > function 7 not configured >> > vga1 at pci0 dev 15 function 0 "VMware Virtual SVGA II" rev 0x00 >> > wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) >> > wsdisplay0: screen 1-5 added (80x25, vt100 emulation) >> > mpi0 at pci0 dev 16 function 0 "Symbios Logic 53c1030" rev 0x01: apic 1 >> int >> > 17 >> > scsibus0 at mpi0: 16 targets, initiator 7 >> > ppb1 at pci0 dev 17 function 0 "VMware Virtual PCI-PCI" rev 0x02 >> > pci2 at ppb1 bus 2 >> > em0 at pci2 dev 0 function 0 "Intel PRO/1000MT (82545EM)" rev 0x01: apic >> 1 >> > int 18, address 00:50:56:1c:97:1e >> > em1 at pci2 dev 1 function 0 "Intel PRO/1000MT (82545EM)" rev 0x01: apic >> 1 >> > int 19, address 00:50:56:29:92:bb >> > ppb2 at pci0 dev 21 function 0 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci3 at ppb2 bus 3 >> > ppb3 at pci0 dev 21 function 1 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci4 at ppb3 bus 4 >> > ppb4 at pci0 dev 21 function 2 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci5 at ppb4 bus 5 >> > ppb5 at pci0 dev 21 function 3 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci6 at ppb5 bus 6 >> > ppb6 at pci0 dev 21 function 4 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci7 at ppb6 bus 7 >> > ppb7 at pci0 dev 21 function 5 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci8 at ppb7 bus 8 >> > ppb8 at pci0 dev 21 function 6 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci9 at ppb8 bus 9 >> > ppb9 at pci0 dev 21 function 7 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci10 at ppb9 bus 10 >> > ppb10 at pci0 dev 22 function 0 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci11 at ppb10 bus 11 >> > ppb11 at pci0 dev 22 function 1 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci12 at ppb11 bus 12 >> > ppb12 at pci0 dev 22 function 2 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci13 at ppb12 bus 13 >> > ppb13 at pci0 dev 22 function 3 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci14 at ppb13 bus 14 >> > ppb14 at pci0 dev 22 function 4 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci15 at ppb14 bus 15 >> > ppb15 at pci0 dev 22 function 5 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci16 at ppb15 bus 16 >> > ppb16 at pci0 dev 22 function 6 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci17 at ppb16 bus 17 >> > ppb17 at pci0 dev 22 function 7 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci18 at ppb17 bus 18 >> > ppb18 at pci0 dev 23 function 0 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci19 at ppb18 bus 19 >> > ppb19 at pci0 dev 23 function 1 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci20 at ppb19 bus 20 >> > ppb20 at pci0 dev 23 function 2 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci21 at ppb20 bus 21 >> > ppb21 at pci0 dev 23 function 3 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci22 at ppb21 bus 22 >> > ppb22 at pci0 dev 23 function 4 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci23 at ppb22 bus 23 >> > ppb23 at pci0 dev 23 function 5 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci24 at ppb23 bus 24 >> > ppb24 at pci0 dev 23 function 6 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci25 at ppb24 bus 25 >> > ppb25 at pci0 dev 23 function 7 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci26 at ppb25 bus 26 >> > ppb26 at pci0 dev 24 function 0 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci27 at ppb26 bus 27 >> > ppb27 at pci0 dev 24 function 1 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci28 at ppb27 bus 28 >> > ppb28 at pci0 dev 24 function 2 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci29 at ppb28 bus 29 >> > ppb29 at pci0 dev 24 function 3 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci30 at ppb29 bus 30 >> > ppb30 at pci0 dev 24 function 4 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci31 at ppb30 bus 31 >> > ppb31 at pci0 dev 24 function 5 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci32 at ppb31 bus 32 >> > ppb32 at pci0 dev 24 function 6 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci33 at ppb32 bus 33 >> > ppb33 at pci0 dev 24 function 7 "VMware Virtual PCIE-PCIE" rev 0x01 >> > pci34 at ppb33 bus 34 >> > isa0 at pcib0 >> > isadma0 at isa0 >> > com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo >> > com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo >> > pckbc0 at isa0 port 0x60/5 >> > pckbd0 at pckbc0 (kbd slot) >> > pckbc0: using irq 1 for kbd slot >> > wskbd0 at pckbd0: console keyboard, using wsdisplay0 >> > pms0 at pckbc0 (aux slot) >> > pckbc0: using irq 12 for aux slot >> > wsmouse0 at pms0 mux 0 >> > pcppi0 at isa0 port 0x61 >> > spkr0 at pcppi0 >> > lpt0 at isa0 port 0x378/4 irq 7 >> > fdc0 at isa0 port 0x3f0/6 irq 6 drq 2 >> > mtrr: Pentium Pro MTRR support >> > vscsi0 at root >> > scsibus1 at vscsi0: 256 targets >> > softraid0 at root >> > scsibus2 at softraid0: 256 targets >> > root on wd0a (7e2867c9d162711b.a) swap on wd0b dump on wd0b >> > >> > >> > >> > Thanks, >> > >> > Peter > -- May the most significant bit of your life be positive.
