W dniu 2011-03-05 21:24, Manuel Guesdon pisze:
On Sat, 5 Mar 2011 22:09:51 +0900
Ryan McBride<mcbr...@openbsd.org> wrote:
| On Fri, Feb 25, 2011 at 08:40:10PM +0100, Manuel Guesdon wrote:
|> "systat -s 2 vmstat":
|>
|> 3.2%Int 0.1%Sys 0.0%Usr 0.0%Nic 96.8%Idle
|> | | | | | | | | | | |
|
| The numbers presented here are calculated against the sum of your CPUs.
| Since you are running bsd.mp with hyperthreading turned on, your machine
| has "16" CPUs; each CPU accounts for about 6% of the total available so
| the "3.2%Int" value in your systat vmstat means that you have one cpu
| (the only one that is actually working in the kernel) about 50% in
| interrupt context.
|
| The exact behaviour varies from hardware to hardware, but it's not
| surprising that you start losing packets at this level of load.
OK. Understood. Thank you. I'll try SP kernel with mulithread disabled as soon
as I can and make some tests.
Manuel
--
______________________________________________________________________
Manuel Guesdon - OXYMIUM
Hello,
Because lately some people wrote to the group about network bandwidth
problems with em(4) i have run some test myself.
On the same hardware i have run tests on Debian and OpenBSD.
It seems, there might be something in OpenBSD that slows bandwidth on
gbit NICs.
Below detailed info.
I can run some more tests if someone push me in the wright direction ;)
----------------------------------------------
TEST BOX:
Mainbord: Intel D955XBK
CPU: Pentium 4 3GHz, HT disabled
LAN 1 (integrated): Gigabit (10/100/1000 Mbits/sec) LAN subsystem using
the Intel. 82573E/82573V/82574V Gigabit Ethernet Controller
LAN 2 (pcie x4): HP NC380T PCI-E x4 Dual Port Multifunction Gigabit
Server NIC
HDD1: OpenBSD 4.8 i386, pf disabled
HDD2: Debian 6.0 i386
bandwidth test by IPERF and NETPERF:
iperf -c 10.0.0.X -t 60 -i 5
netperf -H 10.0.0.X -p 9192 -n1 -l 10
----------------------------------------------
DMESG OpenBSD 4.8 CD INSTALL:
cpu0: Intel(R) Pentium(R) 4 CPU 3.00GHz ("GenuineIntel" 686-class) 3.01 GHz
cpu0: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,
PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,
DS-CPL,EST,CNXT-ID,CX16,xTPR
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: apic clock running at 200MHz
cpu at mainbus0: not configured
acpicpu0 at acpi0: FVS, 3000, 2800 MHz
bnx0 at pci3 dev 4 function 0 "Broadcom BCM5706" rev 0x02: apic 2 int 16
(irq 11)
brgphy0 at bnx0 phy 1: BCM5706 10/100/1000baseT/SX PHY, rev. 2
em0 at pci6 dev 0 function 0 "Intel PRO/1000MT (82573E)" rev 0x03: apic
2 int 17 (irq 10)
--
DMESG Debian 6.0:
Linux version 2.6.32-5-686 (Debian 2.6.32-30)
CPU0: Intel(R) Pentium(R) 4 CPU 3.00GHz stepping 03
e1000e 0000:04:00.0: irq 28 for MSI/MSI-X
e1000e: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
Broadcom NetXtreme II Gigabit Ethernet Driver bnx2 v2.0.2 (Aug 21, 2009)
eth0: Broadcom NetXtreme II BCM5706 1000Base-T (A2) PCI-X 64-bit 100MHz
found at mem 24000000, IRQ 16
eth1: Broadcom NetXtreme II BCM5706 1000Base-T (A2) PCI-X 64-bit 100MHz
found at mem 22000000, IRQ 17
lspci:
Ethernet controller: Broadcom Corporation NetXtreme II BCM5706 Gigabit
Ethernet (rev 02)
Ethernet controller: Broadcom Corporation NetXtreme II BCM5706 Gigabit
Ethernet (rev 02)
Ethernet controller: Intel Corporation 82573V Gigabit Ethernet
Controller (Copper) (rev 03)
----------------------------------------------
test 1a @ bnx0 (pcie x4): iperf from OpenBSD 4.8 -> Debian 6.0
[ 3] 45.0-50.0 sec 236 MBytes 395 Mbits/sec
[ ID] Interval Transfer Bandwidth
[ 3] 50.0-55.0 sec 236 MBytes 396 Mbits/sec
[ ID] Interval Transfer Bandwidth
[ 3] 55.0-60.0 sec 236 MBytes 396 Mbits/sec
[ ID] Interval Transfer Bandwidth
[ 3] 0.0-60.0 sec 2.76 GBytes 396 Mbits/sec
load averages: 0.42, 0.27, 0.18 rlw.local.kig
12:07:09
22 processes: 1 running, 20 idle, 1 on processor
CPU states: 0.0% user, 0.0% nice, 33.1% system, 22.2% interrupt, 44.7%
idle
Memory: Real: 9060K/46M act/tot Free: 445M Swap: 0K/764M used/tot
--
test 1b @ bnx0 (pcie x4): netperf from OpenBSD 4.8 -> OpenBSD 4.8
Recv Send Send
Socket Socket Message Elapsed
Size Size Size Time Throughput
bytes bytes bytes secs. 10^6bits/sec
16384 16384 16384 10.25 453.33
load averages: 0.51, 0.19, 0.07 rlw.local.kig
14:55:05
24 processes: 23 idle, 1 on processor
CPU states: 0.2% user, 0.0% nice, 45.1% system, 33.7% interrupt, 21.0%
idle
Memory: Real: 8672K/37M act/tot Free: 454M Swap: 0K/764M used/tot
PID USERNAME PRI NICE SIZE RES STATE WAIT TIME CPU COMMAND
18327 root 2 0 396K 812K sleep netio 0:04 15.48% netperf
----------------------------------------------
test 2a @ em0 (integrated): iperf from OpenBSD 4.8 -> Debian 6.0
[ ID] Interval Transfer Bandwidth
[ 3] 30.0-35.0 sec 252 MBytes 423 Mbits/sec
[ ID] Interval Transfer Bandwidth
[ 3] 35.0-40.0 sec 252 MBytes 423 Mbits/sec
[ ID] Interval Transfer Bandwidth
[ 3] 40.0-45.0 sec 252 MBytes 423 Mbits/sec
load averages: 0.62, 0.21, 0.08 rlw.local.kig
12:15:45
24 processes: 1 running, 22 idle, 1 on processor
CPU states: 0.2% user, 0.0% nice, 36.1% system, 24.4% interrupt, 39.3%
idle
Memory: Real: 9064K/38M act/tot Free: 453M Swap: 0K/764M used/tot
--
test 2b @ em0 (integrated): netperf from OpenBSD 4.8 -> OpenBSD 4.8
Recv Send Send
Socket Socket Message Elapsed
Size Size Size Time Throughput
bytes bytes bytes secs. 10^6bits/sec
16384 16384 16384 10.14 346.33
----------------------------------------------
test 3a @ bnx0 (pcie x4): iperf from Debian 6.0 -> Debian 6.0
top - 13:20:06 up 2 min, 3 users, load average: 0.07, 0.05, 0.02
Tasks: 64 total, 1 running, 63 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.7%us, 9.0%sy, 0.0%ni, 88.4%id, 0.0%wa, 0.0%hi, 2.0%si,
0.0%st
Mem: 512256k total, 47492k used, 464764k free, 2300k buffers
Swap: 2014200k total, 0k used, 2014200k free, 21680k cached
[ 3] 15.0-20.0 sec 562 MBytes 942 Mbits/sec
[ 3] 20.0-25.0 sec 560 MBytes 940 Mbits/sec
[ 3] 25.0-30.0 sec 562 MBytes 942 Mbits/sec
--
test 3b @ bnx0 (pcie x4): netperf from Debian 6.0 -> Debian 6.0
Recv Send Send
Socket Socket Message Elapsed
Size Size Size Time Throughput
bytes bytes bytes secs. 10^6bits/sec
87380 16384 16384 10.01 940.86
----------------------------------------------
test 4a @ em0 (integrated): iperf from Debian 6.0 -> Debian 6.0
[ 3] 50.0-55.0 sec 559 MBytes 938 Mbits/sec
[ 3] 55.0-60.0 sec 557 MBytes 935 Mbits/sec
[ 3] 0.0-60.0 sec 6.54 GBytes 937 Mbits/sec
top - 12:22:13 up 1 min, 2 users, load average: 0.02, 0.02, 0.00
Tasks: 62 total, 1 running, 61 sleeping, 0 stopped, 0 zombie
Cpu(s): 1.0%us, 9.3%sy, 0.0%ni, 88.0%id, 0.0%wa, 0.0%hi, 1.7%si,
0.0%st
Mem: 512256k total, 44776k used, 467480k free, 2268k buffers
Swap: 2014200k total, 0k used, 2014200k free, 21464k cached
--
test 4b @ em0 (integrated): netperf from Debian 6.0 -> Debian 6.0
Recv Send Send
Socket Socket Message Elapsed
Size Size Size Time Throughput
bytes bytes bytes secs. 10^6bits/sec
87380 16384 16384 10.02 936.56
----------------------------------------------
best regards,
RLW
