On 13/02/10 10:39, Claudio Jeker wrote:
Update to current to get some msk fixes that should make msk(4)
faster. For high performance get a dual em(4) card since those will behave
much better (the interrupt mitigation on msk(4) is somewhat bad and causes
a 4 to 5 times higher delay).
Indeed the msk had a lot of interrupt activity. I checked with systat
and it goes up to 6K with total 10K on both NICs while having traffic.
Is that a lot?
Also netstat -i reports Ierrs only when I run iperf (not while forwarding).
The errors are on msk0 and not on the vlan61 interface.
Something funny with the vlan tagging? Switch does not report errors on
the port.
I will try on monday with a pair of DLINK cards I have spare.
Unfortunately I don't have external Intels nor a spare pc with onboard
intels.
I will also try the current or the latest snapshot of 4.7
The funny think is that low performance is only on the download side.
I reversed the iperf operation and it went up to 760Mbps
when the server uploaded to the client. However that didn't affect
packet forwarding with a max of 400Mbps.
Are there any tuning buffers for forwarding states? cause if I read
correctly
on this list recvspace and sendspace are only for local traffic (in/out).
thanks
Giannis
msk0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
lladdr 00:1b:fc:6b:3f:89
priority: 0
media: Ethernet autoselect (1000baseT full-duplex)
status: active
inet 10.0.0.1 netmask 0xffffff00 broadcast 10.0.0.255
inet6 fe80::21b:fcff:fe6b:3f89%msk0 prefixlen 64 scopeid 0x1
vlan61: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
lladdr 00:1b:fc:6b:3f:89
description: Interface on VLAN 61
priority: 0
vlan: 61 priority: 0 parent interface: msk0
groups: vlan
inet6 fe80::21b:fcff:fe6b:3f89%vlan61 prefixlen 64 scopeid 0x5
inet 10.100.61.2 netmask 0xfffffffc broadcast 10.100.61.3
Name Mtu Network Address Ipkts Ierrs Opkts
Oerrs Colls
lo0 33200 <Link> 76 0 76
0 0
lo0 33200 localhost localhost 76 0 76
0 0
lo0 33200 localhost/1 localhost 76 0 76
0 0
lo0 33200 fe80::%lo0/ fe80::1%lo0 76 0 76
0 0
msk0 1500 <Link> 00:1b:fc:6b:3f:89 11808829 43203 15628209
0 0
msk0 1500 10.0.0/24 foo 11808829 43203 15628209
0 0
msk0 1500 fe80::%msk0 fe80::21b:fcff:fe 11808829 43203 15628209
0 0
re0 1500 <Link> 00:1b:fc:6b:36:e4 9218910 0 5047882
0 0
re0 1500 192.168.1. ext-serv 9218910 0 5047882
0 0
re0 1500 fe80::%re0/ fe80::21b:fcff:fe 9218910 0 5047882
0 0
enc0* 1536 <Link> 0 0 0
0 0
vlan61 1500 <Link> 00:1b:fc:6b:3f:89 11808823 0 15628207
0 0
vlan61 1500 fe80::%vlan fe80::21b:fcff:fe 11808823 0 15628207
0 0
vlan61 1500 10.100.61.2 int-serv 11808823 0 15628207
0 0
pflog0 33200 <Link> 0 0 47
0 0
ip:
21027782 total packets received
0 bad header checksums
0 with size smaller than minimum
0 with data size < data length
0 with header length < data size
0 with data length < header length
0 with bad options
0 with incorrect version number
0 fragments received
0 fragments dropped (duplicates or out of space)
0 malformed fragments dropped
0 fragments dropped after timeout
0 packets reassembled ok
10015596 packets for this host
1 packet for unknown/unsupported protocol
11012121 packets forwarded
0 packets not forwardable
0 redirects sent
9664177 packets sent from this host
0 packets sent with fabricated ip header
0 output packets dropped due to no bufs, etc.
0 output packets discarded due to no route
0 output datagrams fragmented
0 fragments created
0 datagrams that can't be fragmented
0 fragment floods
0 packets with ip length > max ip packet size
0 tunneling packets that can't find gif
0 datagrams with bad address in header
9218806 input datagrams checksum-processed by hardware
5047879 output datagrams checksum-processed by hardware
0 multicast packets which we don't join
tcp:
9664065 packets sent
3365250 data packets (4866545502 bytes)
1 data packet (112 bytes) retransmitted
0 fast retransmitted packets
4207175 ack-only packets (4217040 delayed)
0 URG only packets
0 window probe packets
2091485 window update packets
154 control packets
1318185 packets hardware-checksummed
10015604 packets received
1591546 acks (for 4866481949 bytes)
191 duplicate acks
0 acks for unsent data
0 acks for old data
8140892 packets (11265654889 bytes) received in-sequence
22 completely duplicate packets (30544 bytes)
0 old duplicate packets
0 packets with some duplicate data (0 bytes duplicated)
282933 out-of-order packets (409345480 bytes)
0 packets (0 bytes) of data after window
0 window probes
3 window update packets
7 packets received after close
0 discarded for bad checksums
0 discarded for bad header offset fields
0 discarded because packet too short
0 discarded for missing IPsec protection
0 discarded due to memory shortage
1936182 packets hardware-checksummed
0 bad/missing md5 checksums
0 good md5 checksums
64 connection requests
71 connection accepts
96 connections established (including accepts)
224 connections closed (including 0 drops)
0 connections drained
37 embryonic connections dropped
1591571 segments updated rtt (of 454545 attempts)
3 retransmit timeouts
0 connections dropped by rexmit timeout
0 persist timeouts
0 keepalive timeouts
0 keepalive probes sent
0 connections dropped by keepalive
1293427 correct ACK header predictions
7870924 correct data packet header predictions
243 PCB cache misses
0 ECN connections accepted
0 ECE packets received
0 CWR packets received
0 CE packets received
0 ECT packets sent
0 ECE packets sent
0 CWR packets sent
cwr by fastrecovery: 6
cwr by timeout: 3
cwr by ecn: 0
0 bad connection attempts
71 SYN cache entries added
0 hash collisions
71 completed
0 aborted (no space to build PCB)
0 timed out
0 dropped due to overflow
0 dropped due to bucket overflow
0 dropped due to RST
0 dropped due to ICMP unreachable
0 SYN,ACKs retransmitted
0 duplicate SYNs received for entries already in the cache
0 SYNs dropped (no route or no space)
6 SACK recovery episodes
44 segment rexmits in SACK recovery episodes
63712 byte rexmits in SACK recovery episodes
196 SACK options received
304057 SACK options sent
