> -----Original Message-----
> From: Jeremy Chadwick [mailto:[EMAIL PROTECTED]
> Sent: Tuesday, August 05, 2008 8:25 AM
> To: Igor V. Ruzanov
> Cc: Vinny Abello; [EMAIL PROTECTED]; [email protected]
> Subject: Re: Query timeouts on FreeBSD 7 over network
>
> On Tue, Aug 05, 2008 at 03:04:50PM +0400, Igor V. Ruzanov wrote:
> >> I've tried with the ULE scheduler and 4BSD and tried with and with
> >> out PREEMPTION turned on. Nothing makes a difference.
> > First of all you could try to connect only two machines via cross-
> over
> > cable, no any switches between the machines, no any VLANs and so on.
> > FreeBSD-7.0 works better with ULE-scheduler and kernel should be
> > preemtive (options PREEMPTION in kernel config).
> > - what is your kernel config?
> >
> >> I'm pretty sure this is related to the OS or the em driver in some
> way, because if I disable all ICMP rate limiting and run an extended
> ping from the local firewall, I experience a very low amount of random
> packet loss in no pattern, unlike if you have the ICMP rate limiting
> enabled.
>
> I believe -stable just got added to this thread, so I'm not sure if
> these details were provided prior. My apologies if this stuff has
> already been dealt with.
>
> 1) Are there any messages from the kernel about watchdog timeouts or
> other anomalies pertaining to the network? Look in dmesg.
Nothing I have noticed. I keep checking for errors by using dmesg or just
checking the console, but nothing out of the ordinary.
>
> 2) pciconf -lv (only include the Ethernet entries please), vmstat -i
> and netstat -in output.
rns1# pciconf -lv
[EMAIL PROTECTED]:0:0:0: class=0x060000 card=0x016d1028 chip=0x35908086
rev=0x09
hdr=0x00
vendor = 'Intel Corporation'
device = 'E7520 Server Memory Controller Hub'
class = bridge
subclass = HOST-PCI
[EMAIL PROTECTED]:0:2:0: class=0x060400 card=0x00000000 chip=0x35958086
rev=0x09
hdr=0x01
vendor = 'Intel Corporation'
device = 'E752x Memory Controller Hub PCIe Port A0'
class = bridge
subclass = PCI-PCI
[EMAIL PROTECTED]:0:4:0: class=0x060400 card=0x00000000 chip=0x35978086
rev=0x09
hdr=0x01
vendor = 'Intel Corporation'
device = 'E752x Memory Controller Hub PCIe Port B0'
class = bridge
subclass = PCI-PCI
[EMAIL PROTECTED]:0:5:0: class=0x060400 card=0x00000000 chip=0x35988086
rev=0x09
hdr=0x01
vendor = 'Intel Corporation'
device = 'E752x Memory Controller Hub PCIe Port B1'
class = bridge
subclass = PCI-PCI
[EMAIL PROTECTED]:0:6:0: class=0x060400 card=0x00000000 chip=0x35998086
rev=0x09
hdr=0x01
vendor = 'Intel Corporation'
device = 'E752x Memory Controller Hub PCIe Port C0'
class = bridge
subclass = PCI-PCI
[EMAIL PROTECTED]:0:29:0: class=0x0c0300 card=0x016d1028 chip=0x24d28086
rev=0x02
hdr=0x00
vendor = 'Intel Corporation'
device = '82801EB/ER (ICH5/ICH5R) USB UHCI Controller'
class = serial bus
subclass = USB
[EMAIL PROTECTED]:0:29:1: class=0x0c0300 card=0x016d1028 chip=0x24d48086
rev=0x02
hdr=0x00
vendor = 'Intel Corporation'
device = '82801EB/ER (ICH5/ICH5R) USB UHCI Controller'
class = serial bus
subclass = USB
[EMAIL PROTECTED]:0:29:2: class=0x0c0300 card=0x016d1028 chip=0x24d78086
rev=0x02
hdr=0x00
vendor = 'Intel Corporation'
device = '82801EB/ER (ICH5/ICH5R) USB UHCI Controller'
class = serial bus
subclass = USB
[EMAIL PROTECTED]:0:29:7: class=0x0c0320 card=0x016d1028 chip=0x24dd8086
rev=0x02
hdr=0x00
vendor = 'Intel Corporation'
device = '82801EB/ER (ICH5/ICH5R) USB 2.0 EHCI Controller'
class = serial bus
subclass = USB
[EMAIL PROTECTED]:0:30:0: class=0x060400 card=0x00000000 chip=0x244e8086
rev=0xc2
hdr=0x01
vendor = 'Intel Corporation'
device = '82801 Family (ICH2/3/4/4/5/5/6/7/8/9,63xxESB) Hub Interface
to
PCI Bridge'
class = bridge
subclass = PCI-PCI
[EMAIL PROTECTED]:0:31:0: class=0x060100 card=0x00000000 chip=0x24d08086
rev=0x02
hdr=0x00
vendor = 'Intel Corporation'
device = '82801EB/ER (ICH5/ICH5R) LPC Interface Bridge'
class = bridge
subclass = PCI-ISA
[EMAIL PROTECTED]:0:31:1: class=0x01018a card=0x016d1028 chip=0x24db8086
rev=0x02
hdr=0x00
vendor = 'Intel Corporation'
device = '82801EB/ER (ICH5/ICH5R) EIDE Controller'
class = mass storage
subclass = ATA
[EMAIL PROTECTED]:1:0:0: class=0x060400 card=0x00000000 chip=0x03308086
rev=0x06
hdr=0x01
vendor = 'Intel Corporation'
device = '80332 [Dobson] I/O processor A-segment Bridge'
class = bridge
subclass = PCI-PCI
[EMAIL PROTECTED]:1:0:2: class=0x060400 card=0x00000000 chip=0x03328086
rev=0x06
hdr=0x01
vendor = 'Intel Corporation'
device = '80332 [Dobson] I/O processor B-segment Bridge'
class = bridge
subclass = PCI-PCI
[EMAIL PROTECTED]:2:14:0: class=0x010400 card=0x016d1028 chip=0x00131028
rev=0x06
hdr=0x00
vendor = 'Dell Computer Corporation'
device = 'PERC 4e/Si and PERC 4e/Di Expandable RAID Controller'
class = mass storage
subclass = RAID
[EMAIL PROTECTED]:5:0:0: class=0x060400 card=0x00000000 chip=0x03298086
rev=0x09
hdr=0x01
vendor = 'Intel Corporation'
device = '6700PXH PCI Express-to-PCI Express Bridge A'
class = bridge
subclass = PCI-PCI
[EMAIL PROTECTED]:5:0:2: class=0x060400 card=0x00000000 chip=0x032a8086
rev=0x09
hdr=0x01
vendor = 'Intel Corporation'
device = '6700PXH PCI Express-to-PCI Express Bridge B'
class = bridge
subclass = PCI-PCI
[EMAIL PROTECTED]:6:7:0: class=0x020000 card=0x016d1028 chip=0x10768086
rev=0x05 hdr=0x00
vendor = 'Intel Corporation'
device = '82541EI Gigabit Ethernet Controller'
class = network
subclass = ethernet
[EMAIL PROTECTED]:7:8:0: class=0x020000 card=0x016d1028 chip=0x10768086
rev=0x05 hdr=0x00
vendor = 'Intel Corporation'
device = '82541EI Gigabit Ethernet Controller'
class = network
subclass = ethernet
[EMAIL PROTECTED]:8:0:0: class=0x060400 card=0x00000000 chip=0x03298086
rev=0x09
hdr=0x01
vendor = 'Intel Corporation'
device = '6700PXH PCI Express-to-PCI Express Bridge A'
class = bridge
subclass = PCI-PCI
[EMAIL PROTECTED]:8:0:2: class=0x060400 card=0x00000000 chip=0x032a8086
rev=0x09
hdr=0x01
vendor = 'Intel Corporation'
device = '6700PXH PCI Express-to-PCI Express Bridge B'
class = bridge
subclass = PCI-PCI
[EMAIL PROTECTED]:11:13:0: class=0x030000 card=0x016d1028 chip=0x51591002
rev=0x00
hdr=0x00
vendor = 'ATI Technologies Inc'
device = 'RV100 Radeon 7000 / Radeon VE'
class = display
subclass = VGA
rns1# vmstat -i
interrupt total rate
irq1: atkbd0 2 0
irq6: fdc0 10 0
irq14: ata0 58 0
irq18: uhci2 354670 9
irq23: ehci0 3 0
irq46: amr0 299008 8
irq64: em0 265437 7
cpu0: timer 69997281 1967
cpu1: timer 70001365 1967
Total 140917834 3961
rns1# netstat -in
Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll
em0 1500 <Link#1> 00:11:43:eb:fa:3c 245493 0 55953 0 0
em0 1500 216.182.1.0/2 216.182.1.160 134425 - 55463 - -
em1* 1500 <Link#2> 00:11:43:eb:fa:3d 0 0 0 0 0
lo0 16384 <Link#3> 59 0 59 0 0
lo0 16384 fe80:3::1/64 fe80:3::1 0 - 0 - -
lo0 16384 ::1/128 ::1 0 - 0 - -
lo0 16384 127.0.0.0/8 127.0.0.1 59 - 59 - -
> 3) Try disabling MSI/MSI-X via /boot/loader.conf variables (you'll
> need to reboot after this):
> hw.pci.enable_msi="0"
> hw.pci.enable_msix="0"
No luck... Still seeing the problem.
>
> 4) Disabling TSO on the interface, and in the OS:
> ifconfig emXX -tso
> sysctl net.inet.tcp.tso=0
No change here either, unfortunately.
Any other suggestions based on the above information? Just to make sure I don't
have defective hardware, I'm going to move my RAID set to a completely
different 2850 chassis.
>
> --
> | Jeremy Chadwick jdc at parodius.com |
> | Parodius Networking http://www.parodius.com/ |
> | UNIX Systems Administrator Mountain View, CA, USA |
> | Making life hard for others since 1977. PGP: 4BD6C0CB |
