Re: Packet Loss w/bge & BCM5703 on Dell PE2650
Abdullah Ibn Hamad Al-Marri wrote: >> I've installed an Intel Pro/100 adapter in the Dell PowerEdge 2650. This >> is an Intel 82550 chipset. The packet loss problem is completely gone >> when using this NIC in the server, so it is definitely related to the >> bge driver and this chipset BCM5703 or something else in the server. I'm >> going to try and isolate which major release this problem appeared. >> Maybe this will help isolate the change that is causing this issue for >> me. > > I still suggest you csup to stable, there are changes made to the driver :) OK, just did a cvsup to the latest RELENG_6 from today, recompiled and still have the same problem with the newer bge code, so that didn't help. :( Again, the fxp card works ok. It seems there is no easy fix for this at the moment so I may end up just sticking fxp cards in these model servers and disabling the integrated bge cards. :-/ -- Vinny Abello Network Engineer [EMAIL PROTECTED] (973)940-6100 PGP Key Fingerprint: 3BC5 9A48 FC78 03D3 82E0 E935 5325 FBCB 0100 977A Tellurian Networks - The Ultimate Internet Connection http://www.tellurian.com (888)TELLURIAN "Courage is resistance to fear, mastery of fear - not absence of fear" -- Mark Twain ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
Abdullah Ibn Hamad Al-Marri wrote: > On 5/31/07, Vinny Abello <[EMAIL PROTECTED]> wrote: >> Vinny Abello wrote: >> > Sten Daniel Soersdal wrote: >> >> Vinny Abello wrote: >> >>> Oliver Fromme wrote: >> Vinny Abello wrote: >> > I've isolated a problem which appears to be a bug causing >> packet loss >> > with FreeBSD 6.0 and later on the Dell PowerEdge 2650 servers >> and the >> > integrated Broadcom BCM5703 NICs. >> >> Have you enabled polling on the interface? >> >> I experienced a similar problem on a HP Proliant DL360 >> running 6.2-stable (RELENG_6 of a few weeks ago). >> The problem disappeared upon "ifconfig bge0 polling". >> >> Best regards >> Oliver >> >>> It appears I do not have the DEVICE_POLLING option set when I >> compiled >> >>> my kernel on my one machine and on the second I am just using the >> >>> GENERIC kernel. I'll recompile with this option set and try again and >> >>> post my results to the list. >> >>> >> >>> Thanks! >> >>> >> >> Try disabling hardware assisted checksumming. ( ifconfig bge0 -txcsum >> >> -rxcsum ). >> > >> > Thanks for the suggestion, but... >> > >> > That's actually one of the first things I tried before writing to the >> > list. No difference. >> > >> > I'm going to put an Intel Pro/100 card in shortly to see if the problem >> > goes away to be certain the issue is definitely with the integrated >> > Broadcom NICs. >> >> I've installed an Intel Pro/100 adapter in the Dell PowerEdge 2650. This >> is an Intel 82550 chipset. The packet loss problem is completely gone >> when using this NIC in the server, so it is definitely related to the >> bge driver and this chipset BCM5703 or something else in the server. I'm >> going to try and isolate which major release this problem appeared. >> Maybe this will help isolate the change that is causing this issue for >> me. >> >> -- >> >> Vinny Abello >> Network Engineer >> [EMAIL PROTECTED] >> (973)940-6100 >> PGP Key Fingerprint: 3BC5 9A48 FC78 03D3 82E0 E935 5325 FBCB 0100 977A >> >> Tellurian Networks - The Ultimate Internet Connection >> http://www.tellurian.com (888)TELLURIAN >> >> "Courage is resistance to fear, mastery of fear - not absence of fear" >> -- Mark Twain > > I still suggest you csup to stable, there are changes made to the driver :) OK, I'll try that next instead. :) Thanks! -- Vinny Abello Network Engineer [EMAIL PROTECTED] (973)940-6100 PGP Key Fingerprint: 3BC5 9A48 FC78 03D3 82E0 E935 5325 FBCB 0100 977A Tellurian Networks - The Ultimate Internet Connection http://www.tellurian.com (888)TELLURIAN "Courage is resistance to fear, mastery of fear - not absence of fear" -- Mark Twain ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
On 5/31/07, Vinny Abello <[EMAIL PROTECTED]> wrote: Vinny Abello wrote: > Sten Daniel Soersdal wrote: >> Vinny Abello wrote: >>> Oliver Fromme wrote: Vinny Abello wrote: > I've isolated a problem which appears to be a bug causing packet loss > with FreeBSD 6.0 and later on the Dell PowerEdge 2650 servers and the > integrated Broadcom BCM5703 NICs. Have you enabled polling on the interface? I experienced a similar problem on a HP Proliant DL360 running 6.2-stable (RELENG_6 of a few weeks ago). The problem disappeared upon "ifconfig bge0 polling". Best regards Oliver >>> It appears I do not have the DEVICE_POLLING option set when I compiled >>> my kernel on my one machine and on the second I am just using the >>> GENERIC kernel. I'll recompile with this option set and try again and >>> post my results to the list. >>> >>> Thanks! >>> >> Try disabling hardware assisted checksumming. ( ifconfig bge0 -txcsum >> -rxcsum ). > > Thanks for the suggestion, but... > > That's actually one of the first things I tried before writing to the > list. No difference. > > I'm going to put an Intel Pro/100 card in shortly to see if the problem > goes away to be certain the issue is definitely with the integrated > Broadcom NICs. I've installed an Intel Pro/100 adapter in the Dell PowerEdge 2650. This is an Intel 82550 chipset. The packet loss problem is completely gone when using this NIC in the server, so it is definitely related to the bge driver and this chipset BCM5703 or something else in the server. I'm going to try and isolate which major release this problem appeared. Maybe this will help isolate the change that is causing this issue for me. -- Vinny Abello Network Engineer [EMAIL PROTECTED] (973)940-6100 PGP Key Fingerprint: 3BC5 9A48 FC78 03D3 82E0 E935 5325 FBCB 0100 977A Tellurian Networks - The Ultimate Internet Connection http://www.tellurian.com (888)TELLURIAN "Courage is resistance to fear, mastery of fear - not absence of fear" -- Mark Twain I still suggest you csup to stable, there are changes made to the driver :) -- Regards, -Abdullah Ibn Hamad Al-Marri Arab Portal http://www.WeArab.Net/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
Vinny Abello wrote: > Sten Daniel Soersdal wrote: >> Vinny Abello wrote: >>> Oliver Fromme wrote: Vinny Abello wrote: > I've isolated a problem which appears to be a bug causing packet loss > with FreeBSD 6.0 and later on the Dell PowerEdge 2650 servers and the > integrated Broadcom BCM5703 NICs. Have you enabled polling on the interface? I experienced a similar problem on a HP Proliant DL360 running 6.2-stable (RELENG_6 of a few weeks ago). The problem disappeared upon "ifconfig bge0 polling". Best regards Oliver >>> It appears I do not have the DEVICE_POLLING option set when I compiled >>> my kernel on my one machine and on the second I am just using the >>> GENERIC kernel. I'll recompile with this option set and try again and >>> post my results to the list. >>> >>> Thanks! >>> >> Try disabling hardware assisted checksumming. ( ifconfig bge0 -txcsum >> -rxcsum ). > > Thanks for the suggestion, but... > > That's actually one of the first things I tried before writing to the > list. No difference. > > I'm going to put an Intel Pro/100 card in shortly to see if the problem > goes away to be certain the issue is definitely with the integrated > Broadcom NICs. I've installed an Intel Pro/100 adapter in the Dell PowerEdge 2650. This is an Intel 82550 chipset. The packet loss problem is completely gone when using this NIC in the server, so it is definitely related to the bge driver and this chipset BCM5703 or something else in the server. I'm going to try and isolate which major release this problem appeared. Maybe this will help isolate the change that is causing this issue for me. -- Vinny Abello Network Engineer [EMAIL PROTECTED] (973)940-6100 PGP Key Fingerprint: 3BC5 9A48 FC78 03D3 82E0 E935 5325 FBCB 0100 977A Tellurian Networks - The Ultimate Internet Connection http://www.tellurian.com (888)TELLURIAN "Courage is resistance to fear, mastery of fear - not absence of fear" -- Mark Twain ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
Sten Daniel Soersdal wrote: > Vinny Abello wrote: >> Oliver Fromme wrote: >>> Vinny Abello wrote: >>> > I've isolated a problem which appears to be a bug causing >>> packet loss >>> > with FreeBSD 6.0 and later on the Dell PowerEdge 2650 servers and the >>> > integrated Broadcom BCM5703 NICs. >>> >>> Have you enabled polling on the interface? >>> >>> I experienced a similar problem on a HP Proliant DL360 >>> running 6.2-stable (RELENG_6 of a few weeks ago). >>> The problem disappeared upon "ifconfig bge0 polling". >>> >>> Best regards >>>Oliver >> >> It appears I do not have the DEVICE_POLLING option set when I compiled >> my kernel on my one machine and on the second I am just using the >> GENERIC kernel. I'll recompile with this option set and try again and >> post my results to the list. >> >> Thanks! >> > > Try disabling hardware assisted checksumming. ( ifconfig bge0 -txcsum > -rxcsum ). Thanks for the suggestion, but... That's actually one of the first things I tried before writing to the list. No difference. I'm going to put an Intel Pro/100 card in shortly to see if the problem goes away to be certain the issue is definitely with the integrated Broadcom NICs. -- Vinny Abello Network Engineer [EMAIL PROTECTED] (973)940-6100 PGP Key Fingerprint: 3BC5 9A48 FC78 03D3 82E0 E935 5325 FBCB 0100 977A Tellurian Networks - The Ultimate Internet Connection http://www.tellurian.com (888)TELLURIAN "Courage is resistance to fear, mastery of fear - not absence of fear" -- Mark Twain ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
On Thu, May 31, 2007 at 06:14:15AM -0500, J.D. Bronson wrote: > What is the proper syntax for this in /etc/rc.conf? > > ifconfig_bge0="inet 192.168.1.1 -txcsum -rxcsum netmask 255.255.255.0" That should work, according to the syntax in the manpage. If it doesn't, try reversing the options (put them at the end): ifconfig_bge0="inet 192.168.1.1 netmask 255.255.255.0 -txcsum -rxcsum" -- | Jeremy Chadwickjdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
At 05:33 AM 05/31/2007, Sten Daniel Soersdal wrote: It appears I do not have the DEVICE_POLLING option set when I compiled my kernel on my one machine and on the second I am just using the GENERIC kernel. I'll recompile with this option set and try again and post my results to the list. Thanks! Try disabling hardware assisted checksumming. ( ifconfig bge0 -txcsum -rxcsum ). -- Sten Daniel Soersdal What is the proper syntax for this in /etc/rc.conf? ifconfig_bge0="inet 192.168.1.1 -txcsum -rxcsum netmask 255.255.255.0" ?? Ironically, this is also recommended under Solaris 10 for the same NIC: === If you have a bge interface (eg, SunFire V210), then you may have NAT problems with ipfilter unless you add the following to /etc/system: set ip:dohwcksum=0 This turns off hardware checksumming, which is on by default with bge interfaces. == -JD ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
Vinny Abello wrote: Oliver Fromme wrote: Vinny Abello wrote: > I've isolated a problem which appears to be a bug causing packet loss > with FreeBSD 6.0 and later on the Dell PowerEdge 2650 servers and the > integrated Broadcom BCM5703 NICs. Have you enabled polling on the interface? I experienced a similar problem on a HP Proliant DL360 running 6.2-stable (RELENG_6 of a few weeks ago). The problem disappeared upon "ifconfig bge0 polling". Best regards Oliver It appears I do not have the DEVICE_POLLING option set when I compiled my kernel on my one machine and on the second I am just using the GENERIC kernel. I'll recompile with this option set and try again and post my results to the list. Thanks! Try disabling hardware assisted checksumming. ( ifconfig bge0 -txcsum -rxcsum ). -- Sten Daniel Soersdal ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
Jeremy Chadwick wrote: > On Wed, May 30, 2007 at 02:49:42PM -0400, Vinny Abello wrote: >> All suggestions welcomed: > > Your mbuf counts look OK. I don't see anything there which looks > like a problem. If you had packet loss caused by mbuf exhaustion, > your FreeBSD console log would show something. > > I've some couple questions: > > 1) Checked console logs (dmesg -a) to see if there's anything there >which might give you hints to the problem? I'm on the console. Nothing comes up when there is packet loss. Nothing in the dmesg -a output either likewise... Interestingly, I sometimes forget to adjust the icmplim which will artificially limit the pings in my test. On 4.11, this would show the kernel is doing rate limiting. On 6.2 it does not give any indication. I do confirm that it is not being rate limited though by setting net.inet.icmp.icmplim to some high value or -1 also seems to work. > 2) Any IPMI modules installed in that Dell box? As far as I recall, IPMI support was not added to the PowerEdge servers until the 2850 which supported IPMI 1.5. This is a 2650. There are no addin IPMI cards. There is the built in DRAC controller but that does not share the NIC like happens on the 2850 and 2950 servers. It has it's own dedicated port. Interestingly it uses 3 IRQ's! I tried even switching IRQ's in the BIOS around to make sure the NIC had it's own unshared IRQ but that made no difference either. > 3) vmstat -i output? test# vmstat -i interrupt total rate irq1: atkbd04557 0 irq6: fdc010 0 irq14: ata0 47 0 irq28: bge0 304 0 irq30: aac0 2784 0 cpu0: timer 24371045 1999 Total 24378747 2000 > 4) Is there a switch between the Cisco router and the FreeBSD box? Yes, both my production setup and my test setup where I reproduced the problem. > 5) If there is a switch between the router and the FreeBSD box, have >you tried the pings from a box (not the Cisco) on the same switch >segment as the FreeBSD box? Yes, same loss. I tried from several devices on the segment and see the loss, only to the FreeBSD systems running on that specific hardware. > 6) Have you tried pings the other way (FreeBSD box -> box#2, and >box#2 -> FreeBSD box) to see if its reproducable that way? Yes, in fact that is the reason this is such a big problem. I use the production system to measure latency and packet loss, and since going to FreeBSD 6.x, it has been showing random packet loss in my data that isn't there at all. > 7) Does it only happen with ICMP traffic, or can you reproduce the loss >using something like FTP (slow transfer rates/stalls)? It's hard to say. It's definitely with ICMP. I've not noticed it with other data. I'll have to do more testing. > 8) Tried downthrottling to 100mbit (ifconfig_bge0="... media 100baseTX") >on both sides, to see if it's a gigabit-specific problem? My test system is running at 100Mb, same hardware, same problem. > 9) Tried different cabling? I see the network is gigabit. You might >try replacing the cables, preferably with CAT6. Tried changing cables, ports, port speed, switches, tried the second NIC in the system (same model as the first). The only thing I haven't done is put a third party NIC like an Intel Pro/100 in the system and try it. I'm sure it will work ok but I don't know for a fact. I can try that as a test. I have boxes of them sitting next to my desk here. Thanks for your time! :) -- Vinny Abello Network Engineer [EMAIL PROTECTED] (973)940-6100 PGP Key Fingerprint: 3BC5 9A48 FC78 03D3 82E0 E935 5325 FBCB 0100 977A Tellurian Networks - The Ultimate Internet Connection http://www.tellurian.com (888)TELLURIAN "Courage is resistance to fear, mastery of fear - not absence of fear" -- Mark Twain ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
On Wed, May 30, 2007 at 02:49:42PM -0400, Vinny Abello wrote: > All suggestions welcomed: Your mbuf counts look OK. I don't see anything there which looks like a problem. If you had packet loss caused by mbuf exhaustion, your FreeBSD console log would show something. I've some couple questions: 1) Checked console logs (dmesg -a) to see if there's anything there which might give you hints to the problem? 2) Any IPMI modules installed in that Dell box? 3) vmstat -i output? 4) Is there a switch between the Cisco router and the FreeBSD box? 5) If there is a switch between the router and the FreeBSD box, have you tried the pings from a box (not the Cisco) on the same switch segment as the FreeBSD box? 6) Have you tried pings the other way (FreeBSD box -> box#2, and box#2 -> FreeBSD box) to see if its reproducable that way? 7) Does it only happen with ICMP traffic, or can you reproduce the loss using something like FTP (slow transfer rates/stalls)? 8) Tried downthrottling to 100mbit (ifconfig_bge0="... media 100baseTX") on both sides, to see if it's a gigabit-specific problem? 9) Tried different cabling? I see the network is gigabit. You might try replacing the cables, preferably with CAT6. -- | Jeremy Chadwickjdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
security wrote: > Vinny Abello wrote: >> OK, I've enabled polling in my kernel and did ifconfig bge0 polling and >> it accepted it and shows that polling is enabled on bge0 when checking >> with ifconfig. Unfortunately, this did not resolve the packet loss issue >> I wrote about originally. I still have the same loss. :( >> >> Any other ideas? Does anyone run a PowerEdge 2650 with FreeBSD 6.0 or >> later that's on this list? >> >> Thanks! >> >> > Have you checked your buffer usage with "netstat -m"? My apologies if > this was already suggested All suggestions welcomed: 258/267/525 mbufs in use (current/cache/total) 256/134/390/25600 mbuf clusters in use (current/cache/total/max) 256/128 mbuf+clusters out of packet secondary zone in use (current/cache) 0/0/0/0 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/0 9k jumbo clusters in use (current/cache/total/max) 0/0/0/0 16k jumbo clusters in use (current/cache/total/max) 576K/334K/911K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0/4/6656 sfbufs in use (current/peak/max) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile 0 calls to protocol drain routines I'm not sure how to interpret the information or if any of it is indicating a problem where buffers need adjustment. -- Vinny Abello Network Engineer [EMAIL PROTECTED] (973)940-6100 PGP Key Fingerprint: 3BC5 9A48 FC78 03D3 82E0 E935 5325 FBCB 0100 977A Tellurian Networks - The Ultimate Internet Connection http://www.tellurian.com (888)TELLURIAN "Courage is resistance to fear, mastery of fear - not absence of fear" -- Mark Twain ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
Vinny Abello wrote: > > OK, I've enabled polling in my kernel and did ifconfig bge0 polling and > it accepted it and shows that polling is enabled on bge0 when checking > with ifconfig. Unfortunately, this did not resolve the packet loss issue > I wrote about originally. I still have the same loss. :( > > Any other ideas? Does anyone run a PowerEdge 2650 with FreeBSD 6.0 or > later that's on this list? > > Thanks! > > Have you checked your buffer usage with "netstat -m"? My apologies if this was already suggested jim ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
On 5/30/07, Vinny Abello <[EMAIL PROTECTED]> wrote: Abdullah Ibn Hamad Al-Marri wrote: > On 5/30/07, Jeremy Chadwick <[EMAIL PROTECTED]> wrote: >> On Wed, May 30, 2007 at 01:34:42PM -0400, Vinny Abello wrote: >> > Thanks for the suggestion. Either I am doing something wrong or >> ifconfig >> > doesn't understand the polling argument. I'm wondering if it is >> > supported by the driver on this chipset. >> >> You need to enable "options DEVICE_POLLING" in your kernel. >> >> See polling(4). >> >> -- >> | Jeremy Chadwickjdc at >> parodius.com | >> | Parodius Networking >> http://www.parodius.com/ | >> | UNIX Systems Administrator Mountain View, CA, >> USA | >> | Making life hard for others since 1977. PGP: >> 4BD6C0CB | >> > > I have it in my kernel, do I need to add polling in rc.conf too? OK, I've enabled polling in my kernel and did ifconfig bge0 polling and it accepted it and shows that polling is enabled on bge0 when checking with ifconfig. Unfortunately, this did not resolve the packet loss issue I wrote about originally. I still have the same loss. :( Any other ideas? Does anyone run a PowerEdge 2650 with FreeBSD 6.0 or later that's on this list? Thanks! -- Vinny Abello Network Engineer [EMAIL PROTECTED] (973)940-6100 PGP Key Fingerprint: 3BC5 9A48 FC78 03D3 82E0 E935 5325 FBCB 0100 977A Tellurian Networks - The Ultimate Internet Connection http://www.tellurian.com (888)TELLURIAN "Courage is resistance to fear, mastery of fear - not absence of fear" -- Mark Twain I saw bge code changed in RELENG_6 few days ago, I would recommend that you csup and recompile your kernel as well. -- Regards, -Abdullah Ibn Hamad Al-Marri Arab Portal http://www.WeArab.Net/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
Abdullah Ibn Hamad Al-Marri wrote: > On 5/30/07, Jeremy Chadwick <[EMAIL PROTECTED]> wrote: >> On Wed, May 30, 2007 at 01:34:42PM -0400, Vinny Abello wrote: >> > Thanks for the suggestion. Either I am doing something wrong or >> ifconfig >> > doesn't understand the polling argument. I'm wondering if it is >> > supported by the driver on this chipset. >> >> You need to enable "options DEVICE_POLLING" in your kernel. >> >> See polling(4). >> >> -- >> | Jeremy Chadwickjdc at >> parodius.com | >> | Parodius Networking >> http://www.parodius.com/ | >> | UNIX Systems Administrator Mountain View, CA, >> USA | >> | Making life hard for others since 1977. PGP: >> 4BD6C0CB | >> > > I have it in my kernel, do I need to add polling in rc.conf too? OK, I've enabled polling in my kernel and did ifconfig bge0 polling and it accepted it and shows that polling is enabled on bge0 when checking with ifconfig. Unfortunately, this did not resolve the packet loss issue I wrote about originally. I still have the same loss. :( Any other ideas? Does anyone run a PowerEdge 2650 with FreeBSD 6.0 or later that's on this list? Thanks! -- Vinny Abello Network Engineer [EMAIL PROTECTED] (973)940-6100 PGP Key Fingerprint: 3BC5 9A48 FC78 03D3 82E0 E935 5325 FBCB 0100 977A Tellurian Networks - The Ultimate Internet Connection http://www.tellurian.com (888)TELLURIAN "Courage is resistance to fear, mastery of fear - not absence of fear" -- Mark Twain ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
On 5/30/07, Jeremy Chadwick <[EMAIL PROTECTED]> wrote: On Wed, May 30, 2007 at 01:34:42PM -0400, Vinny Abello wrote: > Thanks for the suggestion. Either I am doing something wrong or ifconfig > doesn't understand the polling argument. I'm wondering if it is > supported by the driver on this chipset. You need to enable "options DEVICE_POLLING" in your kernel. See polling(4). -- | Jeremy Chadwickjdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | I have it in my kernel, do I need to add polling in rc.conf too? -- Regards, -Abdullah Ibn Hamad Al-Marri Arab Portal http://www.WeArab.Net/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
On Wed, May 30, 2007 at 01:34:42PM -0400, Vinny Abello wrote: > Thanks for the suggestion. Either I am doing something wrong or ifconfig > doesn't understand the polling argument. I'm wondering if it is > supported by the driver on this chipset. You need to enable "options DEVICE_POLLING" in your kernel. See polling(4). -- | Jeremy Chadwickjdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
Oliver Fromme wrote: > Vinny Abello wrote: > > I've isolated a problem which appears to be a bug causing packet > loss > > with FreeBSD 6.0 and later on the Dell PowerEdge 2650 servers and the > > integrated Broadcom BCM5703 NICs. > > Have you enabled polling on the interface? > > I experienced a similar problem on a HP Proliant DL360 > running 6.2-stable (RELENG_6 of a few weeks ago). > The problem disappeared upon "ifconfig bge0 polling". > > Best regards >Oliver It appears I do not have the DEVICE_POLLING option set when I compiled my kernel on my one machine and on the second I am just using the GENERIC kernel. I'll recompile with this option set and try again and post my results to the list. Thanks! -- Vinny Abello Network Engineer [EMAIL PROTECTED] (973)940-6100 PGP Key Fingerprint: 3BC5 9A48 FC78 03D3 82E0 E935 5325 FBCB 0100 977A Tellurian Networks - The Ultimate Internet Connection http://www.tellurian.com (888)TELLURIAN "Courage is resistance to fear, mastery of fear - not absence of fear" -- Mark Twain ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
Oliver Fromme wrote: > Vinny Abello wrote: > > I've isolated a problem which appears to be a bug causing packet > loss > > with FreeBSD 6.0 and later on the Dell PowerEdge 2650 servers and the > > integrated Broadcom BCM5703 NICs. > > Have you enabled polling on the interface? > > I experienced a similar problem on a HP Proliant DL360 > running 6.2-stable (RELENG_6 of a few weeks ago). > The problem disappeared upon "ifconfig bge0 polling". > > Best regards >Oliver Thanks for the suggestion. Either I am doing something wrong or ifconfig doesn't understand the polling argument. I'm wondering if it is supported by the driver on this chipset. [EMAIL PROTECTED] ~# ifconfig bge0 polling ifconfig: polling: Invalid argument [EMAIL PROTECTED] ~# ifconfig bge0 bge0: flags=8843 mtu 1500 options=1b inet 216.182.1.13 netmask 0xff00 broadcast 216.182.1.255 ether 00:0d:56:ba:73:bf media: Ethernet autoselect (1000baseTX ) status: active -- Vinny Abello Network Engineer [EMAIL PROTECTED] (973)940-6100 PGP Key Fingerprint: 3BC5 9A48 FC78 03D3 82E0 E935 5325 FBCB 0100 977A Tellurian Networks - The Ultimate Internet Connection http://www.tellurian.com (888)TELLURIAN "Courage is resistance to fear, mastery of fear - not absence of fear" -- Mark Twain ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Packet Loss w/bge & BCM5703 on Dell PE2650
Vinny Abello wrote: > I've isolated a problem which appears to be a bug causing packet loss > with FreeBSD 6.0 and later on the Dell PowerEdge 2650 servers and the > integrated Broadcom BCM5703 NICs. Have you enabled polling on the interface? I experienced a similar problem on a HP Proliant DL360 running 6.2-stable (RELENG_6 of a few weeks ago). The problem disappeared upon "ifconfig bge0 polling". Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "That's what I love about GUIs: They make simple tasks easier, and complex tasks impossible." -- John William Chambless ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Packet Loss w/bge & BCM5703 on Dell PE2650
Hello all, I've isolated a problem which appears to be a bug causing packet loss with FreeBSD 6.0 and later on the Dell PowerEdge 2650 servers and the integrated Broadcom BCM5703 NICs. I thought it was the server at first but I did a clean install of FreeBSD 6.2-RELEASE on another 2650 and see the same issue. This issue did not exist in FreeBSD 5.3 or 4.11. Going from FreeBSD 5.3 to 6.0 is when this problem was introduced. I also installed FreeBSD 6.2-RELEASE on a Dell PowerEdge 2950 and don't see any loss at all. This also uses the bge driver but it has a newer chipset, specifically the BCM5708 vs the problem I'm having with the BCM5703 on the 2650. For my tests I am running extended pings from a Cisco router on the same subnet. I have tuned net.inet.icmp.icmplim to -1 to disable ICMP rate limiting. The packet loss doesn't appear to follow any particular pattern and is generally low, but still there. Below is my dmesg output of one of the 2650's in question followed by an example of the loss I am seeing: Copyright (c) 1992-2007 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 6.2-STABLE #0: Sat Jan 27 00:37:31 EST 2007 [EMAIL PROTECTED]:/usr/obj/usr/src/sys/ENGBOX Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(TM) CPU 2.80GHz (2781.54-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf29 Stepping = 9 Features=0xbfebfbff Features2=0x4400> real memory = 4026400768 (3839 MB) avail memory = 3942182912 (3759 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 6 ioapic0: Changing APIC ID to 8 ioapic1: Changing APIC ID to 9 ioapic2: Changing APIC ID to 10 MADT: Forcing active-low polarity and level trigger for SCI ioapic0 irqs 0-15 on motherboard ioapic1 irqs 16-31 on motherboard ioapic2 irqs 32-47 on motherboard acpi0: on motherboard acpi0: Power Button (fixed) Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 cpu0: on acpi0 cpu1: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pci0: at device 4.0 (no driver attached) pci0: at device 4.1 (no driver attached) pci0: at device 4.2 (no driver attached) pci0: at device 14.0 (no driver attached) atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x17 7,0x376,0x8b0-0x8bf at device 15.1 on pci0 ata0: on atapci0 ata1: on atapci0 ohci0: mem 0xfe10-0xfe100fff irq 5 at device 15.2 on pci0 ohci0: [GIANT-LOCKED] usb0: OHCI version 1.0, legacy support usb0: SMM does not respond, resetting usb0: on ohci0 usb0: USB revision 1.0 uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 4 ports with 4 removable, self powered isab0: at device 15.3 on pci0 isa0: on isab0 pcib1: on acpi0 pci4: on pcib1 pcib2: at device 8.0 on pci4 pci5: on pcib2 aac0: mem 0xf000-0xf7ff irq 30 at device 8.1 on pci4 aac0: [FAST] aac0: Adaptec Raid Controller 2.0.0-1 pcib3: on acpi0 pci3: on pcib3 bge0: mem 0xfcf1-0xfcf1 irq 28 a t device 6.0 on pci3 miibus0: on bge0 brgphy0: on miibus0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX -FDX, auto bge0: Ethernet address: 00:0d:56:ba:73:bf bge1: mem 0xfcf0-0xfcf0 irq 29 a t device 8.0 on pci3 miibus1: on bge1 brgphy1: on miibus1 brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX -FDX, auto bge1: Ethernet address: 00:0d:56:ba:73:c1 pcib4: on acpi0 pci2: on pcib4 pcib5: on acpi0 pci1: on pcib5 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FAST] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model IntelliMouse Explorer, device ID 4 sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0 sio1: type 16550A pmtimer0 on isa0 orm0: at iomem 0xc-0xc7fff,0xc8000-0xcbfff,0xec000-0xe on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa-0xb on isa0 Timecounters tick every 1.000 msec acd0: CDROM at ata0-master UDMA33 aacd0: on aac0 aacd0: 34712MB (71091456 sectors) SMP: AP CPU #1 Launched! Trying to mount root from ufs:/dev/aacd0s1a bge0: link state changed to UP Router#ping 216.182.1.13 repeat 1000 Type escape sequence to abort. Sending 1000, 100-byte ICMP Echos to 216.182.1.13, timeout is 2 seconds: !!!
