Re: Gigabit Ethernet w/Jumbo Frames
[EMAIL PROTECTED] wrote this message on Tue, Jun 26, 2007 at 17:33 -0700: I'm having poor luck trying to use NFS over a gigabit ethernet using jumbo frames. By all indications, my switch (Netgear GS608) forwards jumbo frames with no difficulty, but my Realtek 8169-based cards seem Are you sure? I just tried w/ my GS608 again, and it still doesn't pass jumbo frames... I specifically bought a second switch, an SMC 8508T so that I could work on jumbo frame support... I took my MBP to the SMC and verified that I could ping 5k packets w/o fragmentation between the two (MBP and a FreeBSD-current box w/ an em card) boxes, and then took my MBP to the Netgear, and the remote box would not see the large pings... I just checked Netgear's website, and they do list Jumbo Frame support.. Either I have an old switch and newer ones support it, or they depend upon that most people can't figure out to make jumbo frames work reliabily and depend upon people just using 1500 byte frames... -- John-Mark Gurney Voice: +1 415 225 5579 All that I will do, has been done, All that I have, has not. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Gigabit Ethernet w/Jumbo Frames
On Tue, Jun 26, 2007 at 11:12:23PM -0700, John-Mark Gurney wrote: [EMAIL PROTECTED] wrote this message on Tue, Jun 26, 2007 at 17:33 -0700: I'm having poor luck trying to use NFS over a gigabit ethernet using jumbo frames. By all indications, my switch (Netgear GS608) forwards jumbo frames with no difficulty, but my Realtek 8169-based cards seem Are you sure? I just tried w/ my GS608 again, and it still doesn't pass jumbo frames... I specifically bought a second switch, an SMC 8508T so that I could work on jumbo frame support... I took my MBP to the SMC and verified that I could ping 5k packets w/o fragmentation between the two (MBP and a FreeBSD-current box w/ an em card) boxes, and then took my MBP to the Netgear, and the remote box would not see the large pings... I just checked Netgear's website, and they do list Jumbo Frame support.. Either I have an old switch and newer ones support it, or they depend upon that most people can't figure out to make jumbo frames work reliabily and depend upon people just using 1500 byte frames... I guess re(4) should not generate watchdog errors even if intermediate switches drop/fragment jumbo frames. -- Regards, Pyun YongHyeon ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Gigabit Ethernet w/Jumbo Frames
On Tue, Jun 26, 2007 at 11:12:23PM -0700, John-Mark Gurney wrote: [EMAIL PROTECTED] wrote this message on Tue, Jun 26, 2007 at 17:33 -0700: I'm having poor luck trying to use NFS over a gigabit ethernet using jumbo frames. By all indications, my switch (Netgear GS608) forwards jumbo frames with no difficulty, but my Realtek 8169-based cards seem Are you sure? I just tried w/ my GS608 again, and it still doesn't pass jumbo frames... I specifically bought a second switch, an SMC 8508T so that I could work on jumbo frame support... I took my MBP to the SMC and verified that I could ping 5k packets w/o fragmentation between the two (MBP and a FreeBSD-current box w/ an em card) boxes, and then took my MBP to the Netgear, and the remote box would not see the large pings... I just checked Netgear's website, and they do list Jumbo Frame support.. Either I have an old switch and newer ones support it, or they depend upon that most people can't figure out to make jumbo frames work reliabily and depend upon people just using 1500 byte frames... There are (at least) two different versions of the Netgear GS608 (and some other Netgear switches.) The older ones do not support Jumbo Frames, while the newer ones are supposed to do it. See http://kbserver.netgear.com/inquira/default.asp?ui_mode=answerprior_transaction_id=5016326action_code=5highlight_info=16778279,200,201turl=http%3A%2F%2Fkbserver.netgear.com%2Fkb_web_files%2Fn101624.aspanswer_id=6141591#__highlight for some more information on the different versions of some Netgear switches. -- Insert your favourite quote here. Erik Trulsson [EMAIL PROTECTED] ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Gigabit Ethernet w/Jumbo Frames
Erik Trulsson wrote this message on Wed, Jun 27, 2007 at 10:12 +0200: On Tue, Jun 26, 2007 at 11:12:23PM -0700, John-Mark Gurney wrote: [EMAIL PROTECTED] wrote this message on Tue, Jun 26, 2007 at 17:33 -0700: I'm having poor luck trying to use NFS over a gigabit ethernet using jumbo frames. By all indications, my switch (Netgear GS608) forwards jumbo frames with no difficulty, but my Realtek 8169-based cards seem Are you sure? I just tried w/ my GS608 again, and it still doesn't pass jumbo frames... I specifically bought a second switch, an SMC 8508T so that I could work on jumbo frame support... I took my MBP to the SMC and verified that I could ping 5k packets w/o fragmentation between the two (MBP and a FreeBSD-current box w/ an em card) boxes, and then took my MBP to the Netgear, and the remote box would not see the large pings... I just checked Netgear's website, and they do list Jumbo Frame support.. Either I have an old switch and newer ones support it, or they depend upon that most people can't figure out to make jumbo frames work reliabily and depend upon people just using 1500 byte frames... There are (at least) two different versions of the Netgear GS608 (and some other Netgear switches.) The older ones do not support Jumbo Frames, while the newer ones are supposed to do it. See http://kbserver.netgear.com/inquira/default.asp?ui_mode=answerprior_transaction_id=5016326action_code=5highlight_info=16778279,200,201turl=http%3A%2F%2Fkbserver.netgear.com%2Fkb_web_files%2Fn101624.aspanswer_id=6141591#__highlight for some more information on the different versions of some Netgear switches. My serial number isn't listed there... It starts w/ GS21146, but it's around 2 years old so it's probably v1... Thanks for the link. -- John-Mark Gurney Voice: +1 415 225 5579 All that I will do, has been done, All that I have, has not. ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Gigabit Ethernet w/Jumbo Frames
Thanks to all for your suggestions! As soon as I have a chance to follow up on them (might not be for a couple of days), I'll let you known how it came out. -- George Mitchell ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Gigabit Ethernet w/Jumbo Frames
On Tue, Jun 26, 2007 at 05:33:46PM -0700, [EMAIL PROTECTED] wrote: I'm having poor luck trying to use NFS over a gigabit ethernet using jumbo frames. By all indications, my switch (Netgear GS608) forwards jumbo frames with no difficulty, but my Realtek 8169-based cards seem unreceptive to the idea, giving many watchdog timeouts and other obscure log messages. One server is amd64 and my clients are i386, but I think I've ruled that out as the problem because I see errors evern with an i386 server. So I strongly suspect my network cards at the moment. What gigabit ethernet cards do you use for reliable performance with jumbo frames?-- George Mitchell Are you setting any sysctl tunables? There have been recent reports of watchdog timeout problems with xl, bge, and em devices. I've manage to work around the timeout on bge with net.inet.tcp.sendspace=131072 net.inet.tcp.recvspace=131072 net.inet.tcp.path_mtu_discovery=0 net.inet.udp.recvspace=65536 net.inet.raw.recvspace=16384 hw.pci.enable_msix=0 hw.pci.enable_msi=0 kern.ipc.nmbclusters=5 kern.timecounter.hardware=ACPI-fast -- Steve ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Gigabit Ethernet w/Jumbo Frames
On Tue, Jun 26, 2007 at 05:33:46PM -0700, [EMAIL PROTECTED] wrote: I'm having poor luck trying to use NFS over a gigabit ethernet using jumbo frames. By all indications, my switch (Netgear GS608) forwards jumbo frames with no difficulty, but my Realtek 8169-based cards seem unreceptive to the idea, giving many watchdog timeouts and other obscure log messages. One server is amd64 and my clients are i386, but I think I've ruled that out as the problem because I see errors evern with an i386 server. So I strongly suspect my network cards at the moment. What gigabit ethernet cards do you use for reliable performance with jumbo frames?-- George Mitchell See http://lists.freebsd.org/pipermail/freebsd-current/2007-May/072845.html -- Regards, Pyun YongHyeon ___ freebsd-hackers@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-hackers To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Gigabit ethernet
On Wed, Aug 02, 2000 at 09:15:00 -0700, Josef Grosch wrote: Simple question: Which Gigabit ethernet card works best with FreeBSD? Alteon-based boards. This includes Alteon ACEnics, the 3Com 3c985B (which has 1MB SRAM), and the Netgear GA620 (which has 512K SRAM). You can get the Netgear board for about $320, and the copper version of the board for about $310 from www.necxdirect.com. The 3Com board is about $680 from the same place. (You're paying for the extra memory, which can make a difference, albeit not an enormous difference. Also, the Windows drivers for the Netgear boards don't do jumbo frames. I'm not sure whether the 3Com Windows drivers do jumbo frames, but I would guess that they do.) If you want bandwidth numbers, see: http://people.freebsd.org/~ken/zero_copy/ Ken -- Kenneth Merry [EMAIL PROTECTED] To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
RE: Gigabit ethernet
These pages should answer all of your questions. http://people.freebsd.org/~wpaul/Alteon/ http://people.freebsd.org/~wpaul/SysKonnect/ I went with the NetGear GA-620 because it was cheap. In retrospect (after talking with Bill Paul), I should have probably gone with the Alteon AceNIC or the 3com 3c985. They both have 1 MB of SRAM compared to the 512 KB in the NetGear. To quote Bill, "The Netgear card is inexpensive for a reason. :)" Charles -Original Message- From: Josef Grosch [mailto:[EMAIL PROTECTED]] Sent: Wednesday, August 02, 2000 10:15 AM To: [EMAIL PROTECTED] Subject: Gigabit ethernet Simple question: Which Gigabit ethernet card works best with FreeBSD? Josef -- Josef Grosch | Another day closer to a |FreeBSD 4.1 [EMAIL PROTECTED] | Micro$oft free world | UNIX for the masses To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
RE: Gigabit ethernet
And just to get my name in the minutes, the Intel Gig Ethernet card works fairly well, but because it's not well supported by the manufacturer releasing information about it, it may not be the best choice. Performance has been not proven to be good either- partly because I only had rev 1 boards that couldn't do PCI MWI cycles. I've had reports from other folks that have indicating being able to saturate a switch with it, but I have not been able to confirm that myself. FWIW. On Wed, 2 Aug 2000, Charles Randall wrote: These pages should answer all of your questions. http://people.freebsd.org/~wpaul/Alteon/ http://people.freebsd.org/~wpaul/SysKonnect/ I went with the NetGear GA-620 because it was cheap. In retrospect (after talking with Bill Paul), I should have probably gone with the Alteon AceNIC or the 3com 3c985. They both have 1 MB of SRAM compared to the 512 KB in the NetGear. To quote Bill, "The Netgear card is inexpensive for a reason. :)" Charles -Original Message- From: Josef Grosch [mailto:[EMAIL PROTECTED]] Sent: Wednesday, August 02, 2000 10:15 AM To: [EMAIL PROTECTED] Subject: Gigabit ethernet Simple question: Which Gigabit ethernet card works best with FreeBSD? Josef -- Josef Grosch | Another day closer to a |FreeBSD 4.1 [EMAIL PROTECTED] | Micro$oft free world | UNIX for the masses To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
Re: Gigabit ethernet
Do both the Netgear GA620 and GA620T work? On Wed, 2 Aug 2000, Kenneth D. Merry wrote: On Wed, Aug 02, 2000 at 09:15:00 -0700, Josef Grosch wrote: Simple question: Which Gigabit ethernet card works best with FreeBSD? Alteon-based boards. This includes Alteon ACEnics, the 3Com 3c985B (which has 1MB SRAM), and the Netgear GA620 (which has 512K SRAM). You can get the Netgear board for about $320, and the copper version of the board for about $310 from www.necxdirect.com. The 3Com board is about $680 from the same place. (You're paying for the extra memory, which can make a difference, albeit not an enormous difference. Also, the Windows drivers for the Netgear boards don't do jumbo frames. I'm not sure whether the 3Com Windows drivers do jumbo frames, but I would guess that they do.) If you want bandwidth numbers, see: http://people.freebsd.org/~ken/zero_copy/ Ken -- Kenneth Merry [EMAIL PROTECTED] To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
Re: Gigabit ethernet
On Wed, Aug 02, 2000 at 13:17:51 -0400, Essenz Consulting wrote: Do both the Netgear GA620 and GA620T work? The 620 (i.e. the fiber version of the board) definitely works, I've got two. I would assume that the 620T works, although I don't have any of those. If it is like the ACEnic, it should work with the driver in -current, although you might need to add a new PCI ID to the driver. (The 1000BaseT version of the ACEnic has a different PCI ID.) It won't work with -stable until the new firmware and driver changes get merged in. Ken -- Kenneth Merry [EMAIL PROTECTED] To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
Re: Gigabit ethernet support?
David Miller wrote: Any supported cards in 3.2.x? The HCL pages don't list any:( man ti(4). My Netgear GA620s work just fine. Many thanks to Bill Paul, as usual. This issue was addressed on the -network mailing list LAST week. Apparently you didn't search the archives very hard. ;^) -- Where am I, and what am I doing in this handbasket? Wes Peters Softweyr LLC http://softweyr.com/ w...@softweyr.com To Unsubscribe: send mail to majord...@freebsd.org with unsubscribe freebsd-hackers in the body of the message
Re: Gigabit ethernet support?
David Miller wrote: Any supported cards in 3.2.x? The HCL pages don't list any:( man ti(4). My Netgear GA620s work just fine. Many thanks to Bill Paul, as usual. This issue was addressed on the -network mailing list LAST week. Apparently you didn't search the archives very hard. ;^) -- "Where am I, and what am I doing in this handbasket?" Wes Peters Softweyr LLC http://softweyr.com/ [EMAIL PROTECTED] To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
Re: Gigabit ethernet support?
Wes Peters wrote... "Kenneth D. Merry" wrote: Wes Peters wrote... We have two of the NetGear GA620's here, and they work quite nicely. I use them for testing throughput via Gig-E on our switches. Mine is running in a lowly PII/233, on a 32-bit x 33 Mhz slot, and can push bits at 320 Mbps. The GA620 will work in any 32 or 64 bit, 33 or 66 Mhz slot. A 64x66 slot would probably speed things up appreciably. I doubt a faster PCI interface would really speed things up. My guess is that you've got some other bottleneck other than PCI bandwidth. Is the CPU pegged on either end? Not on mine, it's running about 45%. The other end is much faster, a PII/400, and is just discarding the packets, so it's not sweating. The window size tweaks may help you somewhat. I would recommend that you make sure you've got a couple of things tweaked, they may increase your performance somewhat: - set your MTU to 9000, unless of course you're going through a switch that can't handle it Not yet, that's part of what I will be developing. ;^) Due to architectural limitations, we may not be able to support jumbo frames larger than 8k. That's unfortunate, since you won't be compliant with the pseudo-standard. With 1500 byte packets, you probably won't be able to get much better throughput than what you're getting now. I can get about 340Mbps with standard sized packets with a couple Pentium II 350's, and the CPU isn't pegged on either end. Ken -- Kenneth Merry [EMAIL PROTECTED] To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
Re: Gigabit ethernet support?
Kenneth D. Merry wrote: Wes Peters wrote... Bill Paul wrote: Of all the gin joints in all the towns in all the world, Charles Randall had to walk into mine and say: Bill Paul has developed a driver for the Alteon Tigon 1 and 2 cards. http://www.freebsd.org/~wpaul/Alteon/ FYI, Charles -Original Message- From: David Miller [mailto:dmil...@search.sparks.net] Sent: Wednesday, August 18, 1999 1:55 PM To: freebsd-hackers@freebsd.org Subject: Gigabit ethernet support? Any supported cards in 3.2.x? The HCL pages don't list any:( The ti driver supports several cards, including the Alteon AceNIC, the 3Com 3c985-SX, the Netgear GA620, the DEC EtherWORKS 1000, the SGI PCI gigabit ethernet card, the NEC gigabit ethernet card and possibly some from IBM as well, though I don't know the PCI vendor/device IDs for those so I can't be sure (if you find them out, you can try hacking them into the driver). All of these are supported by the same driver because they're all OEMed from Alteon. We have two of the NetGear GA620's here, and they work quite nicely. I use them for testing throughput via Gig-E on our switches. Mine is running in a lowly PII/233, on a 32-bit x 33 Mhz slot, and can push bits at 320 Mbps. The GA620 will work in any 32 or 64 bit, 33 or 66 Mhz slot. A 64x66 slot would probably speed things up appreciably. I doubt a faster PCI interface would really speed things up. My guess is that you've got some other bottleneck other than PCI bandwidth. Is the CPU pegged on either end? Not on mine, it's running about 45%. The other end is much faster, a PII/400, and is just discarding the packets, so it's not sweating. I would recommend that you make sure you've got a couple of things tweaked, they may increase your performance somewhat: - set your MTU to 9000, unless of course you're going through a switch that can't handle it Not yet, that's part of what I will be developing. ;^) Due to architectural limitations, we may not be able to support jumbo frames larger than 8k. - turn on net.inet.tcp.rfc1323, it enables support for TCP windows larger than 64K OK. - increase net.inet.tcp.sendspace and net.inet.tcp.recvspace to 256K. You'll have to edit src/sys/socketvar.h and increase SB_MAX. From what I've seen (this may not be quite correct, but it's close enough) SB_MAX has to be double whatever you want to set sendspace and recvspace to. This has the effect of changing the TCP window size to 256K, I think. From what I've seen, increasing it to 512K is counterproductive unless you've got a card with 1MB of SRAM on board. (The Netgear boards have 512K.) OK. And finally, netperf seems to work reasonably well for testing performance: http://www.netperf.org Cool. I've been using several tools, since we do our real performance testing with a SmartBits. I use spray to generate UDP traffic and a hacked-up version of tcpblast for tcp traffic. I'll clean it up and re-release it one of these days. They're relatively cheap, too, going for $339 at DataComm Warehouse. FWIW, NECX has them for $310. Cool. We don't have an account there; if I get one from DataComm all I have to do is give them the account number and it shows up on my desk the next morning. It's MORE convenient than going to the store. ;^) -- Where am I, and what am I doing in this handbasket? Wes Peters Softweyr LLC http://softweyr.com/ w...@softweyr.com To Unsubscribe: send mail to majord...@freebsd.org with unsubscribe freebsd-hackers in the body of the message
Re: Gigabit ethernet support?
Wes Peters wrote... Kenneth D. Merry wrote: Wes Peters wrote... We have two of the NetGear GA620's here, and they work quite nicely. I use them for testing throughput via Gig-E on our switches. Mine is running in a lowly PII/233, on a 32-bit x 33 Mhz slot, and can push bits at 320 Mbps. The GA620 will work in any 32 or 64 bit, 33 or 66 Mhz slot. A 64x66 slot would probably speed things up appreciably. I doubt a faster PCI interface would really speed things up. My guess is that you've got some other bottleneck other than PCI bandwidth. Is the CPU pegged on either end? Not on mine, it's running about 45%. The other end is much faster, a PII/400, and is just discarding the packets, so it's not sweating. The window size tweaks may help you somewhat. I would recommend that you make sure you've got a couple of things tweaked, they may increase your performance somewhat: - set your MTU to 9000, unless of course you're going through a switch that can't handle it Not yet, that's part of what I will be developing. ;^) Due to architectural limitations, we may not be able to support jumbo frames larger than 8k. That's unfortunate, since you won't be compliant with the pseudo-standard. With 1500 byte packets, you probably won't be able to get much better throughput than what you're getting now. I can get about 340Mbps with standard sized packets with a couple Pentium II 350's, and the CPU isn't pegged on either end. Ken -- Kenneth Merry k...@kdm.org To Unsubscribe: send mail to majord...@freebsd.org with unsubscribe freebsd-hackers in the body of the message
Re: Gigabit ethernet support?
Yes, several vendors cards are supported in 3.2...most notably cards based on Titon I or Titon II chipsets (Alteon cards, 3Com 3c985, Netgear GA620, etc). -marc Marc Nicholas netSTOR Technologies, Inc. http://www.netstor.com "Fast, Expandable and Affordable Internet Caching Products" 1.877.464.4776 416.979.9000 fax: 416.979.8223 cell: 416.346.9255 On Wed, 18 Aug 1999, David Miller wrote: Any supported cards in 3.2.x? The HCL pages don't list any:( Thanks, --- David To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
RE: Gigabit ethernet support?
Bill Paul has developed a driver for the Alteon Tigon 1 and 2 cards. http://www.freebsd.org/~wpaul/Alteon/ FYI, Charles -Original Message- From: David Miller [mailto:[EMAIL PROTECTED]] Sent: Wednesday, August 18, 1999 1:55 PM To: [EMAIL PROTECTED] Subject: Gigabit ethernet support? Any supported cards in 3.2.x? The HCL pages don't list any:( Thanks, --- David To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
Re: Gigabit ethernet support?
On Wed, 18 Aug 1999, David Miller wrote: Any supported cards in 3.2.x? The HCL pages don't list any:( Support for the Alteon Tigon 1 2 based boards and the SysKonnect bards is in 3.2-STABLE. (Both drivers by Bill Paul.) -- | Matthew N. Dodd | '78 Datsun 280Z | '75 Volvo 164E | FreeBSD/NetBSD | | [EMAIL PROTECTED] | 2 x '84 Volvo 245DL| ix86,sparc,pmax | | http://www.jurai.net/~winter | This Space For Rent | ISO8802.5 4ever | To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
Re: Gigabit ethernet support?
Bill Paul wrote: Of all the gin joints in all the towns in all the world, Charles Randall had to walk into mine and say: Bill Paul has developed a driver for the Alteon Tigon 1 and 2 cards. http://www.freebsd.org/~wpaul/Alteon/ FYI, Charles -Original Message- From: David Miller [mailto:[EMAIL PROTECTED]] Sent: Wednesday, August 18, 1999 1:55 PM To: [EMAIL PROTECTED] Subject: Gigabit ethernet support? Any supported cards in 3.2.x? The HCL pages don't list any:( The ti driver supports several cards, including the Alteon AceNIC, the 3Com 3c985-SX, the Netgear GA620, the DEC EtherWORKS 1000, the SGI PCI gigabit ethernet card, the NEC gigabit ethernet card and possibly some from IBM as well, though I don't know the PCI vendor/device IDs for those so I can't be sure (if you find them out, you can try hacking them into the driver). All of these are supported by the same driver because they're all OEMed from Alteon. We have two of the NetGear GA620's here, and they work quite nicely. I use them for testing throughput via Gig-E on our switches. Mine is running in a lowly PII/233, on a 32-bit x 33 Mhz slot, and can push bits at 320 Mbps. The GA620 will work in any 32 or 64 bit, 33 or 66 Mhz slot. A 64x66 slot would probably speed things up appreciably. They're relatively cheap, too, going for $339 at DataComm Warehouse. I'm still working on those Packet Engine cards, Bill. They're really quite disorganized and difficult to work with up there in Spokane... -- "Where am I, and what am I doing in this handbasket?" Wes Peters Softweyr LLC http://softweyr.com/ [EMAIL PROTECTED] To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
Re: Gigabit ethernet support?
Of all the gin joints in all the towns in all the world, David Malone had to walk into mine and say: On Wed, Aug 18, 1999 at 06:43:24PM -0400, Bill Paul wrote: Just out of curiosity, I thought I saw that you could get Intel Etherexpress 1Gb/s cards. Do these exist and if so would they work with the fxp driver as it is? David. The Intel gigabit ethernet cards are nothing like the EtherExpress fast ethernet adapters. Getting information out of Intel is like trying to squeeze blood from a stone. Either they want you to sign a non disclosure agreement that prevents you from releasing driver source (or makes it hard) or they won't give you any information at all. Sometimes they also play a different game where they release some information and pretend they're being 'open' but in reality the stuff they release is just fluff and you still have to sign an NDA to get your hands on the good stuff. As an aside, there are bound to be extra problems with the Intel gigabit NICs because, if I'm not mistaken, then use an on-board i960 processor to drive them. This means that in order to make the NIC work, you have to load firmware into it, and with firmware comes sticky licensing issues. The Alteon Tigon chipset also requires firmware (it has embedded MIPS R4000 CPUs) but Alteon actually released the firmware source code along with all the other Tigon development information. They even have a mailing list where you can send in questions regarding the firmware and get answers from a real live developer. Until such time as Intel gets its head out of its ass in this regard, I refuse to have anything to do with their networking products, especially when I have two other sources of perfectly good gigabit ethernet NICs available to me with full, unencumbered documentation. Initially this was not true of SysKonnect: they had a Linux driver for their cards but no programming info available. Much to my surprise, after a lengthy e-mail discussion, they actually agreed to release the manual for their GEnesis ASIC not just to me but to anybody without NDA on their web site. You would think that Intel would be prepared to make the same commitment to their customers, but so far as I know, they're still stuck in their proprietary ways. -Bill -- = -Bill Paul(212) 854-6020 | System Manager, Master of Unix-Fu Work: [EMAIL PROTECTED] | Center for Telecommunications Research Home: [EMAIL PROTECTED] | Columbia University, New York City = "It is not I who am crazy; it is I who am mad!" - Ren Hoek, "Space Madness" = To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
Re: Gigabit ethernet support?
Wes Peters wrote... Bill Paul wrote: Of all the gin joints in all the towns in all the world, Charles Randall had to walk into mine and say: Bill Paul has developed a driver for the Alteon Tigon 1 and 2 cards. http://www.freebsd.org/~wpaul/Alteon/ FYI, Charles -Original Message- From: David Miller [mailto:[EMAIL PROTECTED]] Sent: Wednesday, August 18, 1999 1:55 PM To: [EMAIL PROTECTED] Subject: Gigabit ethernet support? Any supported cards in 3.2.x? The HCL pages don't list any:( The ti driver supports several cards, including the Alteon AceNIC, the 3Com 3c985-SX, the Netgear GA620, the DEC EtherWORKS 1000, the SGI PCI gigabit ethernet card, the NEC gigabit ethernet card and possibly some from IBM as well, though I don't know the PCI vendor/device IDs for those so I can't be sure (if you find them out, you can try hacking them into the driver). All of these are supported by the same driver because they're all OEMed from Alteon. We have two of the NetGear GA620's here, and they work quite nicely. I use them for testing throughput via Gig-E on our switches. Mine is running in a lowly PII/233, on a 32-bit x 33 Mhz slot, and can push bits at 320 Mbps. The GA620 will work in any 32 or 64 bit, 33 or 66 Mhz slot. A 64x66 slot would probably speed things up appreciably. I doubt a faster PCI interface would really speed things up. My guess is that you've got some other bottleneck other than PCI bandwidth. Is the CPU pegged on either end? I would recommend that you make sure you've got a couple of things tweaked, they may increase your performance somewhat: - set your MTU to 9000, unless of course you're going through a switch that can't handle it - turn on net.inet.tcp.rfc1323, it enables support for TCP windows larger than 64K - increase net.inet.tcp.sendspace and net.inet.tcp.recvspace to 256K. You'll have to edit src/sys/socketvar.h and increase SB_MAX. From what I've seen (this may not be quite correct, but it's close enough) SB_MAX has to be double whatever you want to set sendspace and recvspace to. This has the effect of changing the TCP window size to 256K, I think. From what I've seen, increasing it to 512K is counterproductive unless you've got a card with 1MB of SRAM on board. (The Netgear boards have 512K.) And finally, netperf seems to work reasonably well for testing performance: http://www.netperf.org They're relatively cheap, too, going for $339 at DataComm Warehouse. FWIW, NECX has them for $310. Ken -- Kenneth Merry [EMAIL PROTECTED] To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
Re: Gigabit ethernet support?
"Kenneth D. Merry" wrote: Wes Peters wrote... Bill Paul wrote: Of all the gin joints in all the towns in all the world, Charles Randall had to walk into mine and say: Bill Paul has developed a driver for the Alteon Tigon 1 and 2 cards. http://www.freebsd.org/~wpaul/Alteon/ FYI, Charles -Original Message- From: David Miller [mailto:[EMAIL PROTECTED]] Sent: Wednesday, August 18, 1999 1:55 PM To: [EMAIL PROTECTED] Subject: Gigabit ethernet support? Any supported cards in 3.2.x? The HCL pages don't list any:( The ti driver supports several cards, including the Alteon AceNIC, the 3Com 3c985-SX, the Netgear GA620, the DEC EtherWORKS 1000, the SGI PCI gigabit ethernet card, the NEC gigabit ethernet card and possibly some from IBM as well, though I don't know the PCI vendor/device IDs for those so I can't be sure (if you find them out, you can try hacking them into the driver). All of these are supported by the same driver because they're all OEMed from Alteon. We have two of the NetGear GA620's here, and they work quite nicely. I use them for testing throughput via Gig-E on our switches. Mine is running in a lowly PII/233, on a 32-bit x 33 Mhz slot, and can push bits at 320 Mbps. The GA620 will work in any 32 or 64 bit, 33 or 66 Mhz slot. A 64x66 slot would probably speed things up appreciably. I doubt a faster PCI interface would really speed things up. My guess is that you've got some other bottleneck other than PCI bandwidth. Is the CPU pegged on either end? Not on mine, it's running about 45%. The other end is much faster, a PII/400, and is just discarding the packets, so it's not sweating. I would recommend that you make sure you've got a couple of things tweaked, they may increase your performance somewhat: - set your MTU to 9000, unless of course you're going through a switch that can't handle it Not yet, that's part of what I will be developing. ;^) Due to architectural limitations, we may not be able to support jumbo frames larger than 8k. - turn on net.inet.tcp.rfc1323, it enables support for TCP windows larger than 64K OK. - increase net.inet.tcp.sendspace and net.inet.tcp.recvspace to 256K. You'll have to edit src/sys/socketvar.h and increase SB_MAX. From what I've seen (this may not be quite correct, but it's close enough) SB_MAX has to be double whatever you want to set sendspace and recvspace to. This has the effect of changing the TCP window size to 256K, I think. From what I've seen, increasing it to 512K is counterproductive unless you've got a card with 1MB of SRAM on board. (The Netgear boards have 512K.) OK. And finally, netperf seems to work reasonably well for testing performance: http://www.netperf.org Cool. I've been using several tools, since we do our real performance testing with a SmartBits. I use spray to generate UDP traffic and a hacked-up version of tcpblast for tcp traffic. I'll clean it up and re-release it one of these days. They're relatively cheap, too, going for $339 at DataComm Warehouse. FWIW, NECX has them for $310. Cool. We don't have an account there; if I get one from DataComm all I have to do is give them the account number and it shows up on my desk the next morning. It's MORE convenient than going to the store. ;^) -- "Where am I, and what am I doing in this handbasket?" Wes Peters Softweyr LLC http://softweyr.com/ [EMAIL PROTECTED] To Unsubscribe: send mail to [EMAIL PROTECTED] with "unsubscribe freebsd-hackers" in the body of the message
Re: Gigabit ethernet support?
Yes, several vendors cards are supported in 3.2...most notably cards based on Titon I or Titon II chipsets (Alteon cards, 3Com 3c985, Netgear GA620, etc). -marc Marc Nicholas netSTOR Technologies, Inc. http://www.netstor.com Fast, Expandable and Affordable Internet Caching Products 1.877.464.4776 416.979.9000 fax: 416.979.8223 cell: 416.346.9255 On Wed, 18 Aug 1999, David Miller wrote: Any supported cards in 3.2.x? The HCL pages don't list any:( Thanks, --- David To Unsubscribe: send mail to majord...@freebsd.org with unsubscribe freebsd-hackers in the body of the message To Unsubscribe: send mail to majord...@freebsd.org with unsubscribe freebsd-hackers in the body of the message
RE: Gigabit ethernet support?
Bill Paul has developed a driver for the Alteon Tigon 1 and 2 cards. http://www.freebsd.org/~wpaul/Alteon/ FYI, Charles -Original Message- From: David Miller [mailto:dmil...@search.sparks.net] Sent: Wednesday, August 18, 1999 1:55 PM To: freebsd-hackers@freebsd.org Subject: Gigabit ethernet support? Any supported cards in 3.2.x? The HCL pages don't list any:( Thanks, --- David To Unsubscribe: send mail to majord...@freebsd.org with unsubscribe freebsd-hackers in the body of the message To Unsubscribe: send mail to majord...@freebsd.org with unsubscribe freebsd-hackers in the body of the message
Re: Gigabit ethernet support?
On Wed, 18 Aug 1999, David Miller wrote: Any supported cards in 3.2.x? The HCL pages don't list any:( Support for the Alteon Tigon 1 2 based boards and the SysKonnect bards is in 3.2-STABLE. (Both drivers by Bill Paul.) -- | Matthew N. Dodd | '78 Datsun 280Z | '75 Volvo 164E | FreeBSD/NetBSD | | win...@jurai.net | 2 x '84 Volvo 245DL| ix86,sparc,pmax | | http://www.jurai.net/~winter | This Space For Rent | ISO8802.5 4ever | To Unsubscribe: send mail to majord...@freebsd.org with unsubscribe freebsd-hackers in the body of the message
Re: Gigabit ethernet support?
Of all the gin joints in all the towns in all the world, Charles Randall had to walk into mine and say: Bill Paul has developed a driver for the Alteon Tigon 1 and 2 cards. http://www.freebsd.org/~wpaul/Alteon/ FYI, Charles -Original Message- From: David Miller [mailto:dmil...@search.sparks.net] Sent: Wednesday, August 18, 1999 1:55 PM To: freebsd-hackers@freebsd.org Subject: Gigabit ethernet support? Any supported cards in 3.2.x? The HCL pages don't list any:( The ti driver supports several cards, including the Alteon AceNIC, the 3Com 3c985-SX, the Netgear GA620, the DEC EtherWORKS 1000, the SGI PCI gigabit ethernet card, the NEC gigabit ethernet card and possibly some from IBM as well, though I don't know the PCI vendor/device IDs for those so I can't be sure (if you find them out, you can try hacking them into the driver). All of these are supported by the same driver because they're all OEMed from Alteon. Also, there is a driver for the SysKonnect gigabit ethernet cards (www.syskonnect.com). The driver sk was merged into the 3.x branch recently. SysKonnect has both single port and dual port cards with multimode and single mode fiber interfaces. All types are supported. -Bill -- = -Bill Paul(212) 854-6020 | System Manager, Master of Unix-Fu Work: wp...@ctr.columbia.edu | Center for Telecommunications Research Home: wp...@skynet.ctr.columbia.edu | Columbia University, New York City = It is not I who am crazy; it is I who am mad! - Ren Hoek, Space Madness = To Unsubscribe: send mail to majord...@freebsd.org with unsubscribe freebsd-hackers in the body of the message
Re: Gigabit ethernet support?
On Wed, Aug 18, 1999 at 06:43:24PM -0400, Bill Paul wrote: Just out of curiosity, I thought I saw that you could get Intel Etherexpress 1Gb/s cards. Do these exist and if so would they work with the fxp driver as it is? David. To Unsubscribe: send mail to majord...@freebsd.org with unsubscribe freebsd-hackers in the body of the message
Re: Gigabit ethernet support?
Bill Paul wrote: Of all the gin joints in all the towns in all the world, Charles Randall had to walk into mine and say: Bill Paul has developed a driver for the Alteon Tigon 1 and 2 cards. http://www.freebsd.org/~wpaul/Alteon/ FYI, Charles -Original Message- From: David Miller [mailto:dmil...@search.sparks.net] Sent: Wednesday, August 18, 1999 1:55 PM To: freebsd-hackers@freebsd.org Subject: Gigabit ethernet support? Any supported cards in 3.2.x? The HCL pages don't list any:( The ti driver supports several cards, including the Alteon AceNIC, the 3Com 3c985-SX, the Netgear GA620, the DEC EtherWORKS 1000, the SGI PCI gigabit ethernet card, the NEC gigabit ethernet card and possibly some from IBM as well, though I don't know the PCI vendor/device IDs for those so I can't be sure (if you find them out, you can try hacking them into the driver). All of these are supported by the same driver because they're all OEMed from Alteon. We have two of the NetGear GA620's here, and they work quite nicely. I use them for testing throughput via Gig-E on our switches. Mine is running in a lowly PII/233, on a 32-bit x 33 Mhz slot, and can push bits at 320 Mbps. The GA620 will work in any 32 or 64 bit, 33 or 66 Mhz slot. A 64x66 slot would probably speed things up appreciably. They're relatively cheap, too, going for $339 at DataComm Warehouse. I'm still working on those Packet Engine cards, Bill. They're really quite disorganized and difficult to work with up there in Spokane... -- Where am I, and what am I doing in this handbasket? Wes Peters Softweyr LLC http://softweyr.com/ w...@softweyr.com To Unsubscribe: send mail to majord...@freebsd.org with unsubscribe freebsd-hackers in the body of the message
Re: Gigabit ethernet support?
Of all the gin joints in all the towns in all the world, David Malone had to walk into mine and say: On Wed, Aug 18, 1999 at 06:43:24PM -0400, Bill Paul wrote: Just out of curiosity, I thought I saw that you could get Intel Etherexpress 1Gb/s cards. Do these exist and if so would they work with the fxp driver as it is? David. The Intel gigabit ethernet cards are nothing like the EtherExpress fast ethernet adapters. Getting information out of Intel is like trying to squeeze blood from a stone. Either they want you to sign a non disclosure agreement that prevents you from releasing driver source (or makes it hard) or they won't give you any information at all. Sometimes they also play a different game where they release some information and pretend they're being 'open' but in reality the stuff they release is just fluff and you still have to sign an NDA to get your hands on the good stuff. As an aside, there are bound to be extra problems with the Intel gigabit NICs because, if I'm not mistaken, then use an on-board i960 processor to drive them. This means that in order to make the NIC work, you have to load firmware into it, and with firmware comes sticky licensing issues. The Alteon Tigon chipset also requires firmware (it has embedded MIPS R4000 CPUs) but Alteon actually released the firmware source code along with all the other Tigon development information. They even have a mailing list where you can send in questions regarding the firmware and get answers from a real live developer. Until such time as Intel gets its head out of its ass in this regard, I refuse to have anything to do with their networking products, especially when I have two other sources of perfectly good gigabit ethernet NICs available to me with full, unencumbered documentation. Initially this was not true of SysKonnect: they had a Linux driver for their cards but no programming info available. Much to my surprise, after a lengthy e-mail discussion, they actually agreed to release the manual for their GEnesis ASIC not just to me but to anybody without NDA on their web site. You would think that Intel would be prepared to make the same commitment to their customers, but so far as I know, they're still stuck in their proprietary ways. -Bill -- = -Bill Paul(212) 854-6020 | System Manager, Master of Unix-Fu Work: wp...@ctr.columbia.edu | Center for Telecommunications Research Home: wp...@skynet.ctr.columbia.edu | Columbia University, New York City = It is not I who am crazy; it is I who am mad! - Ren Hoek, Space Madness = To Unsubscribe: send mail to majord...@freebsd.org with unsubscribe freebsd-hackers in the body of the message
Re: Gigabit ethernet support?
Wes Peters wrote... Bill Paul wrote: Of all the gin joints in all the towns in all the world, Charles Randall had to walk into mine and say: Bill Paul has developed a driver for the Alteon Tigon 1 and 2 cards. http://www.freebsd.org/~wpaul/Alteon/ FYI, Charles -Original Message- From: David Miller [mailto:dmil...@search.sparks.net] Sent: Wednesday, August 18, 1999 1:55 PM To: freebsd-hackers@freebsd.org Subject: Gigabit ethernet support? Any supported cards in 3.2.x? The HCL pages don't list any:( The ti driver supports several cards, including the Alteon AceNIC, the 3Com 3c985-SX, the Netgear GA620, the DEC EtherWORKS 1000, the SGI PCI gigabit ethernet card, the NEC gigabit ethernet card and possibly some from IBM as well, though I don't know the PCI vendor/device IDs for those so I can't be sure (if you find them out, you can try hacking them into the driver). All of these are supported by the same driver because they're all OEMed from Alteon. We have two of the NetGear GA620's here, and they work quite nicely. I use them for testing throughput via Gig-E on our switches. Mine is running in a lowly PII/233, on a 32-bit x 33 Mhz slot, and can push bits at 320 Mbps. The GA620 will work in any 32 or 64 bit, 33 or 66 Mhz slot. A 64x66 slot would probably speed things up appreciably. I doubt a faster PCI interface would really speed things up. My guess is that you've got some other bottleneck other than PCI bandwidth. Is the CPU pegged on either end? I would recommend that you make sure you've got a couple of things tweaked, they may increase your performance somewhat: - set your MTU to 9000, unless of course you're going through a switch that can't handle it - turn on net.inet.tcp.rfc1323, it enables support for TCP windows larger than 64K - increase net.inet.tcp.sendspace and net.inet.tcp.recvspace to 256K. You'll have to edit src/sys/socketvar.h and increase SB_MAX. From what I've seen (this may not be quite correct, but it's close enough) SB_MAX has to be double whatever you want to set sendspace and recvspace to. This has the effect of changing the TCP window size to 256K, I think. From what I've seen, increasing it to 512K is counterproductive unless you've got a card with 1MB of SRAM on board. (The Netgear boards have 512K.) And finally, netperf seems to work reasonably well for testing performance: http://www.netperf.org They're relatively cheap, too, going for $339 at DataComm Warehouse. FWIW, NECX has them for $310. Ken -- Kenneth Merry k...@kdm.org To Unsubscribe: send mail to majord...@freebsd.org with unsubscribe freebsd-hackers in the body of the message
Re: Gigabit Ethernet performance
Has anyone done any performance benchmarking on the TIGON Gigabit Ethernet drivers? Curious to see what sort of link saturation can be achieved with various boxen/applications... 470 Mbps application to application using ttcp, on a PII-350 back to back with a Celeron 300A overclocked to 337 Mhz (ie 75 Mhz bus). Looked like I'd be able to get more with a faster CPU. Steinar Haug, Nethelp consulting, sth...@nethelp.no To Unsubscribe: send mail to majord...@freebsd.org with unsubscribe freebsd-hackers in the body of the message