Re: 10 gigabit ethernet
On Wed, 26 Jan 2011, Rajiv Aaron Manglani wrote: We would like to speed up NFS traffic between a file server (FreeBSD with ZFS) and a compute server (Linux) and wondered if 10 gigabit ethernet was a reasonable approach. Can anyone report experience? Currently it appears that NFS traffic saturates a 1 gigabit/second link, whereas local access to files is several times as fast. have you tried using jumbo frames? you might be able to implement that with your current hardware. We haven't tried it - our thought was that if we are able to saturate the link wit 1500 byte frames, then bigger frames wouldn't go any faster. We are still looking for a dumb, 8 port 10Gbase-T switch, but I am going to start out just linking the two machines with a crossover cable. Dan ___ Discuss mailing list Discuss@blu.org http://lists.blu.org/mailman/listinfo/discuss
Re: 10 gigabit ethernet
Daniel Feenberg wrote: We would like to speed up NFS traffic between a file server... We understand that ganging several 1 gig ethernet ports won't speed up a single connection, only allow multiple 1 gig connections. That won't help us, since we typically would only have one (large) file open on the server. It seems like this should be addressable in the NFS client (or perhaps even the next layer up). For example, a hypothetical NFS driver that implements a read-ahead cache, resulting in separate, parallel requests for chunks of the file. Given the big price difference between 10G and 1G Ethernet, there's motivation for a software solution, so I wouldn't be surprised if someone has created an NFS driver or set of kernel parameters tuned for these circumstances. -Tom -- Tom Metro Venture Logic, Newton, MA, USA Enterprise solutions through open source. Professional Profile: http://tmetro.venturelogic.com/ ___ Discuss mailing list Discuss@blu.org http://lists.blu.org/mailman/listinfo/discuss
RE: 10 gigabit ethernet
From: Daniel Feenberg [mailto:feenb...@nber.org] Sent: Wednesday, January 26, 2011 7:38 AM The Intel switch is about $550, the Mellanox about $100 more and with 2 ports. That is not to bad and the Intel at least appears to have been supported by Linux and FreeBSD for several years, which is a good sign. Really? Did you mean to say switch? I normally think a single NIC will cost that much. I now need a small switch. Are there any 8 port dumb 10gBase-T switches? I can only find 24 port switches for $15,000. I can find a few gigabit switches with 2 10 GB uplink ports - that isn't any better than a crossover cable. But nothing with 4 or 8 ports. Any ideas? Ahh. I guess you did mean NIC in the first paragraph. Good. I mean ... Dang it. It would have been nice if you found switches for $500... Actually, a switch with 2x 10G uplinks is better than a crossover because at least you have the option of using other systems on the same switch at 1G. I know they're out there... For whatever reason, 10G seems to require 10G module bays instead of simply an SFP module. So after buying a switch, you need the module bay adapter, plus the SFP. It's real expensive. But here's one example of a switch that has 4x 10G slots: http://www.newegg.com/Product/Product.aspx?Item=N82E16833122157 ___ Discuss mailing list Discuss@blu.org http://lists.blu.org/mailman/listinfo/discuss
Re: 10 gigabit ethernet
We would like to speed up NFS traffic between a file server (FreeBSD with ZFS) and a compute server (Linux) and wondered if 10 gigabit ethernet was a reasonable approach. Can anyone report experience? Currently it appears that NFS traffic saturates a 1 gigabit/second link, whereas local access to files is several times as fast. have you tried using jumbo frames? you might be able to implement that with your current hardware. ___ Discuss mailing list Discuss@blu.org http://lists.blu.org/mailman/listinfo/discuss
