Re: [OmniOS-discuss] best or preferred 10g card for OmniOS
On 3/29/2015 9:51 AM, Matthew Lagoe wrote: The intel cards are nice but they don't have any cx4 cards so we don't use them. Copper connections have less latency on short links then fiber as you don't have the electric to optical conversion (when done properly) Do yourself a huge favor and go to the SFP+ direct attach stuff. Longer lengths, thinner cables, better cables, etc. The switches are becoming really inexpensive. (I ordered pair of the Intel X520 DA2 cards from all of the recommendations here. I should have them tomorrow) ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] best or preferred 10g card for OmniOS
On Sun, Mar 29, 2015 at 8:51 AM, Matthew Lagoe matthew.la...@subrigo.net wrote: The intel cards are nice but they don't have any cx4 cards so we don't use them. Copper connections have less latency on short links then fiber as you don't have the electric to optical conversion (when done properly) On short links ( 20M) twin-ax copper SFP+ are much more economical and lower latency than optics. I would only use optics and fiber if I have long runs. -Chip -Original Message- From: OmniOS-discuss [mailto:omnios-discuss-boun...@lists.omniti.com] On Behalf Of Richard Elling Sent: Saturday, March 28, 2015 07:40 AM To: Doug Hughes Cc: omnios-discuss Subject: Re: [OmniOS-discuss] best or preferred 10g card for OmniOS On Mar 26, 2015, at 9:24 AM, Doug Hughes d...@will.to wrote: any recommendations? We're having some pretty big problems with the Solarflare card and driver dropping network under high load. We eliminated LACP as a culprit, and the switch. Intel? Chelsio? other? I've been running exclusively Intel for several years now. It gets the most attention in the illumos community. -- richard - Doug ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] best or preferred 10g card for OmniOS
The intel cards are nice but they don't have any cx4 cards so we don't use them. Copper connections have less latency on short links then fiber as you don't have the electric to optical conversion (when done properly) -Original Message- From: OmniOS-discuss [mailto:omnios-discuss-boun...@lists.omniti.com] On Behalf Of Richard Elling Sent: Saturday, March 28, 2015 07:40 AM To: Doug Hughes Cc: omnios-discuss Subject: Re: [OmniOS-discuss] best or preferred 10g card for OmniOS On Mar 26, 2015, at 9:24 AM, Doug Hughes d...@will.to wrote: any recommendations? We're having some pretty big problems with the Solarflare card and driver dropping network under high load. We eliminated LACP as a culprit, and the switch. Intel? Chelsio? other? I've been running exclusively Intel for several years now. It gets the most attention in the illumos community. -- richard - Doug ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] best or preferred 10g card for OmniOS
Am 27.03.15 um 01:05 schrieb Phil Harman: SFPs? Are you know kidding me? For my home lab I bought a pair of X540-T2 cards, which will even run over Cat5 for about a metre. They use a lot more power than SFP though :) He he… 1m doesn't buy you much in a server room, so we're using almost only 540-T2 over Cat6 and we never had a problem under Solaris or OmniOS. I'd always choose the Intel 10GbEs over all other brands. I've had horrible issues with Broadcom-based NICs in my Dells and they will have to prove their reliability to a load of other people first, before I will even consider, buying those again… but, I guess so will other do as well. ;) No issues at all with illumos or VMware. On 26 Mar 2015, at 16:45, Jeff Stockett jstock...@molalla.com mailto:jstock...@molalla.com wrote: I would concur with what Chip said. We’ve had good luck with the Intel X520s setup with LACP to a Nexus 5000 – and also have a few X540s. The X520s are a bit picky about SFPs but Appoved makes one that works and is reasonably affordable. *From:*OmniOS-discuss [mailto:omnios-discuss-boun...@lists.omniti.com] *On Behalf Of *Doug Hughes *Sent:* Thursday, March 26, 2015 9:25 AM *To:* omnios-discuss *Subject:* [OmniOS-discuss] best or preferred 10g card for OmniOS any recommendations? We're having some pretty big problems with the Solarflare card and driver dropping network under high load. We eliminated LACP as a culprit, and the switch. Intel? Chelsio? other? - Doug ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com mailto:OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss -- Stephan Budach Managing Director Jung von Matt/it-services GmbH Glashüttenstraße 79 20357 Hamburg Tel: +49 40-4321-1353 Fax: +49 40-4321-1114 E-Mail: stephan.bud...@jvm.de Internet: http://www.jvm.com Geschäftsführer: Stephan Budach AG HH HRB 98380 ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] best or preferred 10g card for OmniOS
I would concur with what Chip said. We’ve had good luck with the Intel X520s setup with LACP to a Nexus 5000 – and also have a few X540s. The X520s are a bit picky about SFPs but Appoved makes one that works and is reasonably affordable. From: OmniOS-discuss [mailto:omnios-discuss-boun...@lists.omniti.com] On Behalf Of Doug Hughes Sent: Thursday, March 26, 2015 9:25 AM To: omnios-discuss Subject: [OmniOS-discuss] best or preferred 10g card for OmniOS any recommendations? We're having some pretty big problems with the Solarflare card and driver dropping network under high load. We eliminated LACP as a culprit, and the switch. Intel? Chelsio? other? - Doug ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] best or preferred 10g card for OmniOS
On Mar 26, 2015, at 12:24 PM, Doug Hughes d...@will.to wrote: any recommendations? We're having some pretty big problems with the Solarflare card and driver dropping network under high load. We eliminated LACP as a culprit, and the switch. Intel? Chelsio? other? I’ve had a pretty good experience with the Intel X520 cards, not really much I can complain about. -Greg ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] best or preferred 10g card for OmniOS
Generally speaking the Intel ones are preferable, because Intel does the best job of keeping those drivers up to date for all open-source platforms. Just pushed into illumos, and coming soon to r151014 is OPEN-SOURCE support for Broadcom NetXtreme II (now owned by QLogic) 10GigE (the bnxe driver). It's not nearly as good as Intel's code, or likely Intel's HW, but now that it is open-source, it becomes a viable alternative, because people can now fix the driver if there is a problem. I'd still use Intel 10Gig where possible, but if you're stuck on HW with formerly-Broadcom 10GigE, your luck will be improving somewhat. Dan ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
[OmniOS-discuss] best or preferred 10g card for OmniOS
any recommendations? We're having some pretty big problems with the Solarflare card and driver dropping network under high load. We eliminated LACP as a culprit, and the switch. Intel? Chelsio? other? - Doug___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] best or preferred 10g card for OmniOS
Thanks guys! (also, if anybody has some advice or contrary experience with SolarFlare (5162), I'd love to hear it. Right now they are pretty much unusable under load, though iperf tends to work fine. On Thu, Mar 26, 2015 at 12:36 PM, Schweiss, Chip c...@innovates.com wrote: The Intel X520's and the Supermicro equivalents are rock solid. The X540 probably is too, I just haven't used it. I prefer the Supermicro branded Intel cards because the firmware is not as picky about the twin-ax cables used. -Chip On Thu, Mar 26, 2015 at 11:24 AM, Doug Hughes d...@will.to wrote: any recommendations? We're having some pretty big problems with the Solarflare card and driver dropping network under high load. We eliminated LACP as a culprit, and the switch. Intel? Chelsio? other? - Doug ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] best or preferred 10g card for OmniOS
SFPs? Are you know kidding me? For my home lab I bought a pair of X540-T2 cards, which will even run over Cat5 for about a metre. They use a lot more power than SFP though :) No issues at all with illumos or VMware. On 26 Mar 2015, at 16:45, Jeff Stockett jstock...@molalla.com wrote: I would concur with what Chip said. We’ve had good luck with the Intel X520s setup with LACP to a Nexus 5000 – and also have a few X540s. The X520s are a bit picky about SFPs but Appoved makes one that works and is reasonably affordable. From: OmniOS-discuss [mailto:omnios-discuss-boun...@lists.omniti.com] On Behalf Of Doug Hughes Sent: Thursday, March 26, 2015 9:25 AM To: omnios-discuss Subject: [OmniOS-discuss] best or preferred 10g card for OmniOS any recommendations? We're having some pretty big problems with the Solarflare card and driver dropping network under high load. We eliminated LACP as a culprit, and the switch. Intel? Chelsio? other? - Doug ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
Re: [OmniOS-discuss] best or preferred 10g card for OmniOS
I use the myricom 10g cards (myri10g) they work just fine. From: OmniOS-discuss [mailto:omnios-discuss-boun...@lists.omniti.com] On Behalf Of Doug Hughes Sent: Thursday, March 26, 2015 09:25 AM To: omnios-discuss Subject: [OmniOS-discuss] best or preferred 10g card for OmniOS any recommendations? We're having some pretty big problems with the Solarflare card and driver dropping network under high load. We eliminated LACP as a culprit, and the switch. Intel? Chelsio? other? - Doug ___ OmniOS-discuss mailing list OmniOS-discuss@lists.omniti.com http://lists.omniti.com/mailman/listinfo/omnios-discuss
