Re: [casper] 10gbe switch

2011-01-31 Thread Yashwant Gupta
Dear All, Here's an update on what we are doing at the GMRT, for CX4 to SFP+ conversion adaptor : The adapter module will need a PHY chip to convert the four lane 3.125 Gbps CX4 to a single 10Gbps SFP+ output. Currently, we have selected the Vitesse Quad PHY chip VSC 8484 for the same. The

Re: [casper] 10gbe switch

2011-01-29 Thread John Ford
Can one use the zarlink (or something like it) on the ROACH end, and connect the fiber to an SFP+ module in the computer or switch? It seems like someone ought to make such a beast, considering there are a lot of cx-4 ports in the field that need to be connected to new CX-4 - only switches and

Re: [casper] 10gbe switch

2011-01-29 Thread John Ford
Can one use the zarlink (or something like it) on the ROACH end, and connect the fiber to an SFP+ module in the computer or switch? It seems like someone ought to make such a beast, considering there are a lot of cx-4 ports in the field that need to be connected to new CX-4 - only Er, make

Re: [casper] 10gbe switch

2011-01-29 Thread Tom Downes
I'm talking with the engineers at Chelsio about just such a beast and expect a call back on Monday. I imagine I'll go with CX4 on both ends and Zarlink for now, but it seems like something the ROACH community needs to think about - sound like GMRT is doing something like this. Every time I've

Re: [casper] 10gbe switch

2011-01-29 Thread John Ford
I'm talking with the engineers at Chelsio about just such a beast and expect a call back on Monday. I imagine I'll go with CX4 on both ends and Zarlink for now, but it seems like something the ROACH community needs to think about - sound like GMRT is doing something like this. Every time

Re: [casper] 10gbe switch

2011-01-29 Thread Tom Downes
I just turned 30 and still saw a fair amount of 10BASE2 (with BNCs) when I was working at the computer help desk in college. It's not that old. Yes, it's extremely puzzling that there isn't an off-the-shelf solution for this that everyone knows about. Tom On Sat, Jan 29, 2011 at 10:17 AM, John

Re: [casper] 10gbe switch

2011-01-29 Thread Dan Werthimer
hi tom, appended below is a list of11 alternate models of CX4 10Gbe NIC boards. (other than chelsio and myricom). this is a very old list, from august 2008, and there other several newer cards from many other companies, but i don't have an up to date list. (sorry). i also don't know which

Re: [casper] 10gbe switch

2011-01-28 Thread Dan Werthimer
hi tom, i suggest you purchase a myricom 10Gbe CX4 NIC board, rather than a chelsio board. the myricom boards work well and jason wrote a casper memo with test results on myricom nics. myricom has drivers optimized for UDP packets, and drivers that skip over kernel memory and transfer data

Re: [casper] 10gbe switch

2011-01-28 Thread Dan Werthimer
hi tom, one more note: if you use fiber optic CX4 cables, please see the warning at http://casper.berkeley.edu/wiki/Recommended_10_GbE_Hardware not all NIC boards have built in power to support fiber optic cables. check with myricom. the ibob/bee2/roach boards have built in power. dan

Re: [casper] 10gbe switch

2011-01-28 Thread rick raffanti
The Myricom people told me they don't make NICs with active ports- ie, aux power for the fiber translator. That's why we bought the Chelsio. Anton is getting 6Gb/s throughput with the Chelsio- we haven't tried to push it further. I wasn't aware of the UDP packet handling stuff, though.

Re: [casper] 10gbe switch

2011-01-28 Thread Tom Downes
I am avoiding Myricom for the reasons Rick mentioned. It took a long time for me to get the sales/technical person to even understand that I wanted to go from CX4 to fiber. But Chelsio, as several have mentioned on this list, provides the power necessary for transceivers to work. They also have

Re: [casper] 10gbe switch

2010-08-09 Thread John Ford
And don't forget that the switches that are XFP and SFP+ sometimes (usually?) don't include the optics for each port in the switch price. With CX4, all you need is a cable, if you're within a few meters. Yes - that list is years old. Those Fujitsu and HP switches have been tested with the

Re: [casper] 10gbe switch

2010-08-09 Thread Matt Dexter
Yes - when pricing switches, or any sort of (sub-)system, a full BOM must be used to make a meaningful comparison. Matt On Mon, 9 Aug 2010, John Ford wrote: And don't forget that the switches that are XFP and SFP+ sometimes (usually?) don't include the optics for each port in the switch

[casper] 10gbe switch

2010-08-05 Thread Tom Downes
Casper-folks: Hoping to short-circuit a fair amount of research here in the hope that someone has had to do this already. I'll soon be looking to connect 10-20 ROACH boards by 10 gbe to a data acquisition computer(s). It seems like the smartest way of doing that is getting a 16-port switch or

Re: [casper] 10gbe switch

2010-08-05 Thread Tom Downes
No. Believe it or not I spent a long time looking everywhere but the Casper wiki. Should have thought of that because that's where we got the Myricom card from. Those listed are at the higher end of the price range I've seen. Looks like ~$10k is the amount I should be prepared to spend. Am I

Re: [casper] 10gbe switch

2010-08-05 Thread John Ford
No. Believe it or not I spent a long time looking everywhere but the Casper wiki. Should have thought of that because that's where we got the Myricom card from. Those listed are at the higher end of the price range I've seen. Looks like ~$10k is the amount I should be prepared to spend.

Re: [casper] 10gbe switch

2010-08-05 Thread Tom Downes
Matt, John: I would just as soon use 10-100Mbit, but the firmware we have developed uses the 10 gbe port. I understand this to be fairly fundamental in that the CASPER libraries allow simpler interfacing of the memory to the 10 gbe than to the 100 Mbit. My recollection of the details is fuzzy

Re: [casper] 10gbe switch

2010-08-05 Thread Andrew Lutomirski
On Thu, Aug 5, 2010 at 3:21 PM, Matt Dexter mdex...@berkeley.edu wrote: Hi Tom, were you aware of these ? http://casper.berkeley.edu/wiki/Recommended_10_GbE_Hardware Sadly the list is out of date: some of the switches are no longer in production. The XG700, for example, is great and cheap

Re: [casper] 10gbe switch

2010-08-05 Thread Billy Mallard
Tom Downes wrote: I would just as soon use 10-100Mbit, but the firmware we have developed uses the 10 gbe port. I understand this to be fairly fundamental in that the CASPER libraries allow simpler interfacing of the memory to the 10 gbe than to the 100 Mbit. That's correct. The problem is

Re: [casper] 10gbe switch

2010-08-05 Thread Tom Downes
The XG700 does look pretty good at its pricepoint. We could get away with 12 ports for a while I think. Heck, we might be able to buy 2 if we can find them. Thanks all for help. I would appreciate any experience people have with transceivers too. Tom On Thu, Aug 5, 2010 at 4:11 PM, Andrew

Re: [casper] 10gbe switch

2010-08-05 Thread Matt Dexter
we mainly use Zarlink for casper-casper and casper-Fujitsu switch links Not NICs. I think the only NIC application is Fujitsu switch to 1U server w/ Chelsio N310E-CX card (via copper and active Zarlink and Fujitsu fiboer optic links). The issue w/ NICs and some other CX4 devices is that they

Re: [casper] 10gbe switch

2010-08-05 Thread Matt Dexter
Yes - that list is years old. Those Fujitsu and HP switches have been tested with the CASPER hardware and found to work as advertised. There are lots of new products available. More announced all the time. We are in contact with a number of vendors in hopes of getting demo units to try in

Re: [casper] 10gbe switch

2010-08-05 Thread Dan Werthimer
hi tom, if you don't need much more than 10 Mbit/sec, then your system will be a lot cheaper if you use the 1Gbit roach ports. you'll have to change your gateware and software a bit to do this, but you'll save a lot of money in 10Gbe switches, cables, and nic boards. if you want to stick