Justin C. Darby wrote: > Does anyone have interest in my spending time fully documenting our > vblade-based AoE configuration? Here are the basics:
Yes! I have no experience with 10GbE myself but would love to add some good info about it to my xenaoe.org project website. > Performance (total, on extremely optimized kernel, server): Up to > 16Gb/sec (2GB/sec) at about 80% cpu utilization. Nice. That sure beats the 100MB/s I get with my setup! > Security layer: VLAN trunking, with the REORDER_HDR flag set on the REORDER_HDR flag? Never heard of that. I'll have to look it up. > We also had to tune the heck out of the read ahead and page cache > system on the server, but thats more to do with 3ware controllers and > the small read requests vblade generates than vblade itself. How do you know what needs tuning and when you have achieved optimal results? > The new AIO and socketfilter patch will make our environment a little > more sane even though the vlan isolation thing stops vblade from > seeing other vlan's aoe broadcasts (multiple exports on one vlan > become less painful with the socketfilter patch, AIO let's me relax > the vm.dirty[_background]_ratio tuning a bit), so I'm back into the > mode of thinking about vblade. I'll probably be testing this soon. Be sure to check out qaoed also. It handles multiple exports on one vlan without waking up every thread. I am using it and it works very well. > Also, is there any interest in people using vblade on 10GbE to add a > command line switch to set the buffer count? I can't imagine we're the > only people who have run into this. We're probably going to write up a > patch to do this, since we're going to export to some clients over > 1GbE after we get the N7K up and running. What is N7K? > Offtopic pipe dream/note to the guys at Coraid: If you had one device > like the SR2461 that could do RAID 6+hot spares for the ultra > paranoid, had a web interface (internal or external to the box) for > configuration and disk management somewhere near as feature complete > as 3dm2, did 10GBase-SR (not CX4), etherchannel/802.3ad for > redundancy, LVM (or LVM like) partitioning, VLANs with VLAN trunking, > and could be covered under a support contract, I'd be suggesting we > buy one or two next fiscal year. Far fetched, I know. But, we're Sounds like a standard Linux box running vblade/qaoed can already do this minus the web interface. In fact I'm already doing all of that except that I don't have a web interface and I don't have 10Ge equipment. > ramping up to deploy a Cisco Nexus 7000 series switch over the next > few months, in part to deal with 10GbE SAN traffic, and I'm not sold > on FCoE given our awesome AoE setup, and we've got that kind of > solution working locally, and if I can buy it off the shelf it saves > me a lot of time, so... :) Same here as far as FCoE goes. I am migrating our legacy fibrechannel SAN to AoE and not looking back. Coraid really needs to find a way to up the buzz around AoE because all I hear about is iSCSI. The Linux Journal articles were a good idea but that was years ago now. I am yet to meet another tech person who had ever heard of AoE who isn't on this list or who I didn't tell about it myself. -- Tracy R Reed Read my blog at http://ultraviolet.org Key fingerprint = D4A8 4860 535C ABF8 BA97 25A6 F4F2 1829 9615 02AD Non-GPG signed mail gets read only if I can find it among the spam. ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ Aoetools-discuss mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/aoetools-discuss
