The server has a claimed 8GB/s hypertransport link connects the south bridge
and north bridge. The NIC is mounted to the south bridge through a x8 PCIe
slot.
This 8GB/s bandwidth counts both directions. So it only provides 4GB/s
unidirectional bandwidth. The max unidirectional throughput I got is around
8.8Gb/s. And the max bidirectional throughput I got is larger than 12Gb/s.
I'm thinking if this hypertransport link might be the bottleneck.
Any comment?
Jiaqing
2009/4/25 Jiaqing Du <[email protected]>
> Hi, List
>
> I'm playing with two Intel 10 Gigabit CX4 Dual Port Server Adapters located
> at two different machines and connected by network cables directly. These
> two cards sit on two x8 PCIe slots.
>
> The tuning I did includes setting interrupt affinity and process affinity,
> using jumbo frames, and changing related kernel network parameters.
> Basically, I referred to the following two documents.
>
> 1) 10 Gb Ethernet,
> www.redhat.com/promo/summit/2008/downloads/pdf/Thursday/Mark_Wagner.pdf
> 2) Linux kernel documentation,
> http://www.mjmwired.net/kernel/Documentation/networking/ixgb.txt
>
> For one pair of ports located at two different machines, the maximum TCP
> throughput I could get is about 8900Mb/s. This number just comes from
> setting interrupt affinity and using jumbo frames. Changing other parts of
> the system configuration could not give me a better number.
>
> Can I get a higher throughput with more tuning or this is what I can get
> from CX4 adapters?
>
> Thanks.
>
> Jiaqing Du
>
------------------------------------------------------------------------------
Register Now & Save for Velocity, the Web Performance & Operations
Conference from O'Reilly Media. Velocity features a full day of
expert-led, hands-on workshops and two days of sessions from industry
leaders in dedicated Performance & Operations tracks. Use code vel09scf
and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
