Re: [openib-general] Re: TSO and IPoIB performance degradation

2006-03-07 Thread Roland Dreier
David> I wish you had started the thread by mentioning this David> specific patch, we wasted an enormous amount of precious David> developer time speculating and asking for arbitrary tests David> to be run in order to narrow down the problem, yet you knew David> the specific cha

Re: [openib-general] Re: TSO and IPoIB performance degradation

2006-03-07 Thread David S. Miller
From: Roland Dreier <[EMAIL PROTECTED]> Date: Tue, 07 Mar 2006 17:17:30 -0800 > The reason TSO comes up is that reverting the patch described below > helps (or helped at some point at least) IPoIB throughput quite a bit. I wish you had started the thread by mentioning this specific patch, we wast

Re: [openib-general] Re: TSO and IPoIB performance degradation

2006-03-07 Thread Roland Dreier
David> How limited are the IPoIB devices, TX descriptor wise? David> One side effect of the TSO changes is that one extra David> descriptor will be used for outgoing packets. This is David> because we have to put the headers as well as the user David> data, into page based buf

Re: [openib-general] Re: TSO and IPoIB performance degradation

2006-03-07 Thread David S. Miller
From: Matt Leininger <[EMAIL PROTECTED]> Date: Tue, 07 Mar 2006 16:11:37 -0800 > I used the standard setting for tcp_rmem and tcp_wmem. Here are a > few other runs that change those variables. I was able to improve > performance by ~30MB/s to 403 MB/s, but this is still a ways from the > 474

Re: [openib-general] Re: TSO and IPoIB performance degradation

2006-03-07 Thread Matt Leininger
On Tue, 2006-03-07 at 13:49 -0800, Stephen Hemminger wrote: > On Tue, 07 Mar 2006 13:44:51 -0800 > Matt Leininger <[EMAIL PROTECTED]> wrote: > > > On Mon, 2006-03-06 at 19:13 -0800, Shirley Ma wrote: > > > > > > > More likely you are getting hit by the fact that TSO prevents the > > > congestion

Re: [openib-general] Re: TSO and IPoIB performance degradation

2006-03-07 Thread Michael S. Tsirkin
Quoting r. Stephen Hemminger <[EMAIL PROTECTED]>: > Is IB using NAPI or just doing netif_rx()? No, IPoIB doesn't use NAPI. -- Michael S. Tsirkin Staff Engineer, Mellanox Technologies - To unsubscribe from this list: send the line "unsubscribe netdev" in the body of a message to [EMAIL PROTECTED]

Re: [openib-general] Re: TSO and IPoIB performance degradation

2006-03-07 Thread Stephen Hemminger
On Tue, 07 Mar 2006 13:44:51 -0800 Matt Leininger <[EMAIL PROTECTED]> wrote: > On Mon, 2006-03-06 at 19:13 -0800, Shirley Ma wrote: > > > > > More likely you are getting hit by the fact that TSO prevents the > > congestion > > window from increasing properly. This was fixed in 2.6.15 (around mid

Re: [openib-general] Re: TSO and IPoIB performance degradation

2006-03-07 Thread Matt Leininger
On Mon, 2006-03-06 at 19:13 -0800, Shirley Ma wrote: > > > More likely you are getting hit by the fact that TSO prevents the > congestion > window from increasing properly. This was fixed in 2.6.15 (around mid > of Nov 2005). > > Yep, I noticed the same problem. After updating to the new kernel,