Re: Poor UDP performance using 2.6.21-rc5-rt5

2007-04-03 Thread Ingo Molnar
* David Sperry <[EMAIL PROTECTED]> wrote: > > there are a few other things i'm working on to improve this. I've > > uploaded -rt9 which is the current state of affairs. Note that using > > -rt9 you'll likely only see IRQ-8406 overhead in the system, because > > i've added an optimization to do

Re: Poor UDP performance using 2.6.21-rc5-rt5

2007-04-02 Thread Ingo Molnar
* David Sperry <[EMAIL PROTECTED]> wrote: > > > I think there is some kind of bad behavior happening in the Nvidia > > > driver with respect to softirq-net-tx and IRQ-8406. > > > > yes. Part of the problem is that the forcedeth.c driver does not > > fully support NAPI - today i've implemented

RE: Poor UDP performance using 2.6.21-rc5-rt5

2007-04-02 Thread David Sperry
> -Original Message- > From: Ingo Molnar [mailto:[EMAIL PROTECTED] > Sent: Monday, April 02, 2007 3:05 PM > To: [EMAIL PROTECTED] > Cc: Dave Sperry; linux-rt-users@vger.kernel.org; linux- > [EMAIL PROTECTED] > Subject: Re: Poor UDP performance using 2.6.21-rc5

Re: Poor UDP performance using 2.6.21-rc5-rt5

2007-04-02 Thread Ingo Molnar
* [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > The Intel NIC seems to behave better under RT yeah. > I think there is some kind of bad behavior happening in the Nvidia > driver with respect to softirq-net-tx and IRQ-8406. yes. Part of the problem is that the forcedeth.c driver does not full

Re: Poor UDP performance using 2.6.21-rc5-rt5

2007-04-02 Thread [EMAIL PROTECTED]
I have a new data point to add to the confusion. The box I'm testing has 2 nics in it. The one I have been testing so far is: 00:08.0 Bridge: nVidia Corporation MCP55 Ethernet (rev a3) The other NIC is an Intel 1gig fiber 09:00.0 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet

Re: Poor UDP performance using 2.6.21-rc5-rt5

2007-04-02 Thread [EMAIL PROTECTED]
-- Original message -- From: Ingo Molnar <[EMAIL PROTECTED]> > > * [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > > > Thanks for all the input Ingo, Here's a list of all the permutations > > I've tried: > > one thing i noticed is that cyclesoak interferes with

Re: Poor UDP performance using 2.6.21-rc5-rt5

2007-04-02 Thread Ingo Molnar
* [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > Thanks for all the input Ingo, Here's a list of all the permutations > I've tried: one thing i noticed is that cyclesoak interferes with the netperf workload. This is quite surprising. 'top' and 'vmstat' output is reliable on -rt, and the overh

Re: Poor UDP performance using 2.6.21-rc5-rt5

2007-04-02 Thread [EMAIL PROTECTED]
Thanks for all the input Ingo, Here's a list of all the permutations I've tried: setupThruput CPU% from cyclesoak 2.6.21-rc5 vanilla 935 29% 2.6.21-rc5-rt5 711 50% //basically all of 1 cpu 2.6.21-rc5-rt8 733 52% 2.6.2

Re: Poor UDP performance using 2.6.21-rc5-rt5

2007-04-02 Thread Ingo Molnar
* Dave Sperry <[EMAIL PROTECTED]> wrote: > I checked the clock source and in both the vanilla and rt cases and > they were both acpi_pm ok, thanks for double-checking that. > Here's the oprofile for my vanilla case: i tried your workload and i think i managed to optimize it some more: i have

Re: Poor UDP performance using 2.6.21-rc5-rt5

2007-04-02 Thread Dave Sperry
Ingo Molnar wrote: * Dave Sperry <[EMAIL PROTECTED]> wrote: I have a dual core Opteron machine that exhibits poor UDP performance (RT consumes more than 2X cpu) with the 2.6.21-rc5-rt5 as compared to 2.6.21-rc5. Top shows the IRQ handler consuming a lot of CPU. update: even with acpi_pm cloc

Re: Poor UDP performance using 2.6.21-rc5-rt5

2007-04-02 Thread Ingo Molnar
* Dave Sperry <[EMAIL PROTECTED]> wrote: > I have a dual core Opteron machine that exhibits poor UDP performance > (RT consumes more than 2X cpu) with the 2.6.21-rc5-rt5 as compared to > 2.6.21-rc5. Top shows the IRQ handler consuming a lot of CPU. update: even with acpi_pm clocksource on vani

Re: Poor UDP performance using 2.6.21-rc5-rt5

2007-04-01 Thread Ingo Molnar
* Ingo Molnar <[EMAIL PROTECTED]> wrote: > one thing to check would be whether both kernels use the same > clocksource, via: > > cat /sys/devices/system/clocksource/clocksource0/current_clocksource > > but at first sight there's no clocksource related overhead in the > oprofile. i've starte

Re: Poor UDP performance using 2.6.21-rc5-rt5

2007-04-01 Thread Ingo Molnar
* Nivedita Singhvi <[EMAIL PROTECTED]> wrote: > Dave Sperry wrote: > >Hi > > (adding netdev to cc list) in general (except of course those netdev folks that are interested in -rt+networking performance matters) i'd suggest we analyze this in an -rt specific way - netdev shouldnt have to bothe

Re: Poor UDP performance using 2.6.21-rc5-rt5

2007-04-01 Thread Dave Sperry
Nivedita Singhvi wrote: Dave Sperry wrote: Hi (adding netdev to cc list) I have a dual core Opteron machine that exhibits poor UDP performance (RT consumes more than 2X cpu) with the 2.6.21-rc5-rt5 as compared to 2.6.21-rc5. Top shows the IRQ handler consuming a lot of CPU. Dave, any chan

Re: Poor UDP performance using 2.6.21-rc5-rt5

2007-04-01 Thread Nivedita Singhvi
Dave Sperry wrote: Hi (adding netdev to cc list) I have a dual core Opteron machine that exhibits poor UDP performance (RT consumes more than 2X cpu) with the 2.6.21-rc5-rt5 as compared to 2.6.21-rc5. Top shows the IRQ handler consuming a lot of CPU. Dave, any chance you've got oprofile wo

Poor UDP performance using 2.6.21-rc5-rt5

2007-04-01 Thread Dave Sperry
Hi I have a dual core Opteron machine that exhibits poor UDP performance (RT consumes more than 2X cpu) with the 2.6.21-rc5-rt5 as compared to 2.6.21-rc5. Top shows the IRQ handler consuming a lot of CPU. The mother board is a Supermicro H8DME-2 with one dual core Opteron installed. The netwo