Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-25 Thread Grant Grundler
On Tue, Jan 25, 2005 at 09:02:34AM -0500, Mukker, Atul wrote: > The megaraid driver is open source, do you see anything that driver can do > to improve performance. We would greatly appreciate any feedback in this > regard and definitely incorporate in the driver. The FW under Linux and > windows i

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-25 Thread Mel Gorman
On Tue, 25 Jan 2005, Andi Kleen wrote: > On Tue, Jan 25, 2005 at 09:02:34AM -0500, Mukker, Atul wrote: > > > > > e.g. performance on megaraid controllers (very popular > > > because a big PC vendor ships them) was always quite bad on > > > Linux. Up to the point that specific IO workloads run half

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-25 Thread Andi Kleen
On Tue, Jan 25, 2005 at 09:02:34AM -0500, Mukker, Atul wrote: > > > e.g. performance on megaraid controllers (very popular > > because a big PC vendor ships them) was always quite bad on > > Linux. Up to the point that specific IO workloads run half as > > fast on a megaraid compared to other

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-25 Thread Andi Kleen
On Tue, Jan 25, 2005 at 02:27:57PM +, Christoph Hellwig wrote: > > It is not the driver per se, but the way the memory which is the I/O > > source/target is presented to the driver. In linux there is a good > > chance it will have to use more scatter gather elements to represent > > the same am

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-25 Thread Christoph Hellwig
> It is not the driver per se, but the way the memory which is the I/O > source/target is presented to the driver. In linux there is a good > chance it will have to use more scatter gather elements to represent > the same amount of data. Note that a change made a few month ago after seeing issues

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-25 Thread Steve Lord
Mukker, Atul wrote: LSI would leave no stone unturned to make the performance better for megaraid controllers under Linux. If you have some hard data in relation to comparison of performance for adapters from other vendors, please share with us. We would definitely strive to better it. The megaraid

RE: [PATCH] Avoiding fragmentation through different allocator

2005-01-25 Thread Mukker, Atul
> e.g. performance on megaraid controllers (very popular > because a big PC vendor ships them) was always quite bad on > Linux. Up to the point that specific IO workloads run half as > fast on a megaraid compared to other controllers. I heard > they do work better on Windows. > > Ideally th

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-24 Thread Andi Kleen
Steve Lord <[EMAIL PROTECTED]> writes: > > I realize this is one data point on one end of the scale, but I > just wanted to make the point that there are cases where it > does matter. Hopefully William's little change from last > year has helped out a lot. There are more datapoints: e.g. perform

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-24 Thread Steve Lord
James Bottomley wrote: Well, the basic advice would be not to worry too much about fragmentation from the point of view of I/O devices. They mostly all do scatter gather (SG) onboard as an intelligent processing operation and they're very good at it. No one has ever really measured an effect we ca

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-24 Thread James Bottomley
On Mon, 2005-01-24 at 13:49 -0200, Marcelo Tosatti wrote: > So is it valid to affirm that on average an operation with one SG element > pointing to a 1MB > region is similar in speed to an operation with 16 SG elements each pointing > to a 64K > region due to the efficient onboard SG processing

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-24 Thread Grant Grundler
On Mon, Jan 24, 2005 at 10:29:52AM -0200, Marcelo Tosatti wrote: > Grant Grundler and James Bottomley have been working on this area, > they might want to add some comments to this discussion. > > It seems HP (Grant et all) has pursued using big pages on IA64 (64K) > for this purpose. Marcello, T

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-24 Thread Marcelo Tosatti
On Mon, Jan 24, 2005 at 10:44:12AM -0600, James Bottomley wrote: > On Mon, 2005-01-24 at 10:29 -0200, Marcelo Tosatti wrote: > > Since the pages which compose IO operations are most likely sparse (not > > physically contiguous), > > the driver+device has to perform scatter-gather IO on the pages.

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-24 Thread James Bottomley
On Mon, 2005-01-24 at 10:29 -0200, Marcelo Tosatti wrote: > Since the pages which compose IO operations are most likely sparse (not > physically contiguous), > the driver+device has to perform scatter-gather IO on the pages. > > The idea is that if we can have larger memory blocks scatter-gather

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-24 Thread Marcelo Tosatti
James and Grant added to CC. On Mon, Jan 24, 2005 at 01:28:47PM +, Mel Gorman wrote: > On Sat, 22 Jan 2005, Marcelo Tosatti wrote: > > > > > I was thinking that it would be nice to have a set of high-order > > > > intensive workloads, and I wonder what are the most common high-order > > > >

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-24 Thread Mel Gorman
On Sat, 22 Jan 2005, Marcelo Tosatti wrote: > > > I was thinking that it would be nice to have a set of high-order > > > intensive workloads, and I wonder what are the most common high-order > > > allocation paths which fail. > > > > > > > Agreed. As I am not fully sure what workloads require high

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-23 Thread Marcelo Tosatti
On Sat, Jan 22, 2005 at 07:59:49PM -0200, Marcelo Tosatti wrote: > On Sat, Jan 22, 2005 at 09:48:20PM +, Mel Gorman wrote: > > On Fri, 21 Jan 2005, Marcelo Tosatti wrote: > > > > > On Thu, Jan 20, 2005 at 10:13:00AM +, Mel Gorman wrote: > > > > > > > > > > Hi Mel, > > > > > > I was thinki

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-22 Thread Marcelo Tosatti
On Sat, Jan 22, 2005 at 09:48:20PM +, Mel Gorman wrote: > On Fri, 21 Jan 2005, Marcelo Tosatti wrote: > > > On Thu, Jan 20, 2005 at 10:13:00AM +, Mel Gorman wrote: > > > > > > > Hi Mel, > > > > I was thinking that it would be nice to have a set of high-order > > intensive workloads, and I

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-22 Thread Mel Gorman
On Fri, 21 Jan 2005, Marcelo Tosatti wrote: > On Thu, Jan 20, 2005 at 10:13:00AM +, Mel Gorman wrote: > > > > Hi Mel, > > I was thinking that it would be nice to have a set of high-order > intensive workloads, and I wonder what are the most common high-order > allocation paths which fail. >

Re: [PATCH] Avoiding fragmentation through different allocator

2005-01-21 Thread Marcelo Tosatti
On Thu, Jan 20, 2005 at 10:13:00AM +, Mel Gorman wrote: > Changelog since V5 > o Fixed up gcc-2.95 errors > o Fixed up whitespace damage > > Changelog since V4 > o No changes. Applies cleanly against 2.6.11-rc1 and 2.6.11-rc1-bk6. Applies > with offsets to 2.6.11-rc1-mm1 > > Changelog since

[PATCH] Avoiding fragmentation through different allocator

2005-01-20 Thread Mel Gorman
Changelog since V5 o Fixed up gcc-2.95 errors o Fixed up whitespace damage Changelog since V4 o No changes. Applies cleanly against 2.6.11-rc1 and 2.6.11-rc1-bk6. Applies with offsets to 2.6.11-rc1-mm1 Changelog since V3 o inlined get_pageblock_type() and set_pageblock_type() o set_pageblock_ty

[PATCH] Avoiding fragmentation through different allocator

2005-01-20 Thread Mel Gorman
- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/

Re: [PATCH] Avoiding fragmentation through different allocator V2

2005-01-16 Thread Mel Gorman
On Sun, 16 Jan 2005, Marcelo Tosatti wrote: > > No unfortunately. Do you know of a test I can use? > > Some STP reaim results have significant performance increase in general, a few > small regressions. > > I think that depending on the type of access pattern of the application(s) > there > will

Re: [PATCH] Avoiding fragmentation through different allocator V2

2005-01-16 Thread Marcelo Tosatti
On Sat, Jan 15, 2005 at 07:18:42PM +, Mel Gorman wrote: > On Fri, 14 Jan 2005, Marcelo Tosatti wrote: > > > On Thu, Jan 13, 2005 at 03:56:46PM +, Mel Gorman wrote: > > > The patch is against 2.6.11-rc1 and I'm willing to stand by it's > > > stability. I'm also confident it does it's job pr

Re: [PATCH] Avoiding fragmentation through different allocator V2

2005-01-16 Thread Mel Gorman
> > That is possible but it I haven't thought of a way of measuring the cache > > colouring effects (if any). There is also the problem that the additional > > complexity of the allocator will offset this benefit. The two main loss > > points of the allocator are increased complexity and the incre

Re: [PATCH] Avoiding fragmentation through different allocator V2

2005-01-15 Thread Marcelo Tosatti
On Sat, Jan 15, 2005 at 07:18:42PM +, Mel Gorman wrote: > On Fri, 14 Jan 2005, Marcelo Tosatti wrote: > > > On Thu, Jan 13, 2005 at 03:56:46PM +, Mel Gorman wrote: > > > The patch is against 2.6.11-rc1 and I'm willing to stand by it's > > > stability. I'm also confident it does it's job pr

Re: [PATCH] Avoiding fragmentation through different allocator V2

2005-01-15 Thread Mel Gorman
On Fri, 14 Jan 2005, Marcelo Tosatti wrote: > On Thu, Jan 13, 2005 at 03:56:46PM +, Mel Gorman wrote: > > The patch is against 2.6.11-rc1 and I'm willing to stand by it's > > stability. I'm also confident it does it's job pretty well so I'd like it > > to be considered for inclusion. > > This