Re: [PATCH 00/31] numa/core patches

2012-11-12 Thread Mel Gorman
On Sat, Nov 10, 2012 at 10:47:41AM +0800, Alex Shi wrote: > On Sat, Nov 3, 2012 at 8:21 PM, Mel Gorman wrote: > > On Sat, Nov 03, 2012 at 07:04:04PM +0800, Alex Shi wrote: > >> > > >> > In reality, this report is larger but I chopped it down a bit for > >> > brevity. autonuma beats schednuma *heav

Re: [PATCH 00/31] numa/core patches

2012-11-09 Thread Alex Shi
On Sat, Nov 3, 2012 at 8:21 PM, Mel Gorman wrote: > On Sat, Nov 03, 2012 at 07:04:04PM +0800, Alex Shi wrote: >> > >> > In reality, this report is larger but I chopped it down a bit for >> > brevity. autonuma beats schednuma *heavily* on this benchmark both in >> > terms of average operations per

Re: [PATCH 00/31] numa/core patches

2012-11-09 Thread Rik van Riel
On 10/30/2012 08:20 AM, Mel Gorman wrote: On Thu, Oct 25, 2012 at 02:16:17PM +0200, Peter Zijlstra wrote: Hi all, Here's a re-post of the NUMA scheduling and migration improvement patches that we are working on. These include techniques from AutoNUMA and the sched/numa tree and form a unified b

Re: [PATCH 00/31] numa/core patches

2012-11-05 Thread Srikar Dronamraju
Hey Peter, Here are results on 2node and 8node machine while running the autonuma benchmark. On 2 node, 12 core 24GB KernelVersion: 3.7.0-rc3

Re: [PATCH 00/31] numa/core patches

2012-11-03 Thread Mel Gorman
On Sat, Nov 03, 2012 at 07:04:04PM +0800, Alex Shi wrote: > > > > In reality, this report is larger but I chopped it down a bit for > > brevity. autonuma beats schednuma *heavily* on this benchmark both in > > terms of average operations per numa node and overall throughput. > > > > SPECJBB PEAKS >

Re: [PATCH 00/31] numa/core patches

2012-11-03 Thread Alex Shi
> > In reality, this report is larger but I chopped it down a bit for > brevity. autonuma beats schednuma *heavily* on this benchmark both in > terms of average operations per numa node and overall throughput. > > SPECJBB PEAKS >3.7.0 3.7

Re: [PATCH 00/31] numa/core patches

2012-11-02 Thread Hugh Dickins
On Fri, 2 Nov 2012, Zhouping Liu wrote: > On 11/01/2012 09:41 PM, Hugh Dickins wrote: > > > > Here's a patch fixing and tidying up that and a few other things there. > > But I'm not signing it off yet, partly because I've barely tested it > > (quite probably I didn't even have any numa pmd migrati

Re: [PATCH 00/31] numa/core patches

2012-11-01 Thread Zhouping Liu
On 11/01/2012 09:41 PM, Hugh Dickins wrote: On Wed, 31 Oct 2012, Hugh Dickins wrote: On Wed, 31 Oct 2012, Zhouping Liu wrote: On 10/31/2012 03:26 PM, Hugh Dickins wrote: There's quite a few put_page()s in do_huge_pmd_numa_page(), and it would help if we could focus on the one which is giving t

Re: [PATCH 00/31] numa/core patches

2012-11-01 Thread Hugh Dickins
On Wed, 31 Oct 2012, Hugh Dickins wrote: > On Wed, 31 Oct 2012, Zhouping Liu wrote: > > On 10/31/2012 03:26 PM, Hugh Dickins wrote: > > > > > > There's quite a few put_page()s in do_huge_pmd_numa_page(), and it > > > would help if we could focus on the one which is giving the trouble, > > > but I

Re: [PATCH 00/31] numa/core patches

2012-10-31 Thread Hugh Dickins
On Wed, 31 Oct 2012, Zhouping Liu wrote: > On 10/31/2012 03:26 PM, Hugh Dickins wrote: > > > > There's quite a few put_page()s in do_huge_pmd_numa_page(), and it > > would help if we could focus on the one which is giving the trouble, > > but I don't know which that is. Zhouping, if you can, plea

Re: [PATCH 00/31] numa/core patches

2012-10-31 Thread Zhouping Liu
On 10/31/2012 03:26 PM, Hugh Dickins wrote: On Tue, 30 Oct 2012, Johannes Weiner wrote: [88099.923724] [ cut here ] [88099.924036] kernel BUG at mm/memcontrol.c:1134! [88099.924036] invalid opcode: [#1] SMP [88099.924036] Modules linked in: lockd sunrpc kvm_amd kvm a

Re: [PATCH 00/31] numa/core patches

2012-10-31 Thread Hugh Dickins
On Tue, 30 Oct 2012, Johannes Weiner wrote: > On Tue, Oct 30, 2012 at 02:29:25PM +0800, Zhouping Liu wrote: > > On 10/29/2012 01:56 AM, Johannes Weiner wrote: > > >On Fri, Oct 26, 2012 at 11:08:00AM +0200, Peter Zijlstra wrote: > > >>On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: > > >>>[

Re: [PATCH 00/31] numa/core patches

2012-10-30 Thread Johannes Weiner
On Tue, Oct 30, 2012 at 02:29:25PM +0800, Zhouping Liu wrote: > On 10/29/2012 01:56 AM, Johannes Weiner wrote: > >On Fri, Oct 26, 2012 at 11:08:00AM +0200, Peter Zijlstra wrote: > >>On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: > >>>[ 180.918591] RIP: 0010:[] [] > >>>mem_cgroup_prepare_

Re: [PATCH 00/31] numa/core patches

2012-10-30 Thread Mel Gorman
On Tue, Oct 30, 2012 at 08:28:10AM -0700, Andrew Morton wrote: > > On Tue, 30 Oct 2012 12:20:32 + Mel Gorman wrote: > > > ... > > Useful testing - thanks. Did I miss the description of what > autonumabench actually does? How representitive is it of real-world > things? > It's not repres

Re: [PATCH 00/31] numa/core patches

2012-10-30 Thread Andrew Morton
On Tue, 30 Oct 2012 12:20:32 + Mel Gorman wrote: > ... Useful testing - thanks. Did I miss the description of what autonumabench actually does? How representitive is it of real-world things? > I also expect autonuma is continually scanning where as schednuma is > reacting to some other e

Re: [PATCH 00/31] numa/core patches

2012-10-30 Thread Mel Gorman
On Thu, Oct 25, 2012 at 02:16:17PM +0200, Peter Zijlstra wrote: > Hi all, > > Here's a re-post of the NUMA scheduling and migration improvement > patches that we are working on. These include techniques from > AutoNUMA and the sched/numa tree and form a unified basis - it > has got all the bits th

Re: [PATCH 00/31] numa/core patches

2012-10-29 Thread Zhouping Liu
On 10/29/2012 01:56 AM, Johannes Weiner wrote: On Fri, Oct 26, 2012 at 11:08:00AM +0200, Peter Zijlstra wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[] [] mem_cgroup_prepare_migration+0xba/0xd0 [ 182.681450] [] do_huge_pmd_numa_page+0x180/0x500 [ 1

Re: [PATCH 00/31] numa/core patches

2012-10-28 Thread Zhouping Liu
On 10/29/2012 01:56 AM, Johannes Weiner wrote: On Fri, Oct 26, 2012 at 11:08:00AM +0200, Peter Zijlstra wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[] [] mem_cgroup_prepare_migration+0xba/0xd0 [ 182.681450] [] do_huge_pmd_numa_page+0x180/0x500 [ 1

Re: [PATCH 00/31] numa/core patches

2012-10-28 Thread Johannes Weiner
On Fri, Oct 26, 2012 at 11:08:00AM +0200, Peter Zijlstra wrote: > On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: > > [ 180.918591] RIP: 0010:[] [] > > mem_cgroup_prepare_migration+0xba/0xd0 > > > [ 182.681450] [] do_huge_pmd_numa_page+0x180/0x500 > > [ 182.775090] [] handle_mm_fault

Re: [PATCH 00/31] numa/core patches

2012-10-26 Thread Ingo Molnar
* Zhouping Liu wrote: > On 10/26/2012 05:20 PM, Ingo Molnar wrote: > >* Peter Zijlstra wrote: > > > >>On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: > >>>[ 180.918591] RIP: 0010:[] [] > >>>mem_cgroup_prepare_migration+0xba/0xd0 > >>>[ 182.681450] [] do_huge_pmd_numa_page+0x180/0x50

Re: [PATCH 00/31] numa/core patches

2012-10-26 Thread Zhouping Liu
On 10/26/2012 05:20 PM, Ingo Molnar wrote: * Peter Zijlstra wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[] [] mem_cgroup_prepare_migration+0xba/0xd0 [ 182.681450] [] do_huge_pmd_numa_page+0x180/0x500 [ 182.775090] [] handle_mm_fault+0x1e9/0x360

Re: [PATCH 00/31] numa/core patches

2012-10-26 Thread Zhouping Liu
On 10/26/2012 05:20 PM, Ingo Molnar wrote: * Peter Zijlstra wrote: On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: [ 180.918591] RIP: 0010:[] [] mem_cgroup_prepare_migration+0xba/0xd0 [ 182.681450] [] do_huge_pmd_numa_page+0x180/0x500 [ 182.775090] [] handle_mm_fault+0x1e9/0x360

Re: [PATCH 00/31] numa/core patches

2012-10-26 Thread Ingo Molnar
* Peter Zijlstra wrote: > On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: > > [ 180.918591] RIP: 0010:[] [] > > mem_cgroup_prepare_migration+0xba/0xd0 > > > [ 182.681450] [] do_huge_pmd_numa_page+0x180/0x500 > > [ 182.775090] [] handle_mm_fault+0x1e9/0x360 > > [ 182.863038] [] _

Re: [PATCH 00/31] numa/core patches

2012-10-26 Thread Peter Zijlstra
On Fri, 2012-10-26 at 17:07 +0800, Zhouping Liu wrote: > [ 180.918591] RIP: 0010:[] [] > mem_cgroup_prepare_migration+0xba/0xd0 > [ 182.681450] [] do_huge_pmd_numa_page+0x180/0x500 > [ 182.775090] [] handle_mm_fault+0x1e9/0x360 > [ 182.863038] [] __do_page_fault+0x172/0x4e0 > [ 182.95057

[PATCH 00/31] numa/core patches

2012-10-25 Thread Peter Zijlstra
Hi all, Here's a re-post of the NUMA scheduling and migration improvement patches that we are working on. These include techniques from AutoNUMA and the sched/numa tree and form a unified basis - it has got all the bits that look good and mergeable. With these patches applied, the mbind system ca