Re: [RFC PATCH 00/10] Improve numa scheduling by consolidating tasks

2013-07-31 Thread Srikar Dronamraju
* Peter Zijlstra [2013-07-31 17:09:23]: > On Tue, Jul 30, 2013 at 03:16:50PM +0530, Srikar Dronamraju wrote: > > I am not against fault and fault based handling is very much needed. > > I have listed that this approach is complementary to numa faults that > > Mel is proposing. > > > > Right no

Re: [RFC PATCH 00/10] Improve numa scheduling by consolidating tasks

2013-07-31 Thread Srikar Dronamraju
* Peter Zijlstra [2013-07-30 11:33:21]: > On Tue, Jul 30, 2013 at 02:45:43PM +0530, Srikar Dronamraju wrote: > > > Can you please suggest workloads that I could try which might showcase > > why you hate pure process based approach? > > 2 processes, 1 sysvshm segment. I know there's multi-proces

Re: [RFC PATCH 00/10] Improve numa scheduling by consolidating tasks

2013-07-31 Thread Srikar Dronamraju
* Andrew Theurer [2013-07-31 08:33:44]: > ------------ > VM-node00| 49153(006%) 673792(083%)51712(006%) 36352(004%) > > I think the consolidation is a nice concept, but it needs a much tighter > integration with numa balancing

Re: [RFC PATCH 00/10] Improve numa scheduling by consolidating tasks

2013-07-31 Thread Peter Zijlstra
On Tue, Jul 30, 2013 at 03:16:50PM +0530, Srikar Dronamraju wrote: > I am not against fault and fault based handling is very much needed. > I have listed that this approach is complementary to numa faults that > Mel is proposing. > > Right now I think if we can first get the tasks to consolidate

Re: [RFC PATCH 00/10] Improve numa scheduling by consolidating tasks

2013-07-31 Thread Andrew Theurer
On Tue, 2013-07-30 at 13:18 +0530, Srikar Dronamraju wrote: > Here is an approach that looks to consolidate workloads across nodes. > This results in much improved performance. Again I would assume this work > is complementary to Mel's work with numa faulting. > > Here are the advantages of this a

Re: [RFC PATCH 00/10] Improve numa scheduling by consolidating tasks

2013-07-30 Thread Srikar Dronamraju
* Peter Zijlstra [2013-07-30 11:10:21]: > On Tue, Jul 30, 2013 at 02:33:45PM +0530, Srikar Dronamraju wrote: > > * Peter Zijlstra [2013-07-30 10:20:01]: > > > > > On Tue, Jul 30, 2013 at 10:17:55AM +0200, Peter Zijlstra wrote: > > > > On Tue, Jul 30, 2013 at 01:18:15PM +0530, Srikar Dronamraju

Re: [RFC PATCH 00/10] Improve numa scheduling by consolidating tasks

2013-07-30 Thread Peter Zijlstra
On Tue, Jul 30, 2013 at 02:45:43PM +0530, Srikar Dronamraju wrote: > Can you please suggest workloads that I could try which might showcase > why you hate pure process based approach? 2 processes, 1 sysvshm segment. I know there's multi-process MPI libraries out there. Something like: perf bench

Re: [RFC PATCH 00/10] Improve numa scheduling by consolidating tasks

2013-07-30 Thread Peter Zijlstra
On Tue, Jul 30, 2013 at 11:10:21AM +0200, Peter Zijlstra wrote: > On Tue, Jul 30, 2013 at 02:33:45PM +0530, Srikar Dronamraju wrote: > > * Peter Zijlstra [2013-07-30 10:20:01]: > > > > > On Tue, Jul 30, 2013 at 10:17:55AM +0200, Peter Zijlstra wrote: > > > > On Tue, Jul 30, 2013 at 01:18:15PM +05

Re: [RFC PATCH 00/10] Improve numa scheduling by consolidating tasks

2013-07-30 Thread Srikar Dronamraju
* Peter Zijlstra [2013-07-30 10:20:01]: > On Tue, Jul 30, 2013 at 10:17:55AM +0200, Peter Zijlstra wrote: > > On Tue, Jul 30, 2013 at 01:18:15PM +0530, Srikar Dronamraju wrote: > > > Here is an approach that looks to consolidate workloads across nodes. > > > This results in much improved performa

Re: [RFC PATCH 00/10] Improve numa scheduling by consolidating tasks

2013-07-30 Thread Peter Zijlstra
On Tue, Jul 30, 2013 at 02:33:45PM +0530, Srikar Dronamraju wrote: > * Peter Zijlstra [2013-07-30 10:20:01]: > > > On Tue, Jul 30, 2013 at 10:17:55AM +0200, Peter Zijlstra wrote: > > > On Tue, Jul 30, 2013 at 01:18:15PM +0530, Srikar Dronamraju wrote: > > > > Here is an approach that looks to con

Re: [RFC PATCH 00/10] Improve numa scheduling by consolidating tasks

2013-07-30 Thread Srikar Dronamraju
* Peter Zijlstra [2013-07-30 10:20:01]: > On Tue, Jul 30, 2013 at 10:17:55AM +0200, Peter Zijlstra wrote: > > On Tue, Jul 30, 2013 at 01:18:15PM +0530, Srikar Dronamraju wrote: > > > Here is an approach that looks to consolidate workloads across nodes. > > > This results in much improved performa

Re: [RFC PATCH 00/10] Improve numa scheduling by consolidating tasks

2013-07-30 Thread Peter Zijlstra
On Tue, Jul 30, 2013 at 10:17:55AM +0200, Peter Zijlstra wrote: > On Tue, Jul 30, 2013 at 01:18:15PM +0530, Srikar Dronamraju wrote: > > Here is an approach that looks to consolidate workloads across nodes. > > This results in much improved performance. Again I would assume this work > > is complem

Re: [RFC PATCH 00/10] Improve numa scheduling by consolidating tasks

2013-07-30 Thread Peter Zijlstra
On Tue, Jul 30, 2013 at 01:18:15PM +0530, Srikar Dronamraju wrote: > Here is an approach that looks to consolidate workloads across nodes. > This results in much improved performance. Again I would assume this work > is complementary to Mel's work with numa faulting. I highly dislike the use of ta

[RFC PATCH 00/10] Improve numa scheduling by consolidating tasks

2013-07-30 Thread Srikar Dronamraju
Here is an approach that looks to consolidate workloads across nodes. This results in much improved performance. Again I would assume this work is complementary to Mel's work with numa faulting. Here are the advantages of this approach. 1. Provides excellent consolidation of tasks. From my experi