Re: [RFC PATCH 00/27] Move LRU page reclaim from zones to nodes v2

2016-02-24 Thread Mel Gorman
On Tue, Feb 23, 2016 at 04:12:01PM -0800, Johannes Weiner wrote: > > > > > If reclaim can't guarantee a balanced zone utilization then the > > > > > allocator has to keep doing it. :( > > > > > > > > That's the key issue - the main reason balanced zone utilisation is > > > > necessary is because w

Re: [RFC PATCH 00/27] Move LRU page reclaim from zones to nodes v2

2016-02-23 Thread Johannes Weiner
On Tue, Feb 23, 2016 at 09:58:59PM +, Mel Gorman wrote: > On Tue, Feb 23, 2016 at 12:59:15PM -0800, Johannes Weiner wrote: > > The problem is that kswapd will stay awake and continuously draw > > subsequent allocations into a single zone, thus utilizing only a > > fraction of available memory.

Re: [RFC PATCH 00/27] Move LRU page reclaim from zones to nodes v2

2016-02-23 Thread Mel Gorman
On Tue, Feb 23, 2016 at 12:59:15PM -0800, Johannes Weiner wrote: > On Tue, Feb 23, 2016 at 08:19:32PM +, Mel Gorman wrote: > > On Tue, Feb 23, 2016 at 12:04:16PM -0800, Johannes Weiner wrote: > > > On Tue, Feb 23, 2016 at 03:04:23PM +, Mel Gorman wrote: > > > > In many benchmarks, there is

Re: [RFC PATCH 00/27] Move LRU page reclaim from zones to nodes v2

2016-02-23 Thread Johannes Weiner
On Tue, Feb 23, 2016 at 08:19:32PM +, Mel Gorman wrote: > On Tue, Feb 23, 2016 at 12:04:16PM -0800, Johannes Weiner wrote: > > On Tue, Feb 23, 2016 at 03:04:23PM +, Mel Gorman wrote: > > > In many benchmarks, there is an obvious difference in the number of > > > allocations from each zone a

Re: [RFC PATCH 00/27] Move LRU page reclaim from zones to nodes v2

2016-02-23 Thread Mel Gorman
On Tue, Feb 23, 2016 at 12:04:16PM -0800, Johannes Weiner wrote: > On Tue, Feb 23, 2016 at 03:04:23PM +, Mel Gorman wrote: > > In many benchmarks, there is an obvious difference in the number of > > allocations from each zone as the fair zone allocation policy is removed > > towards the end of

Re: [RFC PATCH 00/27] Move LRU page reclaim from zones to nodes v2

2016-02-23 Thread Johannes Weiner
On Tue, Feb 23, 2016 at 03:04:23PM +, Mel Gorman wrote: > In many benchmarks, there is an obvious difference in the number of > allocations from each zone as the fair zone allocation policy is removed > towards the end of the series. For example, this is the allocation stats > when running blog

Re: [RFC PATCH 00/27] Move LRU page reclaim from zones to nodes v2

2016-02-23 Thread Christoph Lameter
On Tue, 23 Feb 2016, Mel Gorman wrote: > Conceptually, moving to node LRUs should be easier to understand. The > page allocator plays fewer tricks to game reclaim and reclaim behaves > similarly on all nodes. I think this is a good way to simplify reclaim and limit the nasty effects of zones a bi

[RFC PATCH 00/27] Move LRU page reclaim from zones to nodes v2

2016-02-23 Thread Mel Gorman
(sorry for the resend, outgoing smtp went haywire so trying again) This is a revisit of an RFC series from last year that moves LRUs from the zones to the node. It is based on mmotm from February 9th as it had to be rebased on top of work there and will not apply cleanly to 4.5-rc* Conceptually, t

[RFC PATCH 00/27] Move LRU page reclaim from zones to nodes v2

2016-02-23 Thread Mel Gorman
This is a revisit of an RFC series from last year that moves LRUs from the zones to the node. It is based on mmotm from February 9th as it had to be rebased on top of work there and will not apply cleanly to 4.5-rc* Conceptually, this is simple but there are a lot of details. Some of the broad moti