Re: [patch 0/8] mm: thrash detection-based file cache sizing v5

2013-11-14 Thread Rik van Riel
On 10/21/2013 05:26 AM, Vlastimil Babka wrote: On 10/10/2013 11:46 PM, Johannes Weiner wrote: Hi everyone, here is an update to the cache sizing patches for 3.13. Changes in this revision o Drop frequency synchronization between refaulted and demoted pages and just straight up acti

Re: [patch 0/8] mm: thrash detection-based file cache sizing v5

2013-11-14 Thread Rik van Riel
On 11/12/2013 05:30 AM, Bob Liu wrote: Hi Johannes, On Fri, Oct 11, 2013 at 5:46 AM, Johannes Weiner wrote: Future Right now we have a fixed ratio (50:50) between inactive and active list but we already have complaints about working sets exceeding half of memory being pushed out of t

Re: [patch 0/8] mm: thrash detection-based file cache sizing v5

2013-11-12 Thread Bob Liu
Hi Johannes, On Fri, Oct 11, 2013 at 5:46 AM, Johannes Weiner wrote: > Future > > Right now we have a fixed ratio (50:50) between inactive and active > list but we already have complaints about working sets exceeding half > of memory being pushed out of the cache by simple used-once strea

Re: [patch 0/8] mm: thrash detection-based file cache sizing v5

2013-10-22 Thread Johannes Weiner
On Mon, Oct 21, 2013 at 11:26:43AM +0200, Vlastimil Babka wrote: > On 10/10/2013 11:46 PM, Johannes Weiner wrote: > > Hi everyone, > > > > here is an update to the cache sizing patches for 3.13. > > > > Changes in this revision > > > > o Drop frequency synchronization between refaulted and d

Re: [patch 0/8] mm: thrash detection-based file cache sizing v5

2013-10-21 Thread Dave Chinner
On Wed, Oct 16, 2013 at 06:31:04PM -0400, Johannes Weiner wrote: > On Wed, Oct 16, 2013 at 01:26:06PM +1100, Dave Chinner wrote: > > On Tue, Oct 15, 2013 at 10:05:26PM -0400, Rik van Riel wrote: > > > On 10/15/2013 07:41 PM, Dave Chinner wrote: > > > > On Tue, Oct 15, 2013 at 01:41:28PM -0400, Joha

Re: [patch 0/8] mm: thrash detection-based file cache sizing v5

2013-10-21 Thread Vlastimil Babka
On 10/10/2013 11:46 PM, Johannes Weiner wrote: > Hi everyone, > > here is an update to the cache sizing patches for 3.13. > > Changes in this revision > > o Drop frequency synchronization between refaulted and demoted pages > and just straight up activate refaulting pages whose access >

Re: [patch 0/8] mm: thrash detection-based file cache sizing v5

2013-10-16 Thread Johannes Weiner
On Wed, Oct 16, 2013 at 01:26:06PM +1100, Dave Chinner wrote: > On Tue, Oct 15, 2013 at 10:05:26PM -0400, Rik van Riel wrote: > > On 10/15/2013 07:41 PM, Dave Chinner wrote: > > > On Tue, Oct 15, 2013 at 01:41:28PM -0400, Johannes Weiner wrote: > > > > >> I'm not forgetting about them, I just trac

Re: [patch 0/8] mm: thrash detection-based file cache sizing v5

2013-10-15 Thread Dave Chinner
On Tue, Oct 15, 2013 at 10:05:26PM -0400, Rik van Riel wrote: > On 10/15/2013 07:41 PM, Dave Chinner wrote: > > On Tue, Oct 15, 2013 at 01:41:28PM -0400, Johannes Weiner wrote: > > >> I'm not forgetting about them, I just track them very coarsely by > >> linking up address spaces and then lazily e

Re: [patch 0/8] mm: thrash detection-based file cache sizing v5

2013-10-15 Thread Rik van Riel
On 10/15/2013 07:41 PM, Dave Chinner wrote: > On Tue, Oct 15, 2013 at 01:41:28PM -0400, Johannes Weiner wrote: >> I'm not forgetting about them, I just track them very coarsely by >> linking up address spaces and then lazily enforce their upper limit >> when memory is tight by using the shrinker c

Re: [patch 0/8] mm: thrash detection-based file cache sizing v5

2013-10-15 Thread Dave Chinner
On Tue, Oct 15, 2013 at 01:41:28PM -0400, Johannes Weiner wrote: > On Tue, Oct 15, 2013 at 12:41:23PM +1100, Dave Chinner wrote: > > On Mon, Oct 14, 2013 at 05:42:50PM -0400, Johannes Weiner wrote: > > > Hi Dave, > > > > > > On Fri, Oct 11, 2013 at 11:39:30AM +1100, Dave Chinner wrote: > > > > On

Re: [patch 0/8] mm: thrash detection-based file cache sizing v5

2013-10-15 Thread Johannes Weiner
On Tue, Oct 15, 2013 at 12:41:23PM +1100, Dave Chinner wrote: > On Mon, Oct 14, 2013 at 05:42:50PM -0400, Johannes Weiner wrote: > > Hi Dave, > > > > On Fri, Oct 11, 2013 at 11:39:30AM +1100, Dave Chinner wrote: > > > On Thu, Oct 10, 2013 at 05:46:54PM -0400, Johannes Weiner wrote: > > > >

Re: [patch 0/8] mm: thrash detection-based file cache sizing v5

2013-10-15 Thread Jan Kara
On Tue 15-10-13 12:41:23, Dave Chinner wrote: > Then you have a serious design flaw if you are relying on a shrinker > to control memory consumed by page cache radix trees as a result of > page cache reclaim inserting exceptional entries into the radix > tree and then forgetting about them. > > To

Re: [patch 0/8] mm: thrash detection-based file cache sizing v5

2013-10-14 Thread Dave Chinner
On Mon, Oct 14, 2013 at 05:42:50PM -0400, Johannes Weiner wrote: > Hi Dave, > > On Fri, Oct 11, 2013 at 11:39:30AM +1100, Dave Chinner wrote: > > On Thu, Oct 10, 2013 at 05:46:54PM -0400, Johannes Weiner wrote: > > > Costs > > > > > > These patches increase struct inode by three words to manage

Re: [patch 0/8] mm: thrash detection-based file cache sizing v5

2013-10-14 Thread Johannes Weiner
Hi Dave, On Fri, Oct 11, 2013 at 11:39:30AM +1100, Dave Chinner wrote: > On Thu, Oct 10, 2013 at 05:46:54PM -0400, Johannes Weiner wrote: > > Costs > > > > These patches increase struct inode by three words to manage shadow > > entries in the page cache radix tree. > > An additional 24 bytes

Re: [patch 0/8] mm: thrash detection-based file cache sizing v5

2013-10-10 Thread Dave Chinner
On Thu, Oct 10, 2013 at 05:46:54PM -0400, Johannes Weiner wrote: > Costs > > These patches increase struct inode by three words to manage shadow > entries in the page cache radix tree. An additional 24 bytes on a 64 bit system. Filesystem developers will kill to save 4 bytes in the struct i