Re: [rfc] superblock shrinker accumulating excessive deferred counts

2017-07-18 Thread Dave Chinner
On Tue, Jul 18, 2017 at 05:28:14PM -0700, David Rientjes wrote: > On Tue, 18 Jul 2017, Dave Chinner wrote: > > > > Thanks for looking into this, Dave! > > > > > > The number of GFP_NOFS allocations that build up the deferred counts can > > > be unbounded, however, so this can become excessive,

Re: [rfc] superblock shrinker accumulating excessive deferred counts

2017-07-18 Thread Dave Chinner
On Tue, Jul 18, 2017 at 05:28:14PM -0700, David Rientjes wrote: > On Tue, 18 Jul 2017, Dave Chinner wrote: > > > > Thanks for looking into this, Dave! > > > > > > The number of GFP_NOFS allocations that build up the deferred counts can > > > be unbounded, however, so this can become excessive,

Re: [rfc] superblock shrinker accumulating excessive deferred counts

2017-07-18 Thread David Rientjes
On Tue, 18 Jul 2017, Dave Chinner wrote: > > Thanks for looking into this, Dave! > > > > The number of GFP_NOFS allocations that build up the deferred counts can > > be unbounded, however, so this can become excessive, and the oom killer > > will not kill any processes in this context.

Re: [rfc] superblock shrinker accumulating excessive deferred counts

2017-07-18 Thread David Rientjes
On Tue, 18 Jul 2017, Dave Chinner wrote: > > Thanks for looking into this, Dave! > > > > The number of GFP_NOFS allocations that build up the deferred counts can > > be unbounded, however, so this can become excessive, and the oom killer > > will not kill any processes in this context.

Re: [rfc] superblock shrinker accumulating excessive deferred counts

2017-07-17 Thread Dave Chinner
On Mon, Jul 17, 2017 at 01:37:35PM -0700, David Rientjes wrote: > On Mon, 17 Jul 2017, Dave Chinner wrote: > > > > This is a side effect of super_cache_count() returning the appropriate > > > count but super_cache_scan() refusing to do anything about it and > > > immediately terminating with

Re: [rfc] superblock shrinker accumulating excessive deferred counts

2017-07-17 Thread Dave Chinner
On Mon, Jul 17, 2017 at 01:37:35PM -0700, David Rientjes wrote: > On Mon, 17 Jul 2017, Dave Chinner wrote: > > > > This is a side effect of super_cache_count() returning the appropriate > > > count but super_cache_scan() refusing to do anything about it and > > > immediately terminating with

Re: [rfc] superblock shrinker accumulating excessive deferred counts

2017-07-17 Thread David Rientjes
On Mon, 17 Jul 2017, Dave Chinner wrote: > > This is a side effect of super_cache_count() returning the appropriate > > count but super_cache_scan() refusing to do anything about it and > > immediately terminating with SHRINK_STOP, mostly for GFP_NOFS allocations. > > Yup. Happens during

Re: [rfc] superblock shrinker accumulating excessive deferred counts

2017-07-17 Thread David Rientjes
On Mon, 17 Jul 2017, Dave Chinner wrote: > > This is a side effect of super_cache_count() returning the appropriate > > count but super_cache_scan() refusing to do anything about it and > > immediately terminating with SHRINK_STOP, mostly for GFP_NOFS allocations. > > Yup. Happens during

Re: [rfc] superblock shrinker accumulating excessive deferred counts

2017-07-16 Thread Dave Chinner
On Wed, Jul 12, 2017 at 01:42:35PM -0700, David Rientjes wrote: > Hi Al and everyone, > > We're encountering an issue where the per-shrinker per-node deferred > counts grow excessively large for the superblock shrinker. This appears > to be long-standing behavior, so reaching out to you to see

Re: [rfc] superblock shrinker accumulating excessive deferred counts

2017-07-16 Thread Dave Chinner
On Wed, Jul 12, 2017 at 01:42:35PM -0700, David Rientjes wrote: > Hi Al and everyone, > > We're encountering an issue where the per-shrinker per-node deferred > counts grow excessively large for the superblock shrinker. This appears > to be long-standing behavior, so reaching out to you to see

[rfc] superblock shrinker accumulating excessive deferred counts

2017-07-12 Thread David Rientjes
Hi Al and everyone, We're encountering an issue where the per-shrinker per-node deferred counts grow excessively large for the superblock shrinker. This appears to be long-standing behavior, so reaching out to you to see if there's any subtleties being overlooked since there is a reference to

[rfc] superblock shrinker accumulating excessive deferred counts

2017-07-12 Thread David Rientjes
Hi Al and everyone, We're encountering an issue where the per-shrinker per-node deferred counts grow excessively large for the superblock shrinker. This appears to be long-standing behavior, so reaching out to you to see if there's any subtleties being overlooked since there is a reference to