On Fri, Feb 17, 2017 at 11:01:54AM -0500, Johannes Weiner wrote:
> On Thu, Feb 16, 2017 at 04:27:18PM -0800, Shaohua Li wrote:
> > On Thu, Feb 16, 2017 at 01:40:18PM -0500, Johannes Weiner wrote:
> > > On Tue, Feb 14, 2017 at 11:36:09AM -0800, Shaohua Li wrote:
> > > > @@ -911,7 +911,7 @@ static void page_check_dirty_writeback(struct page
> > > > *page,
> > > > * Anonymous pages are not handled by flushers and must be
> > > > written
> > > > * from reclaim context. Do not stall reclaim based on them
> > > > */
> > > > - if (!page_is_file_cache(page)) {
> > > > + if (!page_is_file_cache(page) || page_is_lazyfree(page)) {
> > >
> > > Do we need this? MADV_FREE clears the dirty bit off the page; we could
> > > just let them go through with the function without any special-casing.
> >
> > this is just to zero dirty and writeback
>
> Okay, I assumed that the page would always be !dirty && !writeback
> here anyway, so we might as well fall through and check those bits.
>
> But a previously failed TTU might have moved a pte dirty bit to the
> page, so yes, we do need to filter for anon && !swapbacked here.
>
> > > > @@ -1142,7 +1144,7 @@ static unsigned long shrink_page_list(struct
> > > > list_head *page_list,
> > > > * The page is mapped into the page tables of one or
> > > > more
> > > > * processes. Try to unmap it here.
> > > > */
> > > > - if (page_mapped(page) && mapping) {
> > > > + if (page_mapped(page) && (mapping || lazyfree)) {
> > >
> > > Do we actually need to filter for mapping || lazyfree? If we fail to
> > > allocate swap, we don't reach here. If the page is a truncated file
> > > page, ttu returns pretty much instantly with SWAP_AGAIN. We should be
> > > able to just check for page_mapped() alone, no?
> >
> > checking the mapping is faster than running into try_to_unamp, right?
>
> !mapping should be a rare case. In reclaim code, I think it's better
> to keep it simple than to optimize away the rare function call.
ok
> > > > @@ -1154,7 +1156,14 @@ static unsigned long shrink_page_list(struct
> > > > list_head *page_list,
> > > > case SWAP_MLOCK:
> > > > goto cull_mlocked;
> > > > case SWAP_LZFREE:
> > > > - goto lazyfree;
> > > > + /* follow __remove_mapping for
> > > > reference */
> > > > + if (page_ref_freeze(page, 1)) {
> > > > + if (!PageDirty(page))
> > > > + goto lazyfree;
> > > > + else
> > > > + page_ref_unfreeze(page,
> > > > 1);
> > > > + }
> > > > + goto keep_locked;
> > > > case SWAP_SUCCESS:
> > > > ; /* try to free the page below */
> > >
> > > This is a similar situation.
> > >
> > > Can we let the page go through the regular __remove_mapping() process
> > > and simply have that function check for PageAnon && !PageSwapBacked?
> >
> > That will make the code more complicated. We don't call __remove_mapping if
> > !mapping. And we need to do bypass in __remove_mapping, for example, avoid
> > taking mapping->lock.
>
> True, we won't get around a separate freeing path as long as the
> refcount handling is intertwined with the mapping removal like that :/
>
> What we should be able to do, however, is remove at least SWAP_LZFREE
> and stick with SWAP_SUCCESS. On success, we can fall through up until
> we do the __remove_mapping call. The page isn't dirty, so we skip that
> PageDirty block; the page doesn't have private data, so we skip that
> block too. And then we can branch on PageAnon && !PageSwapBacked that
> does our alternate freeing path or __remove_mapping for others.
Sounds good
> > > > @@ -1294,6 +1302,8 @@ static unsigned long shrink_page_list(struct
> > > > list_head *page_list,
> > > > cull_mlocked:
> > > > if (PageSwapCache(page))
> > > > try_to_free_swap(page);
> > > > + if (lazyfree)
> > > > + clear_page_lazyfree(page);
> > >
> > > Why cancel the MADV_FREE state? The combination seems non-sensical,
> > > but we can simply retain the invalidated state while the page goes to
> > > the unevictable list; munlock should move it back to inactive_file.
> >
> > This depends on the policy. If user locks the page, I think it's reasonable
> > to
> > assume the page is hot, so it doesn't make sense to treat the page lazyfree.
>
> I think the key issue is whether the page contains valid data, not
> whether it is hot. When we clear the dirty bits along with
> PageSwapBacked, we're declaring the data in the page invalid. There is
> no practical usecase to mlock a page with invalid data, sure, but the
> act of mlocking a page doesn't make its contents suddenly valid again.
>
> I.e. I'd stick with the pure data integrity perspective here. That's
> clearer and less error prone than intermingling it with eviction
> policy, to avoid accidents where we lose valid data.
The problem is if user mlock the page, it's very likely the user will dirty the
page soon. After the page is munlocked, putting it back to layyfree means page
reclaim will waste time to reclaim the page because it's dirty. But that said,
I don't argue about this. It's a rare case, so either way is ok to me.
> > > > unlock_page(page);
> > > > list_add(&page->lru, &ret_pages);
> > > > continue;
> > > > @@ -1303,6 +1313,8 @@ static unsigned long shrink_page_list(struct
> > > > list_head *page_list,
> > > > if (PageSwapCache(page) && mem_cgroup_swap_full(page))
> > > > try_to_free_swap(page);
> > > > VM_BUG_ON_PAGE(PageActive(page), page);
> > > > + if (lazyfree)
> > > > + clear_page_lazyfree(page);
> > >
> > > This is similar too.
> > >
> > > Can we leave simply leave the page alone here? The only way we get to
> > > this point is if somebody is reading the invalidated page. It's weird
> > > for a lazyfreed page to become active, but it doesn't seem to warrant
> > > active intervention here.
> >
> > So the unmap fails here probably because the page is dirty, which means the
> > page is written recently. It makes sense to assume the page is hot.
>
> Ah, good point.
>
> But can we handle that explicitly please? Like above, I don't want to
> undo the data invalidation just because somebody read the invalid data
> a bunch of times and it has the access bits set. We should only re-set
> the PageSwapBacked based on whether the page is actually dirty.
>
> Maybe along the lines of SWAP_MLOCK we could add SWAP_DIRTY when TTU
> fails because the page is dirty, and then have a cull_dirty: label in
> shrink_page_list handle the lazy rescue of a reused MADV_FREE page?
>
> This should work well with removing the mapping || lazyfree check when
> calling TTU. Then TTU can fail on dirty && !mapping, which is a much
> more obvious way of expressing it IMO - "This page contains valid data
> but there is no mapping that backs it once we unmap it. Abort."
>
> That's mostly why I'm in favor of removing the idea of a "lazyfree"
> page as much as possible. IMO this whole thing becomes much more
> understandable - and less bolted on to the side of the VM - when we
> express it in existing concepts the VM uses for data integrity.
Ok, it makes sense to only reset the PageSwapBacked bit for dirty page. In this
way, we jump to activate_locked for SWAP_DIRTY || (SWAP_FAIL && pagelazyfree)
and jump to activate_locked for SWAP_FAIL && !pagelazyfree. Is this what you
want to do? This will add extra checks for SWAP_FAIL. I'm not sure if this is
really worthy because it's rare the MADV_FREE page is read.
Thanks,
Shaohua
