On Sun, Aug 18, 2024 at 11:48 AM Barry Song <21cn...@gmail.com> wrote:
>
> On Sun, Aug 18, 2024 at 2:55 PM Yafang Shao <laoar.s...@gmail.com> wrote:
> >
> > On Sat, Aug 17, 2024 at 2:25 PM Barry Song <21cn...@gmail.com> wrote:
> > >
> > > From: Barry Song <v-songbao...@oppo.com>
> > >
> > > When users allocate memory with the __GFP_NOFAIL flag, they might
> > > incorrectly use it alongside GFP_ATOMIC, GFP_NOWAIT, etc. This kind of
> > > non-blockable __GFP_NOFAIL is not supported and is pointless. If we
> > > attempt and still fail to allocate memory for these users, we have two
> > > choices:
> > >
> > > 1. We could busy-loop and hope that some other direct reclamation or
> > > kswapd rescues the current process. However, this is unreliable
> > > and could ultimately lead to hard or soft lockups,
> >
> > That can occur even if we set both __GFP_NOFAIL and
> > __GFP_DIRECT_RECLAIM, right? So, I don't believe the issue is related
> > to setting __GFP_DIRECT_RECLAIM; rather, it stems from the flawed
> > design of __GFP_NOFAIL itself.
>
> the point of GFP_NOFAIL is that it won't fail and its user won't check
> the return value. without direct_reclamation, it is sometimes impossible.
> but with direct reclamation, users constantly wait and finally they can
So, what exactly is the difference between 'constantly waiting' and
'busy looping'? Could you please clarify? Also, why can't we
'constantly wait' when __GFP_DIRECT_RECLAIM is not set?
> get memory. if you read the doc of __GFP_NOFAIL you will find it.
> it is absolutely clearly documented.
>
> >
> > > which might not
> > > be well supported by some architectures.
> > >
> > > 2. We could use BUG_ON to trigger a reliable system crash, avoiding
> > > exposing NULL dereference.
> > >
> > > Neither option is ideal, but both are improvements over the existing code.
> > > This patch selects the second option because, with the introduction of
> > > scoped API and GFP_NOFAIL—capable of enforcing direct reclamation for
> > > nofail users(which is in my plan), non-blockable nofail allocations will
> > > no longer be possible.
> > >
> > > Signed-off-by: Barry Song <v-songbao...@oppo.com>
> > > Cc: Michal Hocko <mho...@suse.com>
> > > Cc: Uladzislau Rezki (Sony) <ure...@gmail.com>
> > > Cc: Christoph Hellwig <h...@infradead.org>
> > > Cc: Lorenzo Stoakes <lorenzo.stoa...@oracle.com>
> > > Cc: Christoph Lameter <c...@linux.com>
> > > Cc: Pekka Enberg <penb...@kernel.org>
> > > Cc: David Rientjes <rient...@google.com>
> > > Cc: Joonsoo Kim <iamjoonsoo....@lge.com>
> > > Cc: Vlastimil Babka <vba...@suse.cz>
> > > Cc: Roman Gushchin <roman.gushc...@linux.dev>
> > > Cc: Hyeonggon Yoo <42.hye...@gmail.com>
> > > Cc: Linus Torvalds <torva...@linux-foundation.org>
> > > Cc: Kees Cook <k...@kernel.org>
> > > Cc: "Eugenio Pérez" <epere...@redhat.com>
> > > Cc: Hailong.Liu <hailong....@oppo.com>
> > > Cc: Jason Wang <jasow...@redhat.com>
> > > Cc: Maxime Coquelin <maxime.coque...@redhat.com>
> > > Cc: "Michael S. Tsirkin" <m...@redhat.com>
> > > Cc: Xuan Zhuo <xuanz...@linux.alibaba.com>
> > > ---
> > > mm/page_alloc.c | 10 +++++-----
> > > 1 file changed, 5 insertions(+), 5 deletions(-)
> > >
> > > diff --git a/mm/page_alloc.c b/mm/page_alloc.c
> > > index d2c37f8f8d09..fb5850ecd3ae 100644
> > > --- a/mm/page_alloc.c
> > > +++ b/mm/page_alloc.c
> > > @@ -4399,11 +4399,11 @@ __alloc_pages_slowpath(gfp_t gfp_mask, unsigned
> > > int order,
> > > */
> > > if (gfp_mask & __GFP_NOFAIL) {
> > > /*
> > > - * All existing users of the __GFP_NOFAIL are blockable,
> > > so warn
> > > - * of any new users that actually require GFP_NOWAIT
> > > + * All existing users of the __GFP_NOFAIL are blockable
> > > + * otherwise we introduce a busy loop with inside the page
> > > + * allocator from non-sleepable contexts
> > > */
> > > - if (WARN_ON_ONCE_GFP(!can_direct_reclaim, gfp_mask))
> > > - goto fail;
> > > + BUG_ON(!can_direct_reclaim);
> >
> > I'm not in favor of using BUG_ON() here, as many call sites already
> > handle the return value of __GFP_NOFAIL.
> >
>
> it is not correct to handle the return value of __GFP_NOFAIL.
> if you check the ret, don't use __GFP_NOFAIL.
If so, you have many code changes to make in the linux kernel ;)
>
> > If we believe BUG_ON() is necessary, why not place it at the beginning
> > of __alloc_pages_slowpath() instead of after numerous operations,
> > which could potentially obscure the issue?
>
> to some extent I agree with you. but the point here is that we might
> want to avoid this check in the hot path. so basically, we check when
> we have to check. in 99%+ case, this check can be avoided.
It's on the slow path, but that's not the main point here.
--
Regards
Yafang
