Re: Machine lockups on extreme memory pressure

2020-10-30 Thread Shakeel Butt
On Tue, Sep 22, 2020 at 10:01 AM Michal Hocko wrote: > > On Tue 22-09-20 09:51:30, Shakeel Butt wrote: > > On Tue, Sep 22, 2020 at 9:34 AM Michal Hocko wrote: > > > > > > On Tue 22-09-20 09:29:48, Shakeel Butt wrote: > [...] > > > > Anyways, what do you think of the in-kernel PSI based > > > > oo

Re: Machine lockups on extreme memory pressure

2020-09-22 Thread Michal Hocko
On Tue 22-09-20 09:51:30, Shakeel Butt wrote: > On Tue, Sep 22, 2020 at 9:34 AM Michal Hocko wrote: > > > > On Tue 22-09-20 09:29:48, Shakeel Butt wrote: [...] > > > Anyways, what do you think of the in-kernel PSI based > > > oom-kill trigger. I think Johannes had a prototype as well. > > > > We h

Re: Machine lockups on extreme memory pressure

2020-09-22 Thread Shakeel Butt
On Tue, Sep 22, 2020 at 9:34 AM Michal Hocko wrote: > > On Tue 22-09-20 09:29:48, Shakeel Butt wrote: > > On Tue, Sep 22, 2020 at 8:16 AM Michal Hocko wrote: > > > > > > On Tue 22-09-20 06:37:02, Shakeel Butt wrote: > [...] > > > > I talked about this problem with Johannes at LPC 2019 and I think

Re: Machine lockups on extreme memory pressure

2020-09-22 Thread Michal Hocko
On Tue 22-09-20 09:29:48, Shakeel Butt wrote: > On Tue, Sep 22, 2020 at 8:16 AM Michal Hocko wrote: > > > > On Tue 22-09-20 06:37:02, Shakeel Butt wrote: [...] > > > I talked about this problem with Johannes at LPC 2019 and I think we > > > talked about two potential solutions. First was to someho

Re: Machine lockups on extreme memory pressure

2020-09-22 Thread Shakeel Butt
On Tue, Sep 22, 2020 at 8:16 AM Michal Hocko wrote: > > On Tue 22-09-20 06:37:02, Shakeel Butt wrote: > [...] > > > I would recommend to focus on tracking down the who is blocking the > > > further progress. > > > > I was able to find the CPU next in line for the list_lock from the > > dump. I don

Re: Machine lockups on extreme memory pressure

2020-09-22 Thread Michal Hocko
On Tue 22-09-20 06:37:02, Shakeel Butt wrote: [...] > > I would recommend to focus on tracking down the who is blocking the > > further progress. > > I was able to find the CPU next in line for the list_lock from the > dump. I don't think anyone is blocking the progress as such but more > like the

Re: Machine lockups on extreme memory pressure

2020-09-22 Thread Shakeel Butt
On Tue, Sep 22, 2020 at 4:12 AM Michal Hocko wrote: > > On Mon 21-09-20 11:35:35, Shakeel Butt wrote: > > Hi all, > > > > We are seeing machine lockups due extreme memory pressure where the > > free pages on all the zones are way below the min watermarks. The stack > > of the stuck CPU looks like

Re: Machine lockups on extreme memory pressure

2020-09-22 Thread Michal Hocko
On Mon 21-09-20 11:35:35, Shakeel Butt wrote: > Hi all, > > We are seeing machine lockups due extreme memory pressure where the > free pages on all the zones are way below the min watermarks. The stack > of the stuck CPU looks like the following (I had to crash the machine to > get the info). sys