[PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-06-07 Thread Michal Hocko
On Thu 06-06-13 18:16:33, azurIt wrote: > Hello Michal, > > nice to read you! :) Yes, i'm still on 3.2. Could you be so kind and > try to backport it? Thank you very much! Here we go. I hope I didn't screw anything (Johannes might double check) because there were quite some changes in the area si

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-06-17 Thread azurIt
>Here we go. I hope I didn't screw anything (Johannes might double check) >because there were quite some changes in the area since 3.2. Nothing >earth shattering though. Please note that I have only compile tested >this. Also make sure you remove the previous patches you have from me. Hi Michal,

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-06-19 Thread Michal Hocko
On Mon 17-06-13 12:21:34, azurIt wrote: > >Here we go. I hope I didn't screw anything (Johannes might double check) > >because there were quite some changes in the area since 3.2. Nothing > >earth shattering though. Please note that I have only compile tested > >this. Also make sure you remove the

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-10 Thread azurIt
>> Now i realized that i forgot to remove UID from that cgroup before >> trying to remove it, so cgroup cannot be removed anyway (we are using >> third party cgroup called cgroup-uid from Andrea Righi, which is able >> to associate all user's processes with target cgroup). Look here for >> cgroup-u

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-11 Thread Michal Hocko
On Wed 10-07-13 18:25:06, azurIt wrote: > >> Now i realized that i forgot to remove UID from that cgroup before > >> trying to remove it, so cgroup cannot be removed anyway (we are using > >> third party cgroup called cgroup-uid from Andrea Righi, which is able > >> to associate all user's processe

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-13 Thread azurIt
> CC: "Johannes Weiner" , linux-kernel@vger.kernel.org, > linux...@kvack.org, "cgroups mailinglist" , > "KAMEZAWA Hiroyuki" , righi.and...@gmail.com >On Wed 10-07-13 18:25:06, azurIt wrote: >> >> Now i realized that i forgot to remove UID from that cgroup before >> >> trying to remove it, so cgro

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-13 Thread azurIt
> CC: "Johannes Weiner" , linux-kernel@vger.kernel.org, > linux...@kvack.org, "cgroups mailinglist" , > "KAMEZAWA Hiroyuki" , righi.and...@gmail.com >> CC: "Johannes Weiner" , linux-kernel@vger.kernel.org, >> linux...@kvack.org, "cgroups mailinglist" , >> "KAMEZAWA Hiroyuki" , righi.and...@gmai

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-14 Thread azurIt
> CC: "Michal Hocko" , linux-kernel@vger.kernel.org, > linux...@kvack.org, "cgroups mailinglist" , > "KAMEZAWA Hiroyuki" >On Fri, Jul 05, 2013 at 09:02:46PM +0200, azurIt wrote: >> >I looked at your debug messages but could not find anything that would >> >hint at a deadlock. All tasks are stuc

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-15 Thread Michal Hocko
On Sun 14-07-13 01:51:12, azurIt wrote: > > CC: "Johannes Weiner" , linux-kernel@vger.kernel.org, > > linux...@kvack.org, "cgroups mailinglist" , > > "KAMEZAWA Hiroyuki" , righi.and...@gmail.com > >> CC: "Johannes Weiner" , linux-kernel@vger.kernel.org, > >> linux...@kvack.org, "cgroups mailingl

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-15 Thread Michal Hocko
On Mon 15-07-13 17:41:19, Michal Hocko wrote: > On Sun 14-07-13 01:51:12, azurIt wrote: > > > CC: "Johannes Weiner" , linux-kernel@vger.kernel.org, > > > linux...@kvack.org, "cgroups mailinglist" , > > > "KAMEZAWA Hiroyuki" , > > > righi.and...@gmail.com > > >> CC: "Johannes Weiner" , > > >> li

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-16 Thread Johannes Weiner
On Mon, Jul 15, 2013 at 06:00:06PM +0200, Michal Hocko wrote: > On Mon 15-07-13 17:41:19, Michal Hocko wrote: > > On Sun 14-07-13 01:51:12, azurIt wrote: > > > > CC: "Johannes Weiner" , > > > > linux-kernel@vger.kernel.org, linux...@kvack.org, "cgroups mailinglist" > > > > , "KAMEZAWA Hiroyuki"

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-16 Thread Michal Hocko
On Tue 16-07-13 11:35:44, Johannes Weiner wrote: > On Mon, Jul 15, 2013 at 06:00:06PM +0200, Michal Hocko wrote: > > On Mon 15-07-13 17:41:19, Michal Hocko wrote: > > > On Sun 14-07-13 01:51:12, azurIt wrote: > > > > > CC: "Johannes Weiner" , > > > > > linux-kernel@vger.kernel.org, linux...@kvack.

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-16 Thread Johannes Weiner
On Tue, Jul 16, 2013 at 06:09:05PM +0200, Michal Hocko wrote: > On Tue 16-07-13 11:35:44, Johannes Weiner wrote: > > On Mon, Jul 15, 2013 at 06:00:06PM +0200, Michal Hocko wrote: > > > On Mon 15-07-13 17:41:19, Michal Hocko wrote: > > > > On Sun 14-07-13 01:51:12, azurIt wrote: > > > > > > CC: "Joh

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-18 Thread Johannes Weiner
On Tue, Jul 16, 2013 at 12:48:30PM -0400, Johannes Weiner wrote: > On Tue, Jul 16, 2013 at 06:09:05PM +0200, Michal Hocko wrote: > > On Tue 16-07-13 11:35:44, Johannes Weiner wrote: > > > On Mon, Jul 15, 2013 at 06:00:06PM +0200, Michal Hocko wrote: > > > > On Mon 15-07-13 17:41:19, Michal Hocko wr

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-19 Thread azurIt
> CC: linux-kernel@vger.kernel.org, linux...@kvack.org, "cgroups mailinglist" > , "KAMEZAWA Hiroyuki" > , righi.and...@gmail.com >On Tue, Jul 16, 2013 at 12:48:30PM -0400, Johannes Weiner wrote: >> On Tue, Jul 16, 2013 at 06:09:05PM +0200, Michal Hocko wrote: >> > On Tue 16-07-13 11:35:44, Johann

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-06-22 Thread azurIt
Michal, >> I'm unable to send you stacks or more info because problem is taking >> down the whole server for some time now (don't know what exactly >> caused it to start happening, maybe newer versions of 3.2.x). > >So you are not testing with the same kernel with just the old patch >replaced by

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-06-24 Thread azurIt
>I would be really interesting to see what those tasks are blocked on. Ok, i got it! Problem occurs two times and it behaves differently each time, I was running kernel with that latest patch. 1.) It doesn't have impact on the whole server, only on one cgroup. Here are stacks: http://watchdog.

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-06-24 Thread Johannes Weiner
Hi guys, On Sat, Jun 22, 2013 at 10:09:58PM +0200, azurIt wrote: > >> But i'm sure of one thing - when problem occurs, nothing is able to > >> access hard drives (every process which tries it is freezed until > >> problem is resolved or server is rebooted). > > > >I would be really interesting to

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-05 Thread Johannes Weiner
Hi azurIt, On Fri, Jun 28, 2013 at 12:06:13PM +0200, azurIt wrote: > >It's not a kernel thread that does it because all kernel-context > >handle_mm_fault() are annotated properly, which means the task must be > >userspace and, since tasks is empty, have exited before synchronizing. > > > >Can you

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-05 Thread azurIt
>I looked at your debug messages but could not find anything that would >hint at a deadlock. All tasks are stuck in the refrigerator, so I >assume you use the freezer cgroup and enabled it somehow? Yes, i'm really using freezer cgroup BUT i was checking if it's not doing problems - unfortunatel

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-05 Thread Johannes Weiner
On Fri, Jul 05, 2013 at 09:02:46PM +0200, azurIt wrote: > >I looked at your debug messages but could not find anything that would > >hint at a deadlock. All tasks are stuck in the refrigerator, so I > >assume you use the freezer cgroup and enabled it somehow? > > > Yes, i'm really using freezer

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-07 Thread azurIt
> CC: "Michal Hocko" , linux-kernel@vger.kernel.org, > linux...@kvack.org, "cgroups mailinglist" , > "KAMEZAWA Hiroyuki" >On Fri, Jul 05, 2013 at 09:02:46PM +0200, azurIt wrote: >> >I looked at your debug messages but could not find anything that would >> >hint at a deadlock. All tasks are stuc

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-09 Thread Michal Hocko
On Mon 24-06-13 16:13:45, Johannes Weiner wrote: > Hi guys, > > On Sat, Jun 22, 2013 at 10:09:58PM +0200, azurIt wrote: > > >> But i'm sure of one thing - when problem occurs, nothing is able to > > >> access hard drives (every process which tries it is freezed until > > >> problem is resolved or

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-09 Thread Michal Hocko
On Tue 09-07-13 15:00:17, Michal Hocko wrote: > On Mon 24-06-13 16:13:45, Johannes Weiner wrote: > > Hi guys, > > > > On Sat, Jun 22, 2013 at 10:09:58PM +0200, azurIt wrote: > > > >> But i'm sure of one thing - when problem occurs, nothing is able to > > > >> access hard drives (every process whic

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-09 Thread Michal Hocko
On Tue 09-07-13 15:08:08, Michal Hocko wrote: > On Tue 09-07-13 15:00:17, Michal Hocko wrote: > > On Mon 24-06-13 16:13:45, Johannes Weiner wrote: > > > Hi guys, > > > > > > On Sat, Jun 22, 2013 at 10:09:58PM +0200, azurIt wrote: > > > > >> But i'm sure of one thing - when problem occurs, nothing

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-09 Thread Michal Hocko
On Mon 08-07-13 01:42:24, azurIt wrote: > > CC: "Michal Hocko" , linux-kernel@vger.kernel.org, > > linux...@kvack.org, "cgroups mailinglist" , > > "KAMEZAWA Hiroyuki" > >On Fri, Jul 05, 2013 at 09:02:46PM +0200, azurIt wrote: > >> >I looked at your debug messages but could not find anything that

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-09 Thread azurIt
>On Mon 08-07-13 01:42:24, azurIt wrote: >> > CC: "Michal Hocko" , linux-kernel@vger.kernel.org, >> > linux...@kvack.org, "cgroups mailinglist" , >> > "KAMEZAWA Hiroyuki" >> >On Fri, Jul 05, 2013 at 09:02:46PM +0200, azurIt wrote: >> >> >I looked at your debug messages but could not find anythin

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-07-09 Thread Michal Hocko
On Tue 09-07-13 15:19:21, azurIt wrote: [...] > Now i realized that i forgot to remove UID from that cgroup before > trying to remove it, so cgroup cannot be removed anyway (we are using > third party cgroup called cgroup-uid from Andrea Righi, which is able > to associate all user's processes with

Re: [PATCH for 3.2] memcg: do not trap chargers with full callstack on OOM

2013-06-28 Thread azurIt
>It's not a kernel thread that does it because all kernel-context >handle_mm_fault() are annotated properly, which means the task must be >userspace and, since tasks is empty, have exited before synchronizing. > >Can you try with the following patch on top? Michal and Johannes, i have some obser