[Bug 1792349] Re: Memory leaking when running kubernetes cronjobs
** Tags added: cscc -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1792349 Title: Memory leaking when running kubernetes cronjobs To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1792349/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1792349] Re: Memory leaking when running kubernetes cronjobs
** Also affects: linux-azure (Ubuntu) Importance: Undecided Status: New ** Changed in: linux-azure (Ubuntu) Status: New => Triaged ** Changed in: linux-azure (Ubuntu Bionic) Status: New => Triaged ** Changed in: linux-azure (Ubuntu Cosmic) Status: New => Triaged ** No longer affects: linux-azure (Ubuntu Cosmic) ** No longer affects: linux-azure (Ubuntu Bionic) ** Changed in: linux-azure (Ubuntu) Importance: Undecided => High -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1792349 Title: Memory leaking when running kubernetes cronjobs To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1792349/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1792349] Re: Memory leaking when running kubernetes cronjobs
More patches are required: https://lkml.org/lkml/2018/11/2/182 It looks we'll have to wait for some time, before the kernel stabilizes... -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1792349 Title: Memory leaking when running kubernetes cronjobs To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1792349/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1792349] Re: Memory leaking when running kubernetes cronjobs
This issue also exists on the Linux-azure kernel series. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1792349 Title: Memory leaking when running kubernetes cronjobs To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1792349/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1792349] Re: Memory leaking when running kubernetes cronjobs
Because there are a few and they affect the memory management layer, it might be best to submit these patches to the Ubuntu Kernel Team mailing list for feedback. kernel-t...@lists.ubuntu.com -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1792349 Title: Memory leaking when running kubernetes cronjobs To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1792349/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1792349] Re: Memory leaking when running kubernetes cronjobs
Hi, any update on what needs to happen to get these patches backported to a 4.15 Kernel build for Ubuntu 18? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1792349 Title: Memory leaking when running kubernetes cronjobs To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1792349/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1792349] Re: Memory leaking when running kubernetes cronjobs
Hi, as per this update -> https://www.spinics.net/lists/cgroups/msg20660.html I have a set of patches on top of Kernel 4.19.rc3 that appear to resolve the issue. What is the process for getting these backported to a 4.15 Kernel build for Ubuntu 18? The list of patches is: https://lkml.org/lkml/2018/10/7/84 https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=ce7ea4af0838ffd4667ecad4eb5eec7a25342f1e https://marc.info/?l=linux-netdev=153900037804969 010cb21d4ede math64: prevent double calculation of DIV64_U64_ROUND_UP() arguments f77d7a05670d mm: don't miss the last page because of round-off error d18bf0af683e mm: drain memcg stocks on css offlining 71cd51b2e1ca mm: rework memcg kernel stack accounting f3a2fccbce15 mm: slowly shrink slabs with a relatively small number of objects -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1792349 Title: Memory leaking when running kubernetes cronjobs To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1792349/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1792349] Re: Memory leaking when running kubernetes cronjobs
** Tags removed: kernel-key ** Tags added: kernel-da-key -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1792349 Title: Memory leaking when running kubernetes cronjobs To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1792349/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1792349] Re: Memory leaking when running kubernetes cronjobs
** Also affects: linux (Ubuntu Bionic) Importance: Undecided Status: New ** Changed in: linux (Ubuntu Bionic) Status: New => Triaged ** Changed in: linux (Ubuntu Bionic) Importance: Undecided => Medium ** Changed in: linux (Ubuntu) Importance: Medium => High ** Changed in: linux (Ubuntu Bionic) Importance: Medium => High ** Tags removed: kernel-da-key ** Tags added: kernel-key ** Also affects: linux (Ubuntu Cosmic) Importance: High Status: Triaged -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1792349 Title: Memory leaking when running kubernetes cronjobs To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1792349/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1792349] Re: Memory leaking when running kubernetes cronjobs
Bug reported - link to email is here -> https://www.spinics.net/lists/cgroups/msg20593.html I got a pretty positive response: Thank you for the very detailed and full report! We've experienced the same (or very similar problem), when memory cgroups were staying in the dying state for a long time, so that the number of dying cgroups grew steadily with time. I've investigated the issue and found several problems in the memory reclaim and accounting code. The following commits from the next tree are solving the problem in our case: 010cb21d4ede math64: prevent double calculation of DIV64_U64_ROUND_UP() arguments f77d7a05670d mm: don't miss the last page because of round-off error d18bf0af683e mm: drain memcg stocks on css offlining 71cd51b2e1ca mm: rework memcg kernel stack accounting f3a2fccbce15 mm: slowly shrink slabs with a relatively small number of objects -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1792349 Title: Memory leaking when running kubernetes cronjobs To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1792349/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1792349] Re: Memory leaking when running kubernetes cronjobs
** Tags added: kernel-bug-reported-upstream -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1792349 Title: Memory leaking when running kubernetes cronjobs To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1792349/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1792349] Re: Memory leaking when running kubernetes cronjobs
This issue appears to be an upstream bug, since you tested the latest upstream kernel. Would it be possible for you to open an upstream bug report[0]? That will allow the upstream Developers to examine the issue, and may provide a quicker resolution to the bug. Please follow the instructions on the wiki page[0]. The first step is to email the appropriate mailing list. If no response is received, then a bug may be opened on bugzilla.kernel.org. Once this bug is reported upstream, please add the tag: 'kernel-bug- reported-upstream'. [0] https://wiki.ubuntu.com/Bugs/Upstream/kernel ** Changed in: linux (Ubuntu) Importance: Undecided => Medium ** Changed in: linux (Ubuntu) Status: Confirmed => Incomplete ** Changed in: linux (Ubuntu) Status: Incomplete => Triaged -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1792349 Title: Memory leaking when running kubernetes cronjobs To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1792349/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1792349] Re: Memory leaking when running kubernetes cronjobs
I re-ran on 4.19.0-041900rc3-generic #201809120832 SMP Wed Sep 12 12:35:08 UTC 2018 and am still seeing the leak. ** Tags added: kernel-bug-exists-upstream -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1792349 Title: Memory leaking when running kubernetes cronjobs To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1792349/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1792349] Re: Memory leaking when running kubernetes cronjobs
Would it be possible for you to test the latest upstream kernel? Refer to https://wiki.ubuntu.com/KernelMainlineBuilds . Please test the latest v4.19 kernel[0]. If this bug is fixed in the mainline kernel, please add the following tag 'kernel-fixed-upstream'. If the mainline kernel does not fix this bug, please add the tag: 'kernel-bug-exists-upstream'. Once testing of the upstream kernel is complete, please mark this bug as "Confirmed". Thanks in advance. [0] http://kernel.ubuntu.com/~kernel-ppa/mainline/v4.19-rc3 ** Tags added: kernel-da-key -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1792349 Title: Memory leaking when running kubernetes cronjobs To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1792349/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs