Re: Linux DomU freezes and dies under heavy memory shuffling

On 12.03.21 22:33, Roman Shaposhnik wrote: Hi Jürgen, just wanted to give you (and everyone who may be keeping an eye on this) an update. Somehow, after applying your kernel patch -- the VM is now running 10 days+ without a problem. Can you check the kernel console messages, please? There are

Re: Linux DomU freezes and dies under heavy memory shuffling

Hi Jürgen, just wanted to give you (and everyone who may be keeping an eye on this) an update. Somehow, after applying your kernel patch -- the VM is now running 10 days+ without a problem. I'll keep experimenting (A/B-testing style) but at this point I'm actually pretty perplexed as to why this

Re: Linux DomU freezes and dies under heavy memory shuffling

On Wed, Feb 24, 2021 at 08:30:45PM -0800, Roman Shaposhnik wrote: > Right -- but that's not what distro builders use, right? I mean they do > the whole sdeb -> deb business. > > In fact, to stay as faithful as possible -- I'd love to: >1. unpack SDEB >2. add a single patch to the set of so

Re: Linux DomU freezes and dies under heavy memory shuffling

On Wed, Feb 24, 2021 at 7:44 PM Elliott Mitchell wrote: > > On Wed, Feb 24, 2021 at 07:06:25PM -0800, Roman Shaposhnik wrote: > > I'm slightly confused about this patch -- it seems to me that it needs > > to be applied to the guest kernel, correct? > > > > If that's the case -- the challenge I hav

Re: Linux DomU freezes and dies under heavy memory shuffling

On Wed, Feb 24, 2021 at 07:06:25PM -0800, Roman Shaposhnik wrote: > I'm slightly confused about this patch -- it seems to me that it needs > to be applied to the guest kernel, correct? > > If that's the case -- the challenge I have is that I need to re-build > the Canonical (Ubuntu) distro kernel

Re: Linux DomU freezes and dies under heavy memory shuffling

Hi Jürgen! sorry for the belated reply -- I wanted to externalize the VM before I do -- but let me at least reply to you: On Tue, Feb 23, 2021 at 5:17 AM Jürgen Groß wrote: > > On 18.02.21 06:21, Roman Shaposhnik wrote: > > On Wed, Feb 17, 2021 at 12:29 AM Jürgen Groß >

Re: Linux DomU freezes and dies under heavy memory shuffling

On 18.02.21 06:21, Roman Shaposhnik wrote: On Wed, Feb 17, 2021 at 12:29 AM Jürgen Groß > wrote: On 17.02.21 09:12, Roman Shaposhnik wrote: > Hi Jürgen, thanks for taking a look at this. A few comments below: > > On Tue, Feb 16, 2021 at 10:47 PM Jürgen

Re: Linux DomU freezes and dies under heavy memory shuffling

On 18.02.21 06:21, Roman Shaposhnik wrote: On Wed, Feb 17, 2021 at 12:29 AM Jürgen Groß > wrote: On 17.02.21 09:12, Roman Shaposhnik wrote: > Hi Jürgen, thanks for taking a look at this. A few comments below: > > On Tue, Feb 16, 2021 at 10:47 PM Jürgen

Re: Linux DomU freezes and dies under heavy memory shuffling

On Wed, Feb 17, 2021 at 12:29 AM Jürgen Groß wrote: > On 17.02.21 09:12, Roman Shaposhnik wrote: > > Hi Jürgen, thanks for taking a look at this. A few comments below: > > > > On Tue, Feb 16, 2021 at 10:47 PM Jürgen Groß wrote: > >> > >> On 16.02.21 21:34, Stefano Stabellini wrote: > >>> + x86 m

Re: Linux DomU freezes and dies under heavy memory shuffling

On 17.02.21 09:12, Roman Shaposhnik wrote: Hi Jürgen, thanks for taking a look at this. A few comments below: On Tue, Feb 16, 2021 at 10:47 PM Jürgen Groß wrote: On 16.02.21 21:34, Stefano Stabellini wrote: + x86 maintainers It looks like the tlbflush is getting stuck? I have seen this ca

Re: Linux DomU freezes and dies under heavy memory shuffling

Hi Jürgen, thanks for taking a look at this. A few comments below: On Tue, Feb 16, 2021 at 10:47 PM Jürgen Groß wrote: > > On 16.02.21 21:34, Stefano Stabellini wrote: > > + x86 maintainers > > > > It looks like the tlbflush is getting stuck? > > I have seen this case multiple times on customer s

Re: Linux DomU freezes and dies under heavy memory shuffling

On 16.02.21 21:34, Stefano Stabellini wrote: + x86 maintainers It looks like the tlbflush is getting stuck? I have seen this case multiple times on customer systems now, but reproducing it reliably seems to be very hard. I suspected fifo events to be blamed, but just yesterday I've been infor

Re: Linux DomU freezes and dies under heavy memory shuffling

+ x86 maintainers It looks like the tlbflush is getting stuck? On Sat, 6 Feb 2021, Roman Shaposhnik wrote: > Hi! > > all of a sudden (but only after a few days of running normally), on a stock > Ubuntu 18.04 (Bionic with 4.15.0 kernel) DomU I'm seeing Microsoft's .net > runtime go into a heave

Linux DomU freezes and dies under heavy memory shuffling

Hi! all of a sudden (but only after a few days of running normally), on a stock Ubuntu 18.04 (Bionic with 4.15.0 kernel) DomU I'm seeing Microsoft's .net runtime go into a heave GC cycle and then freeze and die like what is shown below. This is under stock Xen 4.14.0 on a pretty unremarkable x86_6