Re: virsh vol-download uses a lot of memory

2020-01-23 Thread Daniel P . Berrangé
On Thu, Jan 23, 2020 at 10:22:33AM +0100, Michal Privoznik wrote: > On 1/22/20 1:18 PM, Daniel P. Berrangé wrote: > > On Wed, Jan 22, 2020 at 01:01:42PM +0100, Michal Privoznik wrote: > > > For anybody with libvirt insight: virNetClientIOHandleInput() -> > > > virNetClientCallDispatch() -> virNetCl

Re: virsh vol-download uses a lot of memory

2020-01-23 Thread Michal Privoznik
On 1/22/20 1:18 PM, Daniel P. Berrangé wrote: On Wed, Jan 22, 2020 at 01:01:42PM +0100, Michal Privoznik wrote: On 1/22/20 11:11 AM, Michal Privoznik wrote: On 1/22/20 10:03 AM, R. Diez wrote: Hi all: I am using the libvirt version that comes with Ubuntu 18.04.3 LTS. I'm sorry, I don't have

Re: virsh vol-download uses a lot of memory

2020-01-22 Thread R. Diez
> [...] Actually, it is not. It's caused by our design of the client event loop. If there are any incoming data, read as much as possible placing them at the end of linked list of incoming stream data (stream is a way that libvirt uses to transfer binary data). Problem is that instead of returni

Re: virsh vol-download uses a lot of memory

2020-01-22 Thread R. Diez
I'm sorry, I don't have Ubuntu installed anywhere to look the version up. Can you run 'virsh version' to find it out for me please? $ virsh version Compiled against library: libvirt 4.0.0 Using library: libvirt 4.0.0 Using API: QEMU 4.0.0 Running hypervisor: QEMU 2.11.1 This is very likely

Re: virsh vol-download uses a lot of memory

2020-01-22 Thread Peter Crowther
Architecturally, separating the data and control channels feels like the right approach - whether nbd or something else. Would need signposting for those of us who routinely implement firewalling on hosts, but that's a detail. I presume there's no flow control on streams at the moment? Cheers, P

Re: virsh vol-download uses a lot of memory

2020-01-22 Thread Daniel P . Berrangé
On Wed, Jan 22, 2020 at 01:01:42PM +0100, Michal Privoznik wrote: > On 1/22/20 11:11 AM, Michal Privoznik wrote: > > On 1/22/20 10:03 AM, R. Diez wrote: > > > Hi all: > > > > > > I am using the libvirt version that comes with Ubuntu 18.04.3 LTS. > > > > I'm sorry, I don't have Ubuntu installed an

Re: virsh vol-download uses a lot of memory

2020-01-22 Thread Michal Privoznik
On 1/22/20 11:11 AM, Michal Privoznik wrote: On 1/22/20 10:03 AM, R. Diez wrote: Hi all: I am using the libvirt version that comes with Ubuntu 18.04.3 LTS. I'm sorry, I don't have Ubuntu installed anywhere to look the version up. Can you run 'virsh version' to find it out for me please? Ne

Re: virsh vol-download uses a lot of memory

2020-01-22 Thread Michal Privoznik
On 1/22/20 10:03 AM, R. Diez wrote: Hi all: I am using the libvirt version that comes with Ubuntu 18.04.3 LTS. I'm sorry, I don't have Ubuntu installed anywhere to look the version up. Can you run 'virsh version' to find it out for me please? I have written a script that backs up my virtu

virsh vol-download uses a lot of memory

2020-01-22 Thread R. Diez
Hi all: I am using the libvirt version that comes with Ubuntu 18.04.3 LTS. I have written a script that backs up my virtual machines every night. I want to limit the amount of memory that this backup operation consumes, mainly to prevent page cache thrashing. I have described the Linux page cac