Re: [libvirt] [PATCH] spec: Move ldconfig calls from -client to -libs

2019-03-27 Thread Jiri Denemark
On Mon, Mar 25, 2019 at 10:59:24 +0100, Andrea Bolognani wrote: > ldconfig needs to be called after installing or uninstalling > shared libraries. > > For a very long time, libvirt didn't have a separate package > containing just the shared libraries, and so it shipped them > in the same one as

[libvirt] [PATCH v7 21/23] backup: Wire up qemu full pull backup commands over QMP

2019-03-27 Thread Eric Blake
Time to actually issue the QMP transactions that start and stop backup commands (for now, just pull mode, not push). Starting a job has to kick off several pre-req steps, then a transaction, and additionally spawn an NBD server for pull mode; ending a job as well as failing partway through

[libvirt] [PATCH v7 23/23] backup: implement qemu incremental pull backup

2019-03-27 Thread Eric Blake
Complete wiring up incremental backup, by adding in support for creating a checkpoint at the same time as a backup (make the transaction have a few more steps) as well as exposing the dirty bitmap for a prior backup over NBD (requires creating a temporary bitmap, merging all appropriate bitmaps

Re: [libvirt] [jenkins-ci PATCH v2 1/2] guests: Update test dependencies for osinfo-db

2019-03-27 Thread Daniel P . Berrangé
On Tue, Mar 26, 2019 at 05:32:58PM +0100, Fabiano Fidêncio wrote: > The new dependencies are: > - python3 > - python3-lxml > - python3-pytest > - python3-requests > > xmllint has been removed in favour of a own crafted test using > python3-lxml > > Signed-off-by: Fabiano Fidêncio > --- >

Re: [libvirt] [PATCH v7 01/23] snapshot: Drop pointless function virDomainMomentIsCurrentName

2019-03-27 Thread Daniel P . Berrangé
On Wed, Mar 27, 2019 at 05:10:32AM -0500, Eric Blake wrote: > The qemu driver already had a full-blown virDomainMomentObjPtr to > check against, and the test driver ought to have one since we get > better error checking that the user passed in a valid object. Removes > a helper function added in

Re: [libvirt] [PATCH v7 11/23] squash to checkpoint list

2019-03-27 Thread Daniel P . Berrangé
Presumably the $SUBJECT means this should be squashed into an earlier patch. On Wed, Mar 27, 2019 at 05:10:42AM -0500, Eric Blake wrote: > --- > src/conf/checkpoint_conf.c | 2 +- > 1 file changed, 1 insertion(+), 1 deletion(-) > > diff --git a/src/conf/checkpoint_conf.c

Re: [libvirt] [PATCH v7 03/23] snapshot: Refactor qemu to utilize virDomainMoment more

2019-03-27 Thread Daniel P . Berrangé
On Wed, Mar 27, 2019 at 05:07:14AM -0500, Eric Blake wrote: > Use the common base class virDomainMoment for iterator callbacks > related to snapshots from the qemu code, so that when checkpoint > operations are introduced, they can share the same callbacks. > > Simplify the code for

Re: [libvirt] Planning for next release

2019-03-27 Thread Eric Blake
On 3/26/19 8:51 AM, Daniel Veillard wrote: > It's time to get a new release out. Simplest would be to enter freeze > tomorrow, then we can plan an RC2 by Friday, and if everything looks > good have the release on time next Monday. Not sure what time you are planning on starting the freeze, but

Re: [libvirt] [PATCH v7 02/23] snapshot: Allow NULL to virDomainSnapshotObjGetDef

2019-03-27 Thread Daniel P . Berrangé
On Wed, Mar 27, 2019 at 05:07:13AM -0500, Eric Blake wrote: > Doing so can simplify some callers. > > Signed-off-by: Eric Blake > --- > src/conf/virdomainsnapshotobjlist.h | 2 +- > src/conf/snapshot_conf.c| 2 +- > 2 files changed, 2 insertions(+), 2 deletions(-) Reviewed-by:

Re: [libvirt] [PATCH v7 01/23] snapshot: Drop pointless function virDomainMomentIsCurrentName

2019-03-27 Thread Daniel P . Berrangé
On Wed, Mar 27, 2019 at 05:07:12AM -0500, Eric Blake wrote: > The qemu driver already had a full-blown virDomainMomentObjPtr to > check against, and the test driver ought to have one since we get > better error checking that the user passed in a valid object. Removes > a helper function added in

Re: [libvirt] [PATCH] tests: don't abort in fopen(/proc/mounts)

2019-03-27 Thread Michal Privoznik
On 3/27/19 11:31 AM, Daniel P. Berrangé wrote: The mock fopen() function will abort if "/proc/mounts" is requested with "r" permissions and VIR_CGROUP_MOCK_FILENAME env var is not set. Unfortunately this is triggering by the libselinux library constructor when it tries to read /proc/mounts to

Re: [libvirt] [PATCH v2 1/3] Public API for parallel migration

2019-03-27 Thread Jiri Denemark
On Wed, Feb 13, 2019 at 15:03:44 -0500, John Ferlan wrote: > > > On 2/8/19 10:08 AM, Jiri Denemark wrote: > > This patch adds a new VIR_MIGRATE_PARALLEL flag for migration APIs which > > will ask the hypervisor to use multiple parallel connections for > > migrating a domain. The number of

Re: [libvirt] [dockerfiles PATCH] Add Dockerfile for i686 cross-compilation

2019-03-27 Thread Daniel P . Berrangé
On Wed, Mar 27, 2019 at 10:07:16AM +0100, Andrea Bolognani wrote: > On Mon, 2019-03-18 at 11:03 +0100, Andrea Bolognani wrote: > > We didn't add this until now because i686 cross-compilation > > requires special care and lcitool was known to produce broken > > Dockerfiles, but that's been fixed as

[libvirt] [PATCH] news: Document parallel migration

2019-03-27 Thread Jiri Denemark
Signed-off-by: Jiri Denemark --- docs/news.xml | 12 1 file changed, 12 insertions(+) diff --git a/docs/news.xml b/docs/news.xml index 83e965e0f3..2067830848 100644 --- a/docs/news.xml +++ b/docs/news.xml @@ -104,6 +104,18 @@ E.g. controller type='xenbus'

Re: [libvirt] [dockerfiles PATCH] Add Dockerfile for i686 cross-compilation

2019-03-27 Thread Andrea Bolognani
On Wed, 2019-03-27 at 09:17 +, Daniel P. Berrangé wrote: > On Wed, Mar 27, 2019 at 10:07:16AM +0100, Andrea Bolognani wrote: > > On Mon, 2019-03-18 at 11:03 +0100, Andrea Bolognani wrote: > > > We didn't add this until now because i686 cross-compilation > > > requires special care and lcitool

[libvirt] [PATCH v7 07/23] backup: Introduce virDomainBackup APIs

2019-03-27 Thread Eric Blake
Introduce a few new public APIs related to incremental backups. This builds on the previous notion of a checkpoint (without an existing checkpoint, the new API is a full backup, differing from virDomainBlockCopy in the point of time chosen and in operation on multiple disks at once); and also

[libvirt] [PATCH v7 01/23] snapshot: Drop pointless function virDomainMomentIsCurrentName

2019-03-27 Thread Eric Blake
The qemu driver already had a full-blown virDomainMomentObjPtr to check against, and the test driver ought to have one since we get better error checking that the user passed in a valid object. Removes a helper function added in commit commit 4819f54b. Signed-off-by: Eric Blake ---

[libvirt] [PATCH v7 03/23] snapshot: Refactor qemu to utilize virDomainMoment more

2019-03-27 Thread Eric Blake
Use the common base class virDomainMoment for iterator callbacks related to snapshots from the qemu code, so that when checkpoint operations are introduced, they can share the same callbacks. Simplify the code for qemuDomainSnapshotCurrent by better utilizing virDomainMoment helpers.

[libvirt] [PATCH v7 02/23] snapshot: Allow NULL to virDomainSnapshotObjGetDef

2019-03-27 Thread Eric Blake
Doing so can simplify some callers. Signed-off-by: Eric Blake --- src/conf/virdomainsnapshotobjlist.h | 2 +- src/conf/snapshot_conf.c| 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/src/conf/virdomainsnapshotobjlist.h b/src/conf/virdomainsnapshotobjlist.h

Re: [libvirt] [PATCH v7 06/23] backup: Introduce virDomainCheckpoint APIs

2019-03-27 Thread Daniel P . Berrangé
On Wed, Mar 27, 2019 at 05:10:37AM -0500, Eric Blake wrote: > Introduce a bunch of new public APIs related to backup checkpoints. > Checkpoints are modeled heavily after virDomainSnapshotPtr (both > represent a point in time of the guest), although a snapshot exists > with the intent of rolling

Re: [libvirt] [PATCH v7 20/23] backup: qemu: Implement framework for backup job APIs

2019-03-27 Thread Peter Krempa
On Wed, Mar 27, 2019 at 05:10:51 -0500, Eric Blake wrote: > Still needs to actually kick off the right QMP commands, but at > least allows validation of backup XML, including the fact that > a backup job can survive a libvirtd restart. Atomically creating > a checkpoint alongside the backup still

Re: [libvirt] [PATCH] tests: don't abort in fopen(/proc/mounts)

2019-03-27 Thread Daniel P . Berrangé
On Wed, Mar 27, 2019 at 12:55:18PM +0100, Michal Privoznik wrote: > On 3/27/19 11:31 AM, Daniel P. Berrangé wrote: > > The mock fopen() function will abort if "/proc/mounts" is > > requested with "r" permissions and VIR_CGROUP_MOCK_FILENAME > > env var is not set. > > > > Unfortunately this is

Re: [libvirt] [PATCH v7 14/23] backup: Parse and output backup XML

2019-03-27 Thread Peter Krempa
On Wed, Mar 27, 2019 at 07:14:09 -0500, Eric Blake wrote: > On 3/27/19 7:05 AM, Peter Krempa wrote: > > On Wed, Mar 27, 2019 at 05:10:45 -0500, Eric Blake wrote: > >> Accept XML describing a generic block job, and output it again as > >> needed. This may still need a few tweaks to match the

Re: [libvirt] [PATCH v2 2/3] qemu: Add support for parallel migration

2019-03-27 Thread Jiri Denemark
On Wed, Feb 13, 2019 at 15:03:58 -0500, John Ferlan wrote: > > > On 2/8/19 10:08 AM, Jiri Denemark wrote: > > The VIR_MIGRATE_PARALLEL flag is implemented using QEMU's multifd > > migration capability and the corresponding multifd-channels migration > > parameter. > > > > Signed-off-by: Jiri

[libvirt] [PATCH] qemu_capabilities: Pass pointer to va_list in virQEMUCapsSetVAList

2019-03-27 Thread Michal Privoznik
There is one specific caller (testInfoSetArgs() in qemuxml2argvtest.c) which expect the va_list argument to change after returning from the virQEMUCapsSetVAList() function. However, since we are passing plain va_list this is not guaranteed. The man page of stdarg(3) says: If ap is passed to a

[libvirt] [PATCH v7 10/23] backup: Allow for lists of checkpoint objects

2019-03-27 Thread Eric Blake
Create a new file for managing a list of checkpoint objects, borrowing heavily from existing virDomainSnapshotObjList paradigms. Note that while checkpoints definitely have a use case for multiple children to a single parent (create a base snapshot, create a child snapshot, revert to the base,

[libvirt] [PATCH v7 08/23] backup: Document nuances between different state capture APIs

2019-03-27 Thread Eric Blake
Now that various new API have been added, it is worth a landing page that gives an overview of capturing various pieces of guest state, and which APIs are best suited to which tasks. Signed-off-by: Eric Blake Reviewed-by: John Ferlan Reviewed-by: Daniel P. Berrangé --- docs/docs.html.in

[libvirt] [PATCH v7 09/23] backup: Parse and output checkpoint XML

2019-03-27 Thread Eric Blake
Add a new file checkpoint_conf.c that performs the translation to and from new XML describing a checkpoint. The code shares a common base class with snapshots, since a checkpoint similarly represents the domain state at a moment in time. Add some basic testing of round trip XML handling through

[libvirt] [PATCH v7 12/23] backup: Add new domain:checkpoint access control

2019-03-27 Thread Eric Blake
Creating a checkpoint does not modify guest-visible state, but does modify host resources. Rather than reuse existing domain:write, domain:block_write, or domain:snapshot access controls, it seems better to introduce a new access control specific to tasks related to checkpoints and incremental

[libvirt] [PATCH v7 05/23] backup: Document new XML for backups

2019-03-27 Thread Eric Blake
Prepare for new backup APIs by describing the XML that will represent a backup. The XML resembles snapshots and checkpoints in being able to select actions for a set of disks, but has other differences. It can support both push model (the hypervisor does the backup directly into the destination

[libvirt] [PATCH v7 06/23] backup: Introduce virDomainCheckpoint APIs

2019-03-27 Thread Eric Blake
Introduce a bunch of new public APIs related to backup checkpoints. Checkpoints are modeled heavily after virDomainSnapshotPtr (both represent a point in time of the guest), although a snapshot exists with the intent of rolling back to that state, while a checkpoint exists to make it possible to

[libvirt] [PATCH v7 15/23] backup: Implement virsh support for checkpoints

2019-03-27 Thread Eric Blake
Introduce a bunch of new virsh commands for managing checkpoints in isolation. More commands are needed for performing incremental backups, but these commands were easy to implement by modeling heavily after virsh-snapshot.c (no need for checkpoint-revert, and checkpoint-list was a lot easier

[libvirt] [PATCH v7 13/23] backup: Implement backup APIs for remote driver

2019-03-27 Thread Eric Blake
The remote code generator had to be taught about the new virDomainCheckpointPtr type, and about the capitalization of virDomainSnapshotCreateXML2(), at which point the remote driver code for backups can be generated. Signed-off-by: Eric Blake --- src/remote/remote_daemon_dispatch.c | 22 ++-

[libvirt] [PATCH v7 14/23] backup: Parse and output backup XML

2019-03-27 Thread Eric Blake
Accept XML describing a generic block job, and output it again as needed. This may still need a few tweaks to match the documented XML and RNG schema. Signed-off-by: Eric Blake --- src/conf/backup_conf.h | 96 +++ src/conf/virconftypes.h | 3 + src/conf/Makefile.inc.am | 2 +

[libvirt] [PATCH v7 16/23] backup: Implement virsh support for backup

2019-03-27 Thread Eric Blake
Introduce a few more new virsh commands for performing backup jobs, as well as creating a checkpoint atomically with a snapshot. At this time, I did not opt for a convenience command 'backup-begin-as' that cobbles together appropriate XML from the user's command line arguments, but that may be a

[libvirt] [PATCH v7 20/23] backup: qemu: Implement framework for backup job APIs

2019-03-27 Thread Eric Blake
Still needs to actually kick off the right QMP commands, but at least allows validation of backup XML, including the fact that a backup job can survive a libvirtd restart. Atomically creating a checkpoint alongside the backup still needs implementing. Signed-off-by: Eric Blake ---

[libvirt] [PATCH v7 18/23] backup: qemu: Implement metadata tracking for checkpoint APIs

2019-03-27 Thread Eric Blake
A lot of this work heavily copies from the existing snapshot APIs. The interaction with qemu during create/delete still needs to be implemented, but this takes care of all the libvirt metadata (saving and restoring XML, and tracking the relations between multiple checkpoints). Signed-off-by:

[libvirt] [PATCH v7 19/23] backup: Wire up qemu checkpoint commands over QMP

2019-03-27 Thread Eric Blake
Time to actually issue the QMP transactions that create and delete persistent checkpoints. For create, we only need one transaction: inside, we visit all disks affected by the checkpoint, and create a new enabled bitmap, as well as disabling the bitmap of the parent checkpoint (if any). For

[libvirt] [PATCH v7 17/23] backup: Add new qemu monitor interactions

2019-03-27 Thread Eric Blake
Add some monitor commands to be used during backup/checkpoint operations: - another facet to query-block for learning bitmap size - new export and bitmap parameters to nbd-server-add - new block-dirty-bitmap-{add,enable,disable,merge} functions Also add two capabilities for testing that they are

[libvirt] [PATCH v7 22/23] backup: qemu: Wire up qemu full push backup commands over QMP

2019-03-27 Thread Eric Blake
Update the code to support push backups; for now, the destination file still has to be local, although the XML could be extended into supporting remote destinations (where we will have to use the full power of blockdev-add). This also touches up the event handling to inform the user when the job

[libvirt] [PATCH v7 04/23] backup: Document new XML for checkpoints

2019-03-27 Thread Eric Blake
Prepare for new checkpoint APIs by describing the XML that will represent a checkpoint. The checkpoint XML is modeled heavily after virDomainSnapshotPtr. (See the docs for more details). Add testsuite coverage for some minimal uses of the XML (bare minimum, the sample from html, and a full

[libvirt] [PATCH v7 11/23] squash to checkpoint list

2019-03-27 Thread Eric Blake
--- src/conf/checkpoint_conf.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/conf/checkpoint_conf.c b/src/conf/checkpoint_conf.c index 3dd2acf886..01497a79f6 100644 --- a/src/conf/checkpoint_conf.c +++ b/src/conf/checkpoint_conf.c @@ -615,7 +615,7 @@

Re: [libvirt] [PATCH v7 05/23] backup: Document new XML for backups

2019-03-27 Thread Daniel P . Berrangé
On Wed, Mar 27, 2019 at 05:10:36AM -0500, Eric Blake wrote: > Prepare for new backup APIs by describing the XML that will represent > a backup. The XML resembles snapshots and checkpoints in being able > to select actions for a set of disks, but has other differences. It > can support both push

Re: [libvirt] [PATCH] qemu_capabilities: Pass pointer to va_list in virQEMUCapsSetVAList

2019-03-27 Thread Andrea Bolognani
On Wed, 2019-03-27 at 10:50 +0100, Michal Privoznik wrote: > There is one specific caller (testInfoSetArgs() in > qemuxml2argvtest.c) which expect the va_list argument to change s/ / / > after returning from the virQEMUCapsSetVAList() function. > However, since we are passing plain va_list

[libvirt] [PATCH] tests: don't abort in fopen(/proc/mounts)

2019-03-27 Thread Daniel P . Berrangé
The mock fopen() function will abort if "/proc/mounts" is requested with "r" permissions and VIR_CGROUP_MOCK_FILENAME env var is not set. Unfortunately this is triggering by the libselinux library constructor when it tries to read /proc/mounts to find out if selinuxfs is mounted in an unusual

[libvirt] [PATCH 2/2] doc: Fix 'encryption' documentation

2019-03-27 Thread Christophe Fergeau
There are 2 examples of use of which uses a 'type' attribute rather than 'format' as documented in the XML schema: default qcow luks

[libvirt] [PATCH 1/2] qemu: Fix "boolen" typo in API doc

2019-03-27 Thread Christophe Fergeau
This also adjusts the argument name which should be 'isListen' in both cases rather than 'listen'. Signed-off-by: Christophe Fergeau --- src/qemu/qemu_command.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/src/qemu/qemu_command.c b/src/qemu/qemu_command.c index

Re: [libvirt] [PATCH v7 12/23] backup: Add new domain:checkpoint access control

2019-03-27 Thread Daniel P . Berrangé
On Wed, Mar 27, 2019 at 05:10:43AM -0500, Eric Blake wrote: > Creating a checkpoint does not modify guest-visible state, > but does modify host resources. Rather than reuse existing > domain:write, domain:block_write, or domain:snapshot access > controls, it seems better to introduce a new access

Re: [libvirt] [PATCH v7 03/23] snapshot: Refactor qemu to utilize virDomainMoment more

2019-03-27 Thread Daniel P . Berrangé
On Wed, Mar 27, 2019 at 05:10:34AM -0500, Eric Blake wrote: > Use the common base class virDomainMoment for iterator callbacks > related to snapshots from the qemu code, so that when checkpoint > operations are introduced, they can share the same callbacks. > > Simplify the code for

Re: [libvirt] [PATCH v7 18/23] backup: qemu: Implement metadata tracking for checkpoint APIs

2019-03-27 Thread Peter Krempa
On Wed, Mar 27, 2019 at 05:10:49 -0500, Eric Blake wrote: > A lot of this work heavily copies from the existing snapshot > APIs. The interaction with qemu during create/delete still > needs to be implemented, but this takes care of all the libvirt > metadata (saving and restoring XML, and

Re: [libvirt] [PATCH v2 0/3] qemu: don't duplicate suspended events and state changes

2019-03-27 Thread Nikolay Shirokovskiy
ping On 13.02.2019 19:55, John Ferlan wrote: > > > On 2/8/19 2:52 AM, Nikolay Shirokovskiy wrote: >> Patches 1 and 2 are already Reviewed-by: John. Patch 3 needs Peter comments. >> > > Right - feel free to add my : > > Reviewed-by: John Ferlan > > to the first 2 patches for sure. > > To

Re: [libvirt] [PATCH v7 14/23] backup: Parse and output backup XML

2019-03-27 Thread Peter Krempa
On Wed, Mar 27, 2019 at 05:10:45 -0500, Eric Blake wrote: > Accept XML describing a generic block job, and output it again as > needed. This may still need a few tweaks to match the documented XML > and RNG schema. > > Signed-off-by: Eric Blake > --- > src/conf/backup_conf.h | 96 +++ >

Re: [libvirt] [jenkins-ci PATCH v2 2/2] Stop running `make check` against osinfo-db on CentOS 7

2019-03-27 Thread Daniel P . Berrangé
On Tue, Mar 26, 2019 at 05:32:59PM +0100, Fabiano Fidêncio wrote: > osinfo-db tests are Python3 only. > > Signed-off-by: Fabiano Fidêncio > --- > guests/playbooks/build/projects/osinfo-db.yml | 13 + > jenkins/projects/osinfo-db.yaml | 9 + > 2 files changed,

Re: [libvirt] [PATCH] news: Document parallel migration

2019-03-27 Thread Andrea Bolognani
On Wed, 2019-03-27 at 10:38 +0100, Jiri Denemark wrote: > Signed-off-by: Jiri Denemark > --- > docs/news.xml | 12 > 1 file changed, 12 insertions(+) Thanks for taking the time to update the release notes! :) Reviewed-by: Andrea Bolognani -- Andrea Bolognani / Red Hat /

Re: [libvirt] [PATCH 1/2] qemu: Fix "boolen" typo in API doc

2019-03-27 Thread Pino Toscano
On Wednesday, 27 March 2019 12:00:21 CET Christophe Fergeau wrote: > This also adjusts the argument name which should be 'isListen' in both > cases rather than 'listen'. > > Signed-off-by: Christophe Fergeau > --- > src/qemu/qemu_command.c | 4 ++-- > 1 file changed, 2 insertions(+), 2

[libvirt] [PATCH v2 1/2] qemu: Fix "boolen" typo in API doc

2019-03-27 Thread Christophe Fergeau
This also adjusts the argument name which should be 'isListen' in both cases rather than 'listen'. Signed-off-by: Christophe Fergeau --- Changes since v1: - really fix 'boolen' typo src/qemu/qemu_command.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git

[libvirt] [PATCH v2 2/2] doc: Fix 'encryption' documentation

2019-03-27 Thread Christophe Fergeau
There are 2 examples of use of which uses a 'type' attribute rather than 'format' as documented in the XML schema: default qcow luks

Re: [libvirt] [PATCH v7 13/23] backup: Implement backup APIs for remote driver

2019-03-27 Thread Daniel P . Berrangé
On Wed, Mar 27, 2019 at 05:10:44AM -0500, Eric Blake wrote: > The remote code generator had to be taught about the new > virDomainCheckpointPtr type, and about the capitalization of > virDomainSnapshotCreateXML2(), at which point the remote driver code > for backups can be generated. > >

Re: [libvirt] [PATCH v7 07/23] backup: Introduce virDomainBackup APIs

2019-03-27 Thread Daniel P . Berrangé
On Wed, Mar 27, 2019 at 05:10:38AM -0500, Eric Blake wrote: > Introduce a few new public APIs related to incremental backups. This > builds on the previous notion of a checkpoint (without an existing > checkpoint, the new API is a full backup, differing from > virDomainBlockCopy in the point of

Re: [libvirt] [PATCH v7 01/23] snapshot: Drop pointless function virDomainMomentIsCurrentName

2019-03-27 Thread Ján Tomko
On Wed, Mar 27, 2019 at 05:10:32AM -0500, Eric Blake wrote: The qemu driver already had a full-blown virDomainMomentObjPtr to check against, and the test driver ought to have one since we get better error checking that the user passed in a valid object. Removes a helper function added in commit

Re: [libvirt] [PATCH] qemu_capabilities: Pass pointer to va_list in virQEMUCapsSetVAList

2019-03-27 Thread Daniel P . Berrangé
On Wed, Mar 27, 2019 at 01:02:07PM +0100, Andrea Bolognani wrote: > On Wed, 2019-03-27 at 10:50 +0100, Michal Privoznik wrote: > > There is one specific caller (testInfoSetArgs() in > > qemuxml2argvtest.c) which expect the va_list argument to change > > s/ / / > > > after returning from the

[libvirt] [python PATCH v7] Add virDomainCheckpoint APIs

2019-03-27 Thread Eric Blake
Copies heavily from existing virDomainSnapshot handling, regarding what special cases the generator has to be taught and what overrides need to be written. Signed-off-by: Eric Blake --- Python counterparts to my incremental backup patches. An earlier version was already reviewed by Dan; the

Re: [libvirt] [PATCH 1/2] qemu: Fix "boolen" typo in API doc

2019-03-27 Thread Christophe Fergeau
On Wed, Mar 27, 2019 at 12:13:41PM +0100, Pino Toscano wrote: > On Wednesday, 27 March 2019 12:00:21 CET Christophe Fergeau wrote: > > This also adjusts the argument name which should be 'isListen' in both > > cases rather than 'listen'. > > > > Signed-off-by: Christophe Fergeau > > --- > >

Re: [libvirt] [PATCH v6 0/9] Incremental backups, focus on API

2019-03-27 Thread Peter Krempa
On Tue, Mar 26, 2019 at 13:14:48 -0500, Eric Blake wrote: > On 3/26/19 12:41 PM, Peter Krempa wrote: > > On Tue, Mar 26, 2019 at 01:13:44 -0500, Eric Blake wrote: > >> I'm fairly confident that these API are ready to go (that is, I've got > >> qemu code in the wings to implement these API for the

Re: [libvirt] [PATCH v7 21/23] backup: Wire up qemu full pull backup commands over QMP

2019-03-27 Thread Peter Krempa
On Wed, Mar 27, 2019 at 05:10:52 -0500, Eric Blake wrote: > Time to actually issue the QMP transactions that start and > stop backup commands (for now, just pull mode, not push). > Starting a job has to kick off several pre-req steps, then > a transaction, and additionally spawn an NBD server for

Re: [libvirt] [PATCH v7 14/23] backup: Parse and output backup XML

2019-03-27 Thread Eric Blake
On 3/27/19 7:05 AM, Peter Krempa wrote: > On Wed, Mar 27, 2019 at 05:10:45 -0500, Eric Blake wrote: >> Accept XML describing a generic block job, and output it again as >> needed. This may still need a few tweaks to match the documented XML >> and RNG schema. >> >> Signed-off-by: Eric Blake >>

[libvirt] [PATCH v7 03/23] snapshot: Refactor qemu to utilize virDomainMoment more

2019-03-27 Thread Eric Blake
Use the common base class virDomainMoment for iterator callbacks related to snapshots from the qemu code, so that when checkpoint operations are introduced, they can share the same callbacks. Simplify the code for qemuDomainSnapshotCurrent by better utilizing virDomainMoment helpers.

[libvirt] [PATCH v7 00/23] Incremental backups

2019-03-27 Thread Eric Blake
I've finished rebasing my earlier v4/v5 patches on top of cleanups earlier in the series (v6 didn't include the second half of the series). I've pushed a tag backup-v7 to both my libvirt.git and libvirt-python.git repos to match: https://repo.or.cz/libvirt/ericb.git/shortlog/refs/tags/backup-v7

[libvirt] [PATCH v7 02/23] snapshot: Allow NULL to virDomainSnapshotObjGetDef

2019-03-27 Thread Eric Blake
Doing so can simplify some callers. Signed-off-by: Eric Blake --- src/conf/virdomainsnapshotobjlist.h | 2 +- src/conf/snapshot_conf.c| 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/src/conf/virdomainsnapshotobjlist.h b/src/conf/virdomainsnapshotobjlist.h

[libvirt] [PATCH v7 01/23] snapshot: Drop pointless function virDomainMomentIsCurrentName

2019-03-27 Thread Eric Blake
The qemu driver already had a full-blown virDomainMomentObjPtr to check against, and the test driver ought to have one since we get better error checking that the user passed in a valid object. Removes a helper function added in commit commit 4819f54b. Signed-off-by: Eric Blake ---

Re: [libvirt] [PATCH v6 6/9] backup: Document new XML for backups

2019-03-27 Thread Nir Soffer
On Tue, Mar 26, 2019 at 8:14 AM Eric Blake wrote: ... > > + pull > + > + > + > + > ... > + > + > + unix > + > + > +

Re: [libvirt] [PATCH v7 11/23] squash to checkpoint list

2019-03-27 Thread Eric Blake
On 3/27/19 6:29 AM, Daniel P. Berrangé wrote: > > Presumably the $SUBJECT means this should be squashed into an > earlier patch. Yeah, 10/23. > > On Wed, Mar 27, 2019 at 05:10:42AM -0500, Eric Blake wrote: >> --- >> src/conf/checkpoint_conf.c | 2 +- >> 1 file changed, 1 insertion(+), 1

Re: [libvirt] [dockerfiles PATCH] Add Dockerfile for i686 cross-compilation

2019-03-27 Thread Andrea Bolognani
On Mon, 2019-03-18 at 11:03 +0100, Andrea Bolognani wrote: > We didn't add this until now because i686 cross-compilation > requires special care and lcitool was known to produce broken > Dockerfiles, but that's been fixed as of libvirt-jenkins-ci > commit f72d09153905 so we can finally go ahead

Re: [libvirt] [PATCH v6 6/9] backup: Document new XML for backups

2019-03-27 Thread Eric Blake
On 3/27/19 5:16 AM, Nir Soffer wrote: > On Tue, Mar 26, 2019 at 8:14 AM Eric Blake wrote: > We are trying to use backup_v5a from: > https://repo.or.cz/libvirt/ericb.git > And when we start a backup with this xml: > > > socket="/var/run/vdsm/nbd/4f594cec-1a27-43fd-acf8-3283cacd6347.sock" >

Re: [libvirt] [PATCH v7 02/23] snapshot: Allow NULL to virDomainSnapshotObjGetDef

2019-03-27 Thread Daniel P . Berrangé
On Wed, Mar 27, 2019 at 05:10:33AM -0500, Eric Blake wrote: > Doing so can simplify some callers. > > Signed-off-by: Eric Blake > --- > src/conf/virdomainsnapshotobjlist.h | 2 +- > src/conf/snapshot_conf.c| 2 +- > 2 files changed, 2 insertions(+), 2 deletions(-) Reviewed-by:

Re: [libvirt] [PATCH v7 13/23] backup: Implement backup APIs for remote driver

2019-03-27 Thread Eric Blake
On 3/27/19 6:36 AM, Daniel P. Berrangé wrote: > On Wed, Mar 27, 2019 at 05:10:44AM -0500, Eric Blake wrote: >> The remote code generator had to be taught about the new >> virDomainCheckpointPtr type, and about the capitalization of >> virDomainSnapshotCreateXML2(), at which point the remote driver

Re: [libvirt] [PATCH v7 02/23] snapshot: Allow NULL to virDomainSnapshotObjGetDef

2019-03-27 Thread Eric Blake
On 3/27/19 5:10 AM, Eric Blake wrote: > Doing so can simplify some callers. > > Signed-off-by: Eric Blake > --- > src/conf/virdomainsnapshotobjlist.h | 2 +- > src/conf/snapshot_conf.c| 2 +- > 2 files changed, 2 insertions(+), 2 deletions(-) Peter reported that at -O2, this makes

Re: [libvirt] [PATCH v7 18/23] backup: qemu: Implement metadata tracking for checkpoint APIs

2019-03-27 Thread Ján Tomko
On Wed, Mar 27, 2019 at 05:10:49AM -0500, Eric Blake wrote: A lot of this work heavily copies from the existing snapshot APIs. The interaction with qemu during create/delete still needs to be implemented, but this takes care of all the libvirt metadata (saving and restoring XML, and tracking

Re: [libvirt] [PATCH v7 16/23] backup: Implement virsh support for backup

2019-03-27 Thread Peter Krempa
On Wed, Mar 27, 2019 at 05:10:47 -0500, Eric Blake wrote: > Introduce a few more new virsh commands for performing backup jobs, as > well as creating a checkpoint atomically with a snapshot. > > At this time, I did not opt for a convenience command > 'backup-begin-as' that cobbles together

Re: [libvirt] [PATCH v2 0/7] extend virsh domstate to show additional information

2019-03-27 Thread Michal Privoznik
On 3/25/19 9:04 AM, Bjoern Walk wrote: This patch series introduces the ability to save additional information for the domain state and exposes this information in virsh domstate. For example in the case of QEMU guest panic events, we can provide additional information like the crash reason or

Re: [libvirt] [PATCH v2 6/7] virsh: domstate: report detailed state if available

2019-03-27 Thread Michal Privoznik
On 3/25/19 9:04 AM, Bjoern Walk wrote: > Add a new parameter to virsh domstate, --info, to report additional > information for the domain state, e.g. for a QEMU guest running a S390 > domain: > > virsh # domstate --info guest-1 > crashed (panicked: s390: core='0'

Re: [libvirt] [PATCH v2 4/7] remote: implement remoteDomainGetStateParams

2019-03-27 Thread Michal Privoznik
On 3/25/19 9:04 AM, Bjoern Walk wrote: Implement the API function virDomainGetStateParams for the remote driver and wire up the remote protocol. Reviewed-by: Boris Fiuczynski Signed-off-by: Bjoern Walk --- src/remote/remote_daemon_dispatch.c | 50 +

Re: [libvirt] [PATCH v2 2/7] qemu: domain: store and update panic info

2019-03-27 Thread Michal Privoznik
On 3/25/19 9:04 AM, Bjoern Walk wrote: Let's store additional state information in the hypervisor-specific private data to virDomainObj. For now, just consider panic state in QEMU domains for which additional information is available from the guest crash event handler. Reviewed-by: Boris

Re: [libvirt] [PATCH v2 0/7] extend virsh domstate to show additional information

2019-03-27 Thread Bjoern Walk
Michal Privoznik [2019-03-27, 02:05PM +0100]: > I like the general idea, but some cleanups are needed IMO. Fair enough. I will send the next rebased version then after the release. > > Michal > Thanks for the review. signature.asc Description: PGP signature -- libvir-list mailing list

Re: [libvirt] [PATCH v7 01/23] snapshot: Drop pointless function virDomainMomentIsCurrentName

2019-03-27 Thread Eric Blake
On 3/27/19 6:38 AM, Ján Tomko wrote: > On Wed, Mar 27, 2019 at 05:10:32AM -0500, Eric Blake wrote: >> The qemu driver already had a full-blown virDomainMomentObjPtr to >> check against, and the test driver ought to have one since we get >> better error checking that the user passed in a valid

[libvirt] Time to drop support for Debian 8 (Jessie)?

2019-03-27 Thread Andrea Bolognani
We currently support Debian 8 (oldstable) along with Debian 9 (stable), but not without some compromises: * the libvirt-dbus, libvirt-ocaml and virt-manager projects do not support the platform at all because it ships outdated versions of some core components; * on the CI side of

Re: [libvirt] [PATCH v2 4/7] remote: implement remoteDomainGetStateParams

2019-03-27 Thread Michal Privoznik
On 3/27/19 2:19 PM, Bjoern Walk wrote: Michal Privoznik [2019-03-27, 02:05PM +0100]: On 3/25/19 9:04 AM, Bjoern Walk wrote: diff --git a/src/remote/remote_driver.c b/src/remote/remote_driver.c index 5c4dd412..e0962014 100644 --- a/src/remote/remote_driver.c +++ b/src/remote/remote_driver.c @@

Re: [libvirt] [PATCH v7 11/23] squash to checkpoint list

2019-03-27 Thread Eric Blake
On 3/27/19 7:00 AM, Eric Blake wrote: > On 3/27/19 6:29 AM, Daniel P. Berrangé wrote: >> >> Presumably the $SUBJECT means this should be squashed into an >> earlier patch. > > Yeah, 10/23. > >> >> On Wed, Mar 27, 2019 at 05:10:42AM -0500, Eric Blake wrote: >>> --- >>> src/conf/checkpoint_conf.c

Re: [libvirt] [PATCH v7 15/23] backup: Implement virsh support for checkpoints

2019-03-27 Thread Eric Blake
On 3/27/19 9:29 AM, Ján Tomko wrote: > On Wed, Mar 27, 2019 at 05:10:46AM -0500, Eric Blake wrote: >> Introduce a bunch of new virsh commands for managing checkpoints >> in isolation. More commands are needed for performing incremental >> backups, but these commands were easy to implement by

Re: [libvirt] [PATCH v7 14/23] backup: Parse and output backup XML

2019-03-27 Thread Peter Krempa
On Wed, Mar 27, 2019 at 13:18:17 +0100, Peter Krempa wrote: > On Wed, Mar 27, 2019 at 07:14:09 -0500, Eric Blake wrote: > > On 3/27/19 7:05 AM, Peter Krempa wrote: > > > On Wed, Mar 27, 2019 at 05:10:45 -0500, Eric Blake wrote: > > >> Accept XML describing a generic block job, and output it again

Re: [libvirt] [PATCH] tests: don't abort in fopen(/proc/mounts)

2019-03-27 Thread Michal Privoznik
On 3/27/19 12:57 PM, Daniel P. Berrangé wrote: On Wed, Mar 27, 2019 at 12:55:18PM +0100, Michal Privoznik wrote: On 3/27/19 11:31 AM, Daniel P. Berrangé wrote: The mock fopen() function will abort if "/proc/mounts" is requested with "r" permissions and VIR_CGROUP_MOCK_FILENAME env var is not

[libvirt] vcpupin reports bogus vcpu affinities

2019-03-27 Thread Allen, John
For pinned vcpus, vcpupin will report inaccurate affinity values on machines with high core counts (256 cores in my case). The problem is produced as follows: $ virsh vcpupin myguest 0 4 $ virsh vcpupin myguest 0 VCPU CPU Affinity --- 0 4,192,194,196-197

Re: [libvirt] [PATCH v7 13/23] backup: Implement backup APIs for remote driver

2019-03-27 Thread Daniel P . Berrangé
On Wed, Mar 27, 2019 at 07:06:32AM -0500, Eric Blake wrote: > On 3/27/19 6:36 AM, Daniel P. Berrangé wrote: > > On Wed, Mar 27, 2019 at 05:10:44AM -0500, Eric Blake wrote: > >> The remote code generator had to be taught about the new > >> virDomainCheckpointPtr type, and about the capitalization

Re: [libvirt] [PATCH v7 18/23] backup: qemu: Implement metadata tracking for checkpoint APIs

2019-03-27 Thread Peter Krempa
On Wed, Mar 27, 2019 at 05:10:49 -0500, Eric Blake wrote: > A lot of this work heavily copies from the existing snapshot > APIs. The interaction with qemu during create/delete still > needs to be implemented, but this takes care of all the libvirt > metadata (saving and restoring XML, and

Re: [libvirt] [PATCH v7 09/23] backup: Parse and output checkpoint XML

2019-03-27 Thread Eric Blake
On 3/27/19 9:01 AM, Ján Tomko wrote: > On Wed, Mar 27, 2019 at 05:10:40AM -0500, Eric Blake wrote: >> Add a new file checkpoint_conf.c that performs the translation to and >> from new XML describing a checkpoint. The code shares a common base >> class with snapshots, since a checkpoint similarly

Re: [libvirt] [PATCH v2 2/2] doc: Fix 'encryption' documentation

2019-03-27 Thread Ján Tomko
On Wed, Mar 27, 2019 at 12:21:25PM +0100, Christophe Fergeau wrote: There are 2 examples of use of which uses a 'type' attribute rather than 'format' as documented in the XML schema: default qcow luks

Re: [libvirt] [PATCH v2 2/7] qemu: domain: store and update panic info

2019-03-27 Thread Bjoern Walk
Michal Privoznik [2019-03-27, 02:05PM +0100]: > On 3/25/19 9:04 AM, Bjoern Walk wrote: > > @@ -14069,6 +14072,39 @@ > > qemuDomainStatePanicInfoFormatMsg(qemuDomainStatePanicInfoPtr info) > > } > > +void > > +qemuDomainStatePanicInfoSet(virDomainObjPtr vm, > > +

Re: [libvirt] [PATCH v7 09/23] backup: Parse and output checkpoint XML

2019-03-27 Thread Ján Tomko
On Wed, Mar 27, 2019 at 05:10:40AM -0500, Eric Blake wrote: Add a new file checkpoint_conf.c that performs the translation to and from new XML describing a checkpoint. The code shares a common base class with snapshots, since a checkpoint similarly represents the domain state at a moment in

Re: [libvirt] [PATCH 5/5] snapshot: Add tests of virsh -c test:///default snapshot*

2019-03-27 Thread Eric Blake
On 3/27/19 10:02 AM, Daniel P. Berrangé wrote: > On Sat, Mar 23, 2019 at 11:02:03PM -0500, Eric Blake wrote: >> Had this been in place earlier, I would have avoided the bugs in >> commit 0baf6945 and 55c2ab3e. Writing the test required me to extend >> the power of virsh - creating enough snapshots

Re: [libvirt] [PATCH v2 1/2] qemu: Fix "boolen" typo in API doc

2019-03-27 Thread Ján Tomko
Please use --cover-letter for series with two or more patches for neater alignment of e-mails. On Wed, Mar 27, 2019 at 12:21:24PM +0100, Christophe Fergeau wrote: This also adjusts the argument name which should be 'isListen' in both cases rather than 'listen'. Signed-off-by: Christophe

  1   2   >