[libvirt PATCH 0/7] docs: ci: Update the CI pages with fresh contents

2023-09-27 Thread Erik Skultety
While we have already descriptive articles on our GitLab CI, there's recently been some work on the CI front where a few sections deserve some updates. Erik Skultety (7): docs: ci-runners: Add a note on a new runner registration process docs: ci: Update the description on the integration CI

[libvirt PATCH 3/7] docs: testtck: Tweak the Avocado command to run TCK test suite

2023-09-27 Thread Erik Skultety
While we may have needed to run TCK through Avocado by explicitly using the '--tap' option (still possible), we can get a nice output from Avocado by default leaving the option out which is exactly what we do inside GitLab CI environment. Signed-off-by: Erik Skultety --- docs/testtck.rst | 2 +-

[libvirt PATCH 7/7] docs: testtck: Expand the 'Run TCK' section on making use of ci/jobs.sh

2023-09-27 Thread Erik Skultety
Ever since commit 6e9bd600 added a new GitLab job description function handling the integration test suite process to ci/jobs.sh it should be mentioned in the docs. This patch splits the 'Run TCK' section in two, giving user the option to run the integration test suite in their VM environment the

Re: [PATCH] hw/rdma: Deprecate the pvrdma device and the rdma subsystem

2023-09-27 Thread Markus Armbruster
Daniel P. Berrangé writes: > On Wed, Sep 27, 2023 at 12:49:08PM -0400, James Bottomley wrote: >> From: James Bottomley >> >> The Microsoft Simulator (mssim) is the reference emulation platform >> for the TCG TPM 2.0 specification. >> >> https://github.com/Microsoft/ms-tpm-20-ref.git >> >> It

[libvirt PATCH 2/7] docs: ci: Update the description on the integration CI GitLab variables

2023-09-27 Thread Erik Skultety
This patch mainly fixes an unfinished sentence that was supposed to describe the LIBVIRT_CI_INTEGRATION_RUNNER_TAG variable, but took the opportunity to update the description of the other variable too. Signed-off-by: Erik Skultety --- docs/ci.rst | 8 ++-- 1 file changed, 6 insertions(+),

[libvirt PATCH 4/7] docs: testtck: Improve the documentation on how to get a VM from lcitool

2023-09-27 Thread Erik Skultety
While wording is still correct to this day, we have already added more features to lcitool and documented it properly in its repo. Make sure that we refer the users to lcitool's doc material for further details on how VMs can be installed locally. Use the opportunity to bump the OS distro target

[libvirt PATCH 1/7] docs: ci-runners: Add a note on a new runner registration process

2023-09-27 Thread Erik Skultety
The documented process should be updated to reflect the new process once GitLab transitions to it completely and drops the old process involving registration tokens as hinted by the note. Signed-off-by: Erik Skultety --- docs/ci-runners.rst | 10 ++ 1 file changed, 10 insertions(+)

[libvirt PATCH 5/7] docs: testing: Adjust the docs on how to run container workloads locally

2023-09-27 Thread Erik Skultety
The fact that we need ci/helper script to run the workloads remains true, but the invocation has changed as of commit eb41e456 . We also extracted GitLab job specs into a standalone ci/jobs.sh script which allows execution of any container job we run in upstream CI locally, unlike the original

[libvirt PATCH 6/7] docs: testtck: Add a clear note on libvirt + Perl bindings dependency

2023-09-27 Thread Erik Skultety
It's mentioned in an earlier paragraph that Perl bindings in correct version are needed, but there's no note about libvirt even though it should be obvious. So make a clear note on that and while at it, do mention the possibility to get upstream libvirt RPMs from GitLab CI artifacts if users don't

[libvirt PATCH] docs: Go bindings release at the same time as the C library

2023-09-27 Thread Andrea Bolognani
The actual versioning policy[1] is a bit more nuanced, and in particular there are scenarios in which the monthly release is intentionally skipped, but overall it's not inaccurate to claim that the release cadence of the Go bindings follows the one of the C library. [1]

[libvirt PATCH v2 22/33] systemd: Drop @deps@

2023-09-27 Thread Andrea Bolognani
It's no longer used anywhere. Signed-off-by: Andrea Bolognani --- src/meson.build | 2 -- src/remote/libvirtd-admin.socket.in | 1 - src/remote/libvirtd-ro.socket.in| 1 - src/remote/libvirtd-tcp.socket.in | 1 - src/remote/libvirtd-tls.socket.in | 1 -

[libvirt PATCH v2 31/33] systemd: Add RemoveOnStop=yes to all sockets

2023-09-27 Thread Andrea Bolognani
Currently we only set this for the main sockets, which means that $ systemctl stop virtqemud.socket will make the socket disappear from the filesystem while $ systemctl stop virtqemud-ro.socket won't. Get rid of this inconsistency. Signed-off-by: Andrea Bolognani ---

[libvirt PATCH v2 28/33] systemd: Drop Before=libvirtd from virtlogd/virtlockd

2023-09-27 Thread Andrea Bolognani
We have already declared the mirror relationship, so this one is now redundant. Moreover, this version was incomplete: it only ever worked for the monolithic daemon, but the modular daemons for QEMU and Xen also want the sockets to be active. Signed-off-by: Andrea Bolognani Reviewed-by: Daniel

[libvirt PATCH v2 33/33] systemd: Move Documentation lines

2023-09-27 Thread Andrea Bolognani
Like the Description, these are intended to be displayed to the user, so it makes sense to have them towards the top of the file before all the information that systemd will parse to calculate dependencies. Signed-off-by: Andrea Bolognani Reviewed-by: Daniel P. Berrangé ---

[libvirt PATCH v2 03/33] systemd: Make @service_in@ optional

2023-09-27 Thread Andrea Bolognani
It is currently considered required, but we're soon going to provide a default that will be suitable for most services. Since all services currently provide a value explicitly, we can implement a default without breaking anything. Signed-off-by: Andrea Bolognani --- src/meson.build | 6 --

[libvirt PATCH v2 11/33] systemd: Switch virtsecretd to common templates

2023-09-27 Thread Andrea Bolognani
Signed-off-by: Andrea Bolognani --- src/secret/meson.build| 4 src/secret/virtsecretd.service.in | 25 - 2 files changed, 29 deletions(-) delete mode 100644 src/secret/virtsecretd.service.in diff --git a/src/secret/meson.build b/src/secret/meson.build

[libvirt PATCH v2 02/33] systemd: Introduce service_in/service_out variables

2023-09-27 Thread Andrea Bolognani
They're similar to the existing socket_in/socket_out variables and will make future changes nicer. Signed-off-by: Andrea Bolognani --- src/meson.build | 7 +-- 1 file changed, 5 insertions(+), 2 deletions(-) diff --git a/src/meson.build b/src/meson.build index 6c85cc9b9b..c6728cc8f8 100644

[libvirt PATCH v2 05/33] systemd: Provide all input files explicitly

2023-09-27 Thread Andrea Bolognani
We're about to change the defaults and start migrating to common templates: in order to be able to switch units over one at a time, make the input files that are currently used explicit rather than implicit. Signed-off-by: Andrea Bolognani --- src/ch/meson.build | 3 +++

[libvirt PATCH v2 12/33] systemd: Switch virtnetworkd to common templates

2023-09-27 Thread Andrea Bolognani
Signed-off-by: Andrea Bolognani --- src/network/meson.build | 5 + src/network/virtnetworkd.service.extra.in | 2 ++ src/network/virtnetworkd.service.in | 26 --- 3 files changed, 3 insertions(+), 30 deletions(-) create mode 100644

[libvirt PATCH v2 13/33] systemd: Switch virtstoraged to common templates

2023-09-27 Thread Andrea Bolognani
Signed-off-by: Andrea Bolognani --- src/storage/meson.build | 5 + src/storage/virtstoraged.service.extra.in | 3 +++ src/storage/virtstoraged.service.in | 27 --- 3 files changed, 4 insertions(+), 31 deletions(-) create mode 100644

[libvirt PATCH v2 04/33] systemd: Introduce temporary libvirtd_socket*_in values

2023-09-27 Thread Andrea Bolognani
These will be useful during the upcoming migration to common templates for systemd units and will be dropped as soon as all services have been converted. Signed-off-by: Andrea Bolognani --- src/meson.build | 4 1 file changed, 4 insertions(+) diff --git a/src/meson.build b/src/meson.build

[libvirt PATCH v2 06/33] systemd: Introduce common templates

2023-09-27 Thread Andrea Bolognani
We already use templating to generate sockets, which are all based off libvirtd's. Push the idea further, and extend it to cover services as well. This is more challenging, as the various modular daemons each have their own needs in terms of what system services needs to be available before they

[libvirt PATCH v2 14/33] systemd: Switch virtvboxd to common templates

2023-09-27 Thread Andrea Bolognani
Signed-off-by: Andrea Bolognani --- src/vbox/meson.build| 5 + src/vbox/virtvboxd.service.extra.in | 2 ++ src/vbox/virtvboxd.service.in | 26 -- 3 files changed, 3 insertions(+), 30 deletions(-) create mode 100644

[libvirt PATCH v2 07/33] systemd: Use common templates by default

2023-09-27 Thread Andrea Bolognani
All services are still listing their input files explicitly, so no changes to the output files will occur yet. Signed-off-by: Andrea Bolognani --- src/meson.build | 10 +- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/src/meson.build b/src/meson.build index

[libvirt PATCH v2 27/33] systemd: Augment Requires/Wants with After

2023-09-27 Thread Andrea Bolognani
Requires/Wants only tells systemd that the corresponding unit should be started when the current one is, but that could very well happen in parallel. For virtlogd/virtlockd, we want the socket to be already active when the hypervisor driver is started. Signed-off-by: Andrea Bolognani

[libvirt PATCH v2 29/33] systemd: Drop Before=foo.service from sockets

2023-09-27 Thread Andrea Bolognani
systemd will automatically infer this dependency based on the socket's Service=foo.service setting. Signed-off-by: Andrea Bolognani Reviewed-by: Daniel P. Berrangé --- src/remote/libvirtd-admin.socket.in | 1 - src/remote/libvirtd-ro.socket.in| 1 - src/remote/libvirtd-tcp.socket.in | 1

[libvirt PATCH v2 25/33] systemd: Replace Requires with BindTo+After for main socket

2023-09-27 Thread Andrea Bolognani
This is the strongest relationship that can be declared between two units, and causes the service to be terminated immediately if its main socket disappears. This is the behavior we want. Note that we don't do the same for the read-only/admin sockets, because those are not as critical for the

[libvirt PATCH v2 18/33] systemd: Switch virtlxcd to common templates

2023-09-27 Thread Andrea Bolognani
Signed-off-by: Andrea Bolognani --- src/lxc/meson.build | 5 +--- src/lxc/virtlxcd.service.extra.in | 22 src/lxc/virtlxcd.service.in | 44 --- 3 files changed, 23 insertions(+), 48 deletions(-) create mode 100644

[libvirt PATCH v2 21/33] systemd: Drop libvirtd_socket*_in values

2023-09-27 Thread Andrea Bolognani
Now that the migration to common templates has been completed, we no longer need these. Signed-off-by: Andrea Bolognani --- src/meson.build | 4 1 file changed, 4 deletions(-) diff --git a/src/meson.build b/src/meson.build index 0fbefe37d5..541ca61101 100644 --- a/src/meson.build +++

[libvirt PATCH v2 23/33] systemd: Drop parametrization from libvirtd sockets

2023-09-27 Thread Andrea Bolognani
Up until now the files have been used as template for most services, but now that those have been converted to common templates we can drop parametrization and make it clear that these files are for libvirtd only. Signed-off-by: Andrea Bolognani --- src/remote/libvirtd-admin.socket.in | 10

[libvirt PATCH v2 17/33] systemd: Switch virtxend to common templates

2023-09-27 Thread Andrea Bolognani
Signed-off-by: Andrea Bolognani --- src/libxl/meson.build | 7 ++- src/libxl/virtxend.service.extra.in | 12 +++ src/libxl/virtxend.service.in | 32 - src/libxl/virtxend.socket.extra.in | 2 ++ 4 files changed, 16 insertions(+), 37

[libvirt PATCH v2 26/33] systemd: Downgrade read-only/admin sockets to Wants

2023-09-27 Thread Andrea Bolognani
Only the main socket is actually necessary for the service to be usable. In the past, we've had security issues that could be exploited via access to the read-only socket, so a security-minded administrator might consider disabling all optional sockets. This change makes such a setup possible.

[libvirt PATCH v2 10/33] systemd: Switch virtnwfilterd to common templates

2023-09-27 Thread Andrea Bolognani
Signed-off-by: Andrea Bolognani --- src/nwfilter/meson.build | 4 src/nwfilter/virtnwfilterd.service.in | 25 - 2 files changed, 29 deletions(-) delete mode 100644 src/nwfilter/virtnwfilterd.service.in diff --git a/src/nwfilter/meson.build

[libvirt PATCH v2 32/33] systemd: Improve and unify unit descriptions

2023-09-27 Thread Andrea Bolognani
Hypervisors are referred to by their user-facing name rather than the name of their libvirt driver, the monolithic daemon is explicitly referred to as legacy, and a consistent format is used throughout. Signed-off-by: Andrea Bolognani --- src/ch/meson.build| 2 +-

[libvirt PATCH v2 16/33] systemd: Switch virtchd to common templates

2023-09-27 Thread Andrea Bolognani
Signed-off-by: Andrea Bolognani --- src/ch/meson.build | 5 +--- src/ch/virtchd.service.extra.in | 22 + src/ch/virtchd.service.in | 44 - 3 files changed, 23 insertions(+), 48 deletions(-) create mode 100644

[libvirt PATCH v2 20/33] systemd: Switch virtproxyd to common templates

2023-09-27 Thread Andrea Bolognani
Signed-off-by: Andrea Bolognani --- src/remote/meson.build | 6 -- src/remote/virtproxyd.service.in | 25 - 2 files changed, 31 deletions(-) delete mode 100644 src/remote/virtproxyd.service.in diff --git a/src/remote/meson.build b/src/remote/meson.build

[libvirt PATCH v2 08/33] systemd: Switch virtnodedevd to common templates

2023-09-27 Thread Andrea Bolognani
Signed-off-by: Andrea Bolognani --- src/node_device/meson.build | 4 src/node_device/virtnodedevd.service.in | 25 - 2 files changed, 29 deletions(-) delete mode 100644 src/node_device/virtnodedevd.service.in diff --git a/src/node_device/meson.build

[libvirt PATCH v2 24/33] systemd: Make modular daemons conflict with libvirtd

2023-09-27 Thread Andrea Bolognani
We want to make sure that, at any given time, we have either the modular daemons or the monolithic one running, never both. In order to achieve that, make every single modular unit conflict with the corresponding libvirtd unit. We set both Conflicts=libvirtd.unit and After=libvirtd.unit: this

[libvirt PATCH v2 01/33] systemd: Drop Conflicts from virtproxyd sockets

2023-09-27 Thread Andrea Bolognani
The idea behind these is to prevent running both modular daemons and monolithic daemon at the same time. We will implement a more effective solution for that shortly. Signed-off-by: Andrea Bolognani --- src/remote/meson.build | 3 --- 1 file changed, 3 deletions(-) diff --git

[libvirt PATCH v2 00/33] systemd: Improve units for services and sockets

2023-09-27 Thread Andrea Bolognani
A grab bag of changes, ranging from very much functional ones to purely aesthetical ones. Changes from [v1] * patches 01-11 from the original series have been pushed; * patch 40 from the original series has been dropped; * patches 02 (cosmetic) and 31 (bug fix) have been added; * the

[libvirt PATCH v2 19/33] systemd: Switch virtqemud to common templates

2023-09-27 Thread Andrea Bolognani
Signed-off-by: Andrea Bolognani --- src/qemu/meson.build| 5 +-- src/qemu/virtqemud.service.extra.in | 28 + src/qemu/virtqemud.service.in | 48 - 3 files changed, 29 insertions(+), 52 deletions(-) create mode 100644

[libvirt PATCH v2 30/33] systemd: Add Also between sockets

2023-09-27 Thread Andrea Bolognani
This results in all sockets for a service being enabled when a single one of them is. The -tcp and -tls sockets are intentionally excluded, because enabling them should require explicit action on the administrator's part; moreover, disabling them should not result in the local sockets being

[libvirt PATCH v2 09/33] systemd: Switch virtinterfaced to common templates

2023-09-27 Thread Andrea Bolognani
Signed-off-by: Andrea Bolognani --- src/interface/meson.build | 4 src/interface/virtinterfaced.service.in | 25 - 2 files changed, 29 deletions(-) delete mode 100644 src/interface/virtinterfaced.service.in diff --git a/src/interface/meson.build

[libvirt PATCH v2 15/33] systemd: Switch virtvzd to common templates

2023-09-27 Thread Andrea Bolognani
Signed-off-by: Andrea Bolognani --- src/vz/meson.build | 5 + src/vz/virtvzd.service.extra.in | 2 ++ src/vz/virtvzd.service.in | 26 -- 3 files changed, 3 insertions(+), 30 deletions(-) create mode 100644 src/vz/virtvzd.service.extra.in delete

Re: [libvirt PATCH 34/42] systemd: Make modular daemons conflict with libvirtd

2023-09-27 Thread Andrea Bolognani
On Mon, Sep 25, 2023 at 08:58:32PM +0200, Andrea Bolognani wrote: > +++ b/src/virtd-tls.socket.in > @@ -3,6 +3,8 @@ Description=@name@ TLS IP socket > Before=@service@.service > BindsTo=@service@.socket > After=@service@.socket > +Conflicts=libvirt-tls.socket > +After=libvirt-tls.socket >

Re: [PATCH] virsh: Account for return values in virNodeGetFreePages

2023-09-27 Thread Michal Prívozník
On 9/26/23 15:56, Martin Kletzander wrote: > The function returns how many array items were filled in, but virsh > never checked for anything other than errors. Just to make sure this > does not report invalid data, even though the only possibility would be > reporting 0 free pages, check the

[PATCH] hw/rdma: Deprecate the pvrdma device and the rdma subsystem

2023-09-27 Thread Thomas Huth
This subsystem is said to be in a bad shape (see e.g. [1], [2] and [3]), and nobody seems to feel responsible to pick up patches for this and send them via a pull request. For example there is a patch for a CVE-worthy bug posted more than half a year ago [4] which has never been merged. Quoting

Re: [libvirt PATCH] gitpublish: Add suppresscc option

2023-09-27 Thread Michal Prívozník
On 9/19/23 11:34, Erik Skultety wrote: > send-email scans the commit messages to figure out the default set of > addresses to put into CC, Acked-by/Reviewed-by, etc-by being among > them. We're quite strict about CC-ing people on libvirt-list, since > most developers are subscribed to the list

Re: [libvirt PATCH 0/2] Add vdpablock and nbdkit to NEWS

2023-09-27 Thread Michal Prívozník
On 9/19/23 22:47, Jonathon Jongsma wrote: > > > Jonathon Jongsma (2): > news: document support for vdpa block devices > news: document nbdkit support for network disks > > NEWS.rst | 18 ++ > 1 file changed, 18 insertions(+) > Reviewed-by: Michal Privoznik Michal

Re: [libvirt PATCH 41/42] systemd: Improve and unify unit descriptions

2023-09-27 Thread Andrea Bolognani
On Wed, Sep 27, 2023 at 10:57:13AM +0100, Daniel P. Berrangé wrote: > On Mon, Sep 25, 2023 at 08:58:39PM +0200, Andrea Bolognani wrote: > > +++ b/src/locking/virtlockd-admin.socket.in > > @@ -1,5 +1,5 @@ > > [Unit] > > -Description=Virtual machine lock manager admin socket > >

Re: [libvirt PATCH 40/42] systemd: Drop BindTo/After between sockets

2023-09-27 Thread Andrea Bolognani
On Wed, Sep 27, 2023 at 10:55:04AM +0100, Daniel P. Berrangé wrote: > On Mon, Sep 25, 2023 at 08:58:38PM +0200, Andrea Bolognani wrote: > > They are unnecessary, since all sockets for a service are now > > enabled as soon as one of them is and each service has a very > > strong dependency on all

Re: [libvirt PATCH 41/42] systemd: Improve and unify unit descriptions

2023-09-27 Thread Daniel P . Berrangé
On Mon, Sep 25, 2023 at 08:58:39PM +0200, Andrea Bolognani wrote: > Hypervisors are referred to by their user-facing name rather > than the name of their libvirt driver, the monolithic daemon is > explicitly referred to as legacy, and a consistent format is > used throughout. > > Signed-off-by:

Re: [libvirt PATCH 42/42] systemd: Move Documentation lines

2023-09-27 Thread Daniel P . Berrangé
On Mon, Sep 25, 2023 at 08:58:40PM +0200, Andrea Bolognani wrote: > Like the Description, these are intended to be displayed to the > user, so it makes sense to have them towards the top of the file > before all the information that systemd will parse to calculate > dependencies. > >

Re: [libvirt PATCH 40/42] systemd: Drop BindTo/After between sockets

2023-09-27 Thread Daniel P . Berrangé
On Mon, Sep 25, 2023 at 08:58:38PM +0200, Andrea Bolognani wrote: > They are unnecessary, since all sockets for a service are now > enabled as soon as one of them is and each service has a very > strong dependency on all of its sockets. You earlier modified the .service units to have BindsTo=

Re: [libvirt PATCH 39/42] systemd: Add Also between sockets

2023-09-27 Thread Daniel P . Berrangé
On Mon, Sep 25, 2023 at 08:58:37PM +0200, Andrea Bolognani wrote: > This results in all sockets for a service being enabled when a > single one of them is. > > The -tcp and -tls sockets are intentionally excluded, because > enabling them should require explicit action on the > administrator's

Re: [libvirt PATCH 34/42] systemd: Make modular daemons conflict with libvirtd

2023-09-27 Thread Daniel P . Berrangé
On Mon, Sep 25, 2023 at 08:58:32PM +0200, Andrea Bolognani wrote: > We want to make sure that, at any given time, we have either the > modular daemons or the monolithic one running, never both. In > order to achieve that, make every single modular unit conflict > with the corresponding libvirtd

Re: [libvirt PATCH 37/42] systemd: Drop Before=libvirtd from virtlogd/virtlockd

2023-09-27 Thread Daniel P . Berrangé
On Mon, Sep 25, 2023 at 08:58:35PM +0200, Andrea Bolognani wrote: > We have already declared the mirror relationship, so this one > is now redundant. > > Moreover, this version was incomplete: it only ever worked for > the monolithic daemon, but the modular daemons for QEMU and Xen > also want

Re: [libvirt PATCH 38/42] systemd: Drop Before=foo.service from sockets

2023-09-27 Thread Daniel P . Berrangé
On Mon, Sep 25, 2023 at 08:58:36PM +0200, Andrea Bolognani wrote: > systemd will automatically infer this dependency based on the > socket's Service=foo.service setting. > > Signed-off-by: Andrea Bolognani > --- > src/remote/libvirtd-admin.socket.in | 1 - > src/remote/libvirtd-ro.socket.in

Re: [libvirt PATCH 36/42] systemd: Augment Requires/Wants with After

2023-09-27 Thread Daniel P . Berrangé
On Mon, Sep 25, 2023 at 08:58:34PM +0200, Andrea Bolognani wrote: > Requires/Wants only tells systemd that the corresponding unit > should be started when the current one is, but that could very > well happen in parallel. For virtlogd/virtlockd, we want the > socket to be already active when the

Re: [libvirt PATCH] gitpublish: Add suppresscc option

2023-09-27 Thread Erik Skultety
On Tue, Sep 19, 2023 at 11:34:19AM +0200, Erik Skultety wrote: > send-email scans the commit messages to figure out the default set of > addresses to put into CC, Acked-by/Reviewed-by, etc-by being among > them. We're quite strict about CC-ing people on libvirt-list, since > most developers are