Re: [pve-devel] [RFC cluster 1/4] rrd: add free, buffer/cache and arc size to memory statistics

2023-12-11 Thread DERUMIER, Alexandre
Hi, if we are going to bump the rrd version, I think it could be great to add pressure stats too. I have send patches 2 year ago, it can be really usefull to implement vm balancing/scheduling/node eviction or even simply to diplay graph to have more information about load. https://lists.proxm

Re: [pve-devel] [PATCH qemu-server 1/1] fix #4507 : increase qemu max openfiles limit

2023-12-11 Thread DERUMIER, Alexandre
>>I thought: can't we instead do this as part of setting up the systemd >>scope/qemu.slice with LimitNOFILE? I have tried (see my cover-letter ;), I can't get it work. "start failed: org.freedesktop.DBus.Error.PropertyReadOnly: Cannot set property LimitNOFILE, or unknown property. " I don't s

Re: [pve-devel] [PATCH widget-toolkit] notify: sendmail: smtp: fix mailto/mailto-user parameter deletion

2023-12-11 Thread Maximiliano Sandoval
Lukas Wagner writes: > Both fields were moved to a separate panel at some point, but this > broke parameter deletion behavior (e.g. if a target is modified and > switches from using mailto to mailto-user, then mailto should be > deleted) > > Signed-off-by: Lukas Wagner The commit message was

[pve-devel] applied-series: [PATCH qemu 1/2] add patch to work around stuck guest IO with iothread and VirtIO block/SCSI

2023-12-11 Thread Thomas Lamprecht
Am 11/12/2023 um 14:28 schrieb Fiona Ebner: > When using iothread, after commits > 1665d9326f ("virtio-blk: implement BlockDevOps->drained_begin()") > 766aa2de0f ("virtio-scsi: implement BlockDevOps->drained_begin()") > it can happen that polling gets stuck when draining. This would cause > IO in t

[pve-devel] [PATCH qemu-server] add qemu 8.1 cpu models

2023-12-11 Thread Alexandre Derumier
Signed-off-by: Alexandre Derumier --- PVE/QemuServer/CPUConfig.pm | 7 +++ 1 file changed, 7 insertions(+) diff --git a/PVE/QemuServer/CPUConfig.pm b/PVE/QemuServer/CPUConfig.pm index 750d3b6..ca2946b 100644 --- a/PVE/QemuServer/CPUConfig.pm +++ b/PVE/QemuServer/CPUConfig.pm @@ -109,6 +109,8

[pve-devel] [RFC cluster/common/widget-toolkit/manager 0/4] split node memory graph into usage types

2023-12-11 Thread Folke Gleumes
The goal of this patchseries is to make it more intuitive to understand the memory usage of an instance by splitting the memory usage graph into 'Used', 'Buffer/Cache', 'ZFS Arc' and 'Free' instead of 'Total' and 'RAM usage', displayed as different colored segments in a stacking graph that adds up

[pve-devel] [RFC widget-toolkit 3/4] add option to display rrd graph as stacking

2023-12-11 Thread Folke Gleumes
Signed-off-by: Folke Gleumes --- src/panel/RRDChart.js | 59 +-- 1 file changed, 46 insertions(+), 13 deletions(-) diff --git a/src/panel/RRDChart.js b/src/panel/RRDChart.js index dc5940c..983437e 100644 --- a/src/panel/RRDChart.js +++ b/src/panel/RRDChart

[pve-devel] [RFC manager 4/4] split ram usage into usage types

2023-12-11 Thread Folke Gleumes
Signed-off-by: Folke Gleumes --- PVE/API2/Nodes.pm| 6 +++--- PVE/API2Tools.pm | 2 +- PVE/Service/pvestatd.pm | 15 +++ www/manager6/node/Summary.js | 6 -- 4 files changed, 19 insertions(+), 10 deletions(-) diff --git a/PVE/API2/Nodes.pm b/PVE/AP

[pve-devel] [RFC common 2/4] add more detailed statistics to memory report

2023-12-11 Thread Folke Gleumes
Signed-off-by: Folke Gleumes --- src/PVE/ProcFSTools.pm | 11 ++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/src/PVE/ProcFSTools.pm b/src/PVE/ProcFSTools.pm index 3826fcc..5f5d768 100644 --- a/src/PVE/ProcFSTools.pm +++ b/src/PVE/ProcFSTools.pm @@ -279,7 +279,10 @@ sub

[pve-devel] [RFC cluster 1/4] rrd: add free, buffer/cache and arc size to memory statistics

2023-12-11 Thread Folke Gleumes
adding values to the rrd format break compatability with the old file. Therfore the filename/path had to be changed as well. Signed-off-by: Folke Gleumes --- src/pmxcfs/status.c | 9 ++--- 1 file changed, 6 insertions(+), 3 deletions(-) diff --git a/src/pmxcfs/status.c b/src/pmxcfs/status.c

Re: [pve-devel] [PATCH qemu-server] Properly identify the CPU architecture of 32-bit VMs

2023-12-11 Thread Fiona Ebner
Am 11.12.23 um 15:12 schrieb Filip Schauer: > @@ -3293,11 +3293,12 @@ sub is_native($) { > > sub get_vm_arch { > my ($conf) = @_; > -return $conf->{arch} // get_host_arch(); > +return $conf->{arch} // cpu_type_to_arch($conf->{cpu}) // > get_host_arch(); > } > > my $default_mach

[pve-devel] [PATCH qemu-server] Properly identify the CPU architecture of 32-bit VMs

2023-12-11 Thread Filip Schauer
Add an i386 CPU architecture which is used when a 32 bit CPU type is detected. This now prevents starting a 32-bit VM using a 64-bit OVMF BIOS. Instead it throws the error, "no OVMF images known for architecture 'i386'", triggered in get_ovmf_file. This behaviour is intended since we do not suppor

Re: [pve-devel] [PATCH many 00/21] notifications: notification metadata matching improvements

2023-12-11 Thread Maximiliano Sandoval
Lukas Wagner writes: > This patch series attempts to improve the user experience when creating > notification matchers. I gave the web UI side of things a test, it substantially improves the UX when setting Match Rules. In my brief testing everything worked correctly. Tested-by: Maximiliano

[pve-devel] [PATCH proxmox v2 3/5] time: posix: add bindings for strftime_l

2023-12-11 Thread Lukas Wagner
This variant of strftime can be provided with a locale_t, which determines the locale used for time formatting. A struct `Locale` was also introduced as a safe wrapper around locale_t. Signed-off-by: Lukas Wagner --- proxmox-time/src/posix.rs | 99 +++ 1 file

[pve-devel] [PATCH proxmox v2 0/5] sys: email: always format 'Date' header with C locale

2023-12-11 Thread Lukas Wagner
This patch series makes the formatting of the 'Date' header for sent emails independent of the system locale. Previously, strftime was used to generate the header, but since this function is locale-aware, invalid Date headers could be generated. As an example, if the locale was `de_DE.UTF-8`, then

[pve-devel] [PATCH proxmox v2 2/5] time: posix: inline vars in string formatting

2023-12-11 Thread Lukas Wagner
No functional changes. Signed-off-by: Lukas Wagner --- proxmox-time/src/posix.rs | 33 ++--- 1 file changed, 14 insertions(+), 19 deletions(-) diff --git a/proxmox-time/src/posix.rs b/proxmox-time/src/posix.rs index c463ab3..5913816 100644 --- a/proxmox-time/src/posi

[pve-devel] [PATCH proxmox v2 4/5] time: posix: add epoch_to_rfc2822

2023-12-11 Thread Lukas Wagner
This is the format used in the 'Date' header in mails. Signed-off-by: Lukas Wagner --- Changes v1 -> v2: - Fix TZ-dependent test case proxmox-time/src/posix.rs | 17 + 1 file changed, 17 insertions(+) diff --git a/proxmox-time/src/posix.rs b/proxmox-time/src/posix.rs index 9c8

[pve-devel] [PATCH qemu 2/2] pick fix for potential deadlock with QMP resize and iothread

2023-12-11 Thread Fiona Ebner
While the patch gives bdrv_graph_wrlock() as an example where the issue can manifest, something similar can happen even when that is disabled. Was able to reproduce the issue with while true; do qm resize 115 scsi0 +4M; sleep 1; done while running fio --name=make-mirror-work --size=100M --direct=1

[pve-devel] [PATCH proxmox v2 5/5] sys: email: use `epoch_to_rfc2822` from proxmox_time

2023-12-11 Thread Lukas Wagner
`strftime`'s formatting is locale-dependent. If the system locale was set to e.g. de_DE.UTF-8, the `Date` header became invalid (e.g Mo instead of Mon for 'Monday'), tripping up some mail clients (e.g. KMail). This commit should fix this by using the new `epoch_to_rfc2822` function from proxmox_ti

[pve-devel] [PATCH proxmox v2 1/5] time: posix: use strftime from the `libc` crate.

2023-12-11 Thread Lukas Wagner
Signed-off-by: Lukas Wagner --- proxmox-time/src/posix.rs | 14 +- 1 file changed, 1 insertion(+), 13 deletions(-) diff --git a/proxmox-time/src/posix.rs b/proxmox-time/src/posix.rs index 6157f8b..c463ab3 100644 --- a/proxmox-time/src/posix.rs +++ b/proxmox-time/src/posix.rs @@ -108,

[pve-devel] [PATCH qemu 1/2] add patch to work around stuck guest IO with iothread and VirtIO block/SCSI

2023-12-11 Thread Fiona Ebner
When using iothread, after commits 1665d9326f ("virtio-blk: implement BlockDevOps->drained_begin()") 766aa2de0f ("virtio-scsi: implement BlockDevOps->drained_begin()") it can happen that polling gets stuck when draining. This would cause IO in the guest to get completely stuck. A workaround for us

Re: [pve-devel] [PATCH proxmox 4/5] time: posix: add epoch_to_rfc2822

2023-12-11 Thread Lukas Wagner
On 12/5/23 13:11, Lukas Wagner wrote: diff --git a/proxmox-time/src/posix.rs b/proxmox-time/src/posix.rs + +#[test] +fn test_epoch_to_rfc2822() { +let epoch = 1609263000; +let formatted = epoch_to_rfc2822(epoch).unwrap(); +assert_eq!(formatted, "Tue, 29 Dec 2020 18:30:00 +0100"); +}

[pve-devel] [PATCH proxmox-widget-toolkit 18/21] notification: matcher: move match-severity fields to panel

2023-12-11 Thread Lukas Wagner
Also introduce a local viewModel that is linked to a parent viewModel, allowing us to move the formulas to the panel. This should make the code more cohesive and easier to follow. No functional changes. Signed-off-by: Lukas Wagner --- src/window/NotificationMatcherEdit.js | 129

[pve-devel] [PATCH proxmox-widget-toolkit 17/21] notification: matcher: move match-calendar fields to panel

2023-12-11 Thread Lukas Wagner
Also introduce a local viewModel that is linked to a parent viewModel, allowing us to move the formulas to the panel. This should make the code more cohesive and easier to follow. No functional changes. Signed-off-by: Lukas Wagner --- src/window/NotificationMatcherEdit.js | 92 +

[pve-devel] [PATCH pve-docs 20/21] notifications: describe new notification metadata fields

2023-12-11 Thread Lukas Wagner
Signed-off-by: Lukas Wagner --- notifications.adoc | 21 - 1 file changed, 12 insertions(+), 9 deletions(-) diff --git a/notifications.adoc b/notifications.adoc index f087dda..62a1cee 100644 --- a/notifications.adoc +++ b/notifications.adoc @@ -289,19 +289,22 @@ Notification

[pve-devel] [PATCH pve-manager 12/21] api: notification: add API for getting known metadata fields/values

2023-12-11 Thread Lukas Wagner
This new API route returns known notification metadata fields and a list of known possible values. This will be used by the UI to provide suggestions when adding/modifying match rules. Signed-off-by: Lukas Wagner --- PVE/API2/Cluster/Notifications.pm | 152 ++ 1 file

[pve-devel] [PATCH pve-docs 19/21] notification: clarify that 'hostname' does not include the domain

2023-12-11 Thread Lukas Wagner
This was a bit inconsistent between the different notification types: - APT/VZDump included the domain part - fence notifications did not A decision has been made to unify this by removing the domain part from APT/VZDump notifications. Signed-off-by: Lukas Wagner --- notifications.adoc | 2

[pve-devel] [PATCH proxmox-widget-toolkit 14/21] combogrid: add 'showClearTrigger' config

2023-12-11 Thread Lukas Wagner
This allows one configure the clear trigger to be shown, even if 'allowBlank' is set false. This can be useful if one has a non-editable combogrid where the value is set to something not present in the store. Example: Match rule editing, one selects a backup job to be match. If the backup job is re

[pve-devel] [PATCH pve-manager 13/21] ui: utils: add overrides for translatable notification fields/values

2023-12-11 Thread Lukas Wagner
Signed-off-by: Lukas Wagner --- www/manager6/Utils.js | 12 1 file changed, 12 insertions(+) diff --git a/www/manager6/Utils.js b/www/manager6/Utils.js index 63129358..315038e1 100644 --- a/www/manager6/Utils.js +++ b/www/manager6/Utils.js @@ -2030,6 +2030,18 @@ Ext.define('PVE.Util

[pve-devel] [PATCH pve-manager 07/21] ui: dc: backup: allow to set custom job id in advanced settings

2023-12-11 Thread Lukas Wagner
This might be useful if somebody wants to match on the new 'backup-job' field in a notification match rule. Signed-off-by: Lukas Wagner --- www/manager6/Utils.js | 4 www/manager6/dc/Backup.js | 11 +++ 2 files changed, 15 insertions(+) diff --git a/www/manager6/Utils.js b/www

[pve-devel] [PATCH pve-manager 05/21] ui: dc: backup: send 'id' property when starting a backup job manually

2023-12-11 Thread Lukas Wagner
Signed-off-by: Lukas Wagner --- www/manager6/dc/Backup.js | 1 - 1 file changed, 1 deletion(-) diff --git a/www/manager6/dc/Backup.js b/www/manager6/dc/Backup.js index 70903bdc..4beb84c0 100644 --- a/www/manager6/dc/Backup.js +++ b/www/manager6/dc/Backup.js @@ -569,7 +569,6 @@ Ext.define('PVE.dc

[pve-devel] [PATCH pve-manager 11/21] api: replication: include 'hostname' field for notifications

2023-12-11 Thread Lukas Wagner
The field contains the hostname of the host (without any domain part) which sends the notification. This field can be used in match-field match rules. Signed-off-by: Lukas Wagner --- PVE/API2/Replication.pm | 2 ++ 1 file changed, 2 insertions(+) diff --git a/PVE/API2/Replication.pm b/PVE/API2/

[pve-devel] [PATCH pve-manager 08/21] api: replication: add 'replication-job' to notification metadata

2023-12-11 Thread Lukas Wagner
This allows users to create notification match rules for specific replication jobs, if they so desire. Signed-off-by: Lukas Wagner --- PVE/API2/Replication.pm | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/PVE/API2/Replication.pm b/PVE/API2/Replication.pm index 0dc944c9..703

[pve-devel] [PATCH proxmox-widget-toolkit 16/21] notification: matcher: move match-field formulas to local viewModel

2023-12-11 Thread Lukas Wagner
This should make the code more cohesive and easier to follow. No functional changes. Signed-off-by: Lukas Wagner --- src/window/NotificationMatcherEdit.js | 186 +- 1 file changed, 92 insertions(+), 94 deletions(-) diff --git a/src/window/NotificationMatcherEdit.js b/s

[pve-devel] [PATCH proxmox-widget-toolkit 15/21] notification: matcher: match-field: show known fields/values

2023-12-11 Thread Lukas Wagner
These changes introduce combogrid pickers for the 'field' and 'value' form elements for 'match-field' match rules. The 'field' picker shows a list of all known metadata fields, while the 'value' picker shows a list of all known values, filtered depending on the current value of 'field'. The list o

[pve-devel] [PATCH proxmox 02/21] notify: matcher: support lists of values for 'exact' match-field mode

2023-12-11 Thread Lukas Wagner
For example, one can now use: match-field exact:type=vzdump,replication to match on vzdump AND replication events. Signed-off-by: Lukas Wagner --- proxmox-notify/src/matcher.rs | 43 +++ 1 file changed, 34 insertions(+), 9 deletions(-) diff --git a/proxmox-noti

[pve-devel] [PATCH pve-docs 21/21] notifications: match-field 'exact'-mode can now match multiple values

2023-12-11 Thread Lukas Wagner
Signed-off-by: Lukas Wagner --- notifications.adoc | 18 ++ 1 file changed, 6 insertions(+), 12 deletions(-) diff --git a/notifications.adoc b/notifications.adoc index 62a1cee..00776a5 100644 --- a/notifications.adoc +++ b/notifications.adoc @@ -221,11 +221,16 @@ configurable sch

[pve-devel] [PATCH pve-manager 10/21] vzdump: apt: notification: do not include domain in 'hostname' field

2023-12-11 Thread Lukas Wagner
- The man page warns about the usage of `hostname -f`, since a host may have multiple domains (or none at all) - The fallback PVE::INotify::nodename() already only returned the hostname without the domain part - Fencing notifications didn't include the domain part anyway This may result i

[pve-devel] [PATCH pve-manager 06/21] ui: dc: backup: show 'Job ID' column

2023-12-11 Thread Lukas Wagner
This is useful for creating matchers based on the 'backup-job' metadata field. Signed-off-by: Lukas Wagner --- www/manager6/dc/Backup.js | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/www/manager6/dc/Backup.js b/www/manager6/dc/Backup.js index 4beb84c0..fb4df0a7 100644 ---

[pve-devel] [PATCH pve-manager 09/21] ui: replication: show 'Job ID' column

2023-12-11 Thread Lukas Wagner
Notification match rules are able to match based on the job id, so it makes sense to display it to the user. Signed-off-by: Lukas Wagner --- www/manager6/grid/Replication.js | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/www/manager6/grid/Replication.js b/www/manager6/grid

[pve-devel] [PATCH pve-manager 03/21] api: notifications: add 'smtp' to target index

2023-12-11 Thread Lukas Wagner
Signed-off-by: Lukas Wagner --- PVE/API2/Cluster/Notifications.pm | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/PVE/API2/Cluster/Notifications.pm b/PVE/API2/Cluster/Notifications.pm index 7047f0b1..68fdda2a 100644 --- a/PVE/API2/Cluster/Notifications.pm +++ b/PVE/API2/Clu

[pve-devel] [PATCH proxmox 01/21] notify: include 'hostname' metadata field for forwarded mails

2023-12-11 Thread Lukas Wagner
Signed-off-by: Lukas Wagner --- proxmox-notify/src/lib.rs | 18 ++ 1 file changed, 14 insertions(+), 4 deletions(-) diff --git a/proxmox-notify/src/lib.rs b/proxmox-notify/src/lib.rs index 1fb9623..f3ee3ad 100644 --- a/proxmox-notify/src/lib.rs +++ b/proxmox-notify/src/lib.rs @@

[pve-devel] [PATCH many 00/21] notifications: notification metadata matching improvements

2023-12-11 Thread Lukas Wagner
This patch series attempts to improve the user experience when creating notification matchers. Some of the noteworthy changes: - Fixup inconsistent 'hostname' field. Some notification events sent the hostname including a domain, while other did not. This series unifies the behavior, now the

[pve-devel] [PATCH pve-manager 04/21] api: jobs: vzdump: pass job 'id' parameter

2023-12-11 Thread Lukas Wagner
This allows us to access us the backup job id in the send_notification function, where we can set it as metadata for the notification. Signed-off-by: Lukas Wagner --- PVE/API2/VZDump.pm | 8 PVE/Jobs/VZDump.pm | 4 +++- PVE/VZDump.pm | 6 +++--- 3 files changed, 14 insertions(+), 4

[pve-devel] applied: [PATCH] fix #5063: load webgl addon in try block

2023-12-11 Thread Thomas Lamprecht
Am 11/12/2023 um 11:19 schrieb Dominik Csapak: > since under certain circumstances (e.g. using safari < 16) the addon > constructor already throws an exception, not only the loading later. > > To allow falling back to the canvas renderer, move it into the try block > after webgl detection. > > Th

[pve-devel] [PATCH] fix #5063: load webgl addon in try block

2023-12-11 Thread Dominik Csapak
since under certain circumstances (e.g. using safari < 16) the addon constructor already throws an exception, not only the loading later. To allow falling back to the canvas renderer, move it into the try block after webgl detection. This should fix the xterm.js console on iOS in chrome and other

Re: [pve-devel] [PATCH qemu-server 1/1] fix #4507 : increase qemu max openfiles limit

2023-12-11 Thread Fiona Ebner
Much of the cover letter would be nice to have as a commit message here. Missing your Signed-off-by. Am 10.12.23 um 15:49 schrieb Alexandre Derumier: > --- > PVE/QemuServer.pm | 6 ++ > 1 file changed, 6 insertions(+) > > diff --git a/PVE/QemuServer.pm b/PVE/QemuServer.pm > index 2063e66..e