Re: [pve-devel] [PATCH installer 6/7] auto-installer: add new `global.root_password_hashed` answer option

2024-05-24 Thread Christoph Heiss
On Thu, May 23, 2024 at 02:19:34PM +0200, Christoph Heiss wrote: > This allows user to specify the root password in a hashed format, > generated using e.g. mkpasswd(1), instead of plaintext. > > Signed-off-by: Christoph Heiss > --- > proxmox-auto-installer/src/answer.rs | 3 ++- > proxmox-auto-in

[pve-devel] [PATCH installer v4 0/3] expose zfs arc size setting for all products

2024-05-24 Thread Christoph Heiss
As suggested by Thomas, leaves the ZFS default if the user never touches the setting in the installer (i.e. not writing a modprobe file). See also the discussion in v1 [0]. [0] https://lists.proxmox.com/pipermail/pve-devel/2024-February/061659.html Testing --- Tested the installation of PVE a

[pve-devel] [PATCH installer v4 1/3] tui: NumericEditView: add optional placeholder value

2024-05-24 Thread Christoph Heiss
Enables to add an optional placeholder value to `NumericEditView`, which will be displayed in a different (darker) color and not returned by `.get_content*()`. Can be used for having default values in the TUI, but with different handling in the back. Signed-off-by: Christoph Heiss --- Changes v3

[pve-devel] [PATCH installer v4 2/3] tui: expose arc size setting for zfs bootdisks for all products

2024-05-24 Thread Christoph Heiss
For non-PVE products, simply use the ZFS defaults (aka. 50%) and leave unset, if the user never touches that setting. Signed-off-by: Christoph Heiss --- Changes v3 -> v4: * rebased on latest master, trivial conflict Changes v2 -> v3: * no changes Changes v1 -> v2: * use new placeholder fu

[pve-devel] [PATCH installer v4 3/3] proxinstall: expose arc size setting for zfs bootdisks for all products

2024-05-24 Thread Christoph Heiss
For non-PVE products, simply use the ZFS defaults (aka. 50%) and leave unset, if the user never touches that setting. Signed-off-by: Christoph Heiss --- Changes v3 -> v4: * no changes Changes v2 -> v3: * rework based on Maximilano's suggestion using Gtk3::Adjustment Changes v1 -> v2: * ad

Re: [pve-devel] [PATCH installer v3 0/3] expose zfs arc size setting for all products

2024-05-24 Thread Christoph Heiss
v4: https://lists.proxmox.com/pipermail/pve-devel/2024-May/063957.html ___ pve-devel mailing list pve-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

[pve-devel] [PATCH storage v4 04/12] ovf: improve and simplify path checking code

2024-05-24 Thread Dominik Csapak
moves the filepath code a bit more closer to where it's actually used checks the contained path before trying to find it's absolute path properly add error handling to realpath instead of checking the combined ovf_path + filepath, just make sure filepath can't point to anythign besides a file in t

[pve-devel] [PATCH storage v4 02/12] plugin: dir: implement import content type

2024-05-24 Thread Dominik Csapak
in DirPlugin and not Plugin (because of cyclic dependency of Plugin -> OVF -> Storage -> Plugin otherwise) only ovf is currently supported (though ova will be shown in import listing), expects the files to not be in a subdir, and adjacent to the ovf file. listed will be all ovf/qcow2/raw/vmdk fil

[pve-devel] [PATCH storage v4 06/12] ovf: implement parsing out firmware type

2024-05-24 Thread Dominik Csapak
it seems there is no part of the ovf standard that handles which type of bios there is (at least i could not find it). Every ovf/ova i tested either has no info about it, or has it in a vmware specific property which we parse here. Signed-off-by: Dominik Csapak --- src/PVE/GuestImport/OVF.pm

[pve-devel] [PATCH storage v4 07/12] ovf: implement rudimentary boot order

2024-05-24 Thread Dominik Csapak
simply add all parsed disks to the boot order in the order we encounter them (similar to the esxi plugin). Signed-off-by: Dominik Csapak --- src/PVE/GuestImport/OVF.pm | 6 +- src/test/run_ovf_tests.pl | 3 +++ 2 files changed, 8 insertions(+), 1 deletion(-) diff --git a/src/PVE/GuestImpor

[pve-devel] [PATCH storage v4 12/12] plugin: file_size_info: don't ignore base path with whitespace

2024-05-24 Thread Dominik Csapak
if the base image (parent) of an image contains whitespace in it's path (e.g. a space), the current untainting would not match and it would seem there was no parent. Fix that by adapting the untaint regex Signed-off-by: Dominik Csapak --- src/PVE/Storage/Plugin.pm | 2 +- 1 file changed, 1 inse

[pve-devel] [PATCH storage v4 09/12] api: allow ova upload/download

2024-05-24 Thread Dominik Csapak
introducing a separate regex that only contains ova, since upload/downloading ovfs does not make sense (since the disks are then missing). Signed-off-by: Dominik Csapak --- src/PVE/API2/Storage/Status.pm | 18 ++ src/PVE/Storage.pm | 11 +++ 2 files changed, 2

[pve-devel] [PATCH qemu-server v4 1/4] api: delete unused OVF.pm

2024-05-24 Thread Dominik Csapak
the api part was never in use by anything Signed-off-by: Dominik Csapak --- PVE/API2/Qemu/Makefile | 2 +- PVE/API2/Qemu/OVF.pm | 53 -- 2 files changed, 1 insertion(+), 54 deletions(-) delete mode 100644 PVE/API2/Qemu/OVF.pm diff --git a/PVE/API2/Qem

[pve-devel] [PATCH manager v4 9/9] ui: import: show size for dir-based storages

2024-05-24 Thread Dominik Csapak
since there we already have the size information Signed-off-by: Dominik Csapak --- www/manager6/storage/Browser.js | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/www/manager6/storage/Browser.js b/www/manager6/storage/Browser.js index 763abc70..c0b66acc 100644 --- a/www/manag

[pve-devel] [PATCH manager v4 3/9] ui: enable import content type for relevant storages

2024-05-24 Thread Dominik Csapak
Signed-off-by: Dominik Csapak --- www/manager6/Utils.js| 1 + www/manager6/form/ContentTypeSelector.js | 2 +- www/manager6/storage/CephFSEdit.js | 2 +- www/manager6/storage/GlusterFsEdit.js| 2 +- 4 files changed, 4 insertions(+), 3 deletions(-) diff --git a/www/m

[pve-devel] [PATCH storage v4 03/12] plugin: dir: handle ova files for import

2024-05-24 Thread Dominik Csapak
since we want to handle ova files (which are only ovf+images bundled in a tar file) for import, add code that handles that. we introduce a valid volname for files contained in ovas like this: storage:import/archive.ova/disk-1.vmdk by basically treating the last part of the path as the name for

[pve-devel] [PATCH qemu-server v4 3/4] api: create: implement extracting disks when needed for import-from

2024-05-24 Thread Dominik Csapak
when 'import-from' contains a disk image that needs extraction (currently only from an 'ova' archive), do that in 'create_disks' and overwrite the '$source' volid. Collect the names into a 'delete_sources' list, that we use later to clean it up again (either when we're finished with importing or i

[pve-devel] [PATCH qemu-server v4 4/4] api: create: add 'import-extraction-storage' parameter

2024-05-24 Thread Dominik Csapak
this is to override the target extraction storage for the option disk extraction for 'import-from'. This way if the storage does not supports the content type 'images', one can give an alternative one. Signed-off-by: Dominik Csapak --- PVE/API2/Qemu.pm | 46 +

[pve-devel] [PATCH storage/qemu-server/manager v4] implement ova/ovf import for file based storages

2024-05-24 Thread Dominik Csapak
This series enables importing ova/ovf from directory based storages, inclusive upload/download via the webui (ova only). It also improves the ovf importer by parsing the ostype, nics, bootorder (and firmware from vmware exported files). I opted to move the OVF.pm to pve-storage, since there is no

[pve-devel] [PATCH storage v4 08/12] ovf: implement parsing nics

2024-05-24 Thread Dominik Csapak
by iterating over the relevant parts and trying to parse out the 'ResourceSubType'. The content of that is not standardized, but I only ever found examples that are compatible with vmware, meaning it's either 'e1000', 'e1000e' or 'vmxnet3' (in various capitalizations; thus the `lc()`) As a fallbac

[pve-devel] [PATCH storage v4 11/12] add 'import' content type to 'check_volume_access'

2024-05-24 Thread Dominik Csapak
in the same branch as 'vztmpl' and 'iso' Signed-off-by: Dominik Csapak --- src/PVE/Storage.pm | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/PVE/Storage.pm b/src/PVE/Storage.pm index 7c43701..8b9d21b 100755 --- a/src/PVE/Storage.pm +++ b/src/PVE/Storage.pm @@ -542,7 +542

[pve-devel] [PATCH manager v4 2/9] ui: guest import: add ova-needs-extracting warning text

2024-05-24 Thread Dominik Csapak
Signed-off-by: Dominik Csapak --- www/manager6/window/GuestImport.js | 1 + 1 file changed, 1 insertion(+) diff --git a/www/manager6/window/GuestImport.js b/www/manager6/window/GuestImport.js index 4bedc211..76ba6dc8 100644 --- a/www/manager6/window/GuestImport.js +++ b/www/manager6/window/Gues

[pve-devel] [PATCH manager v4 1/9] ui: fix special 'import' icon for non-esxi storages

2024-05-24 Thread Dominik Csapak
we only want to show that icon in the tree when the storage is solely used for importing, not when it's just one of several content types. Signed-off-by: Dominik Csapak --- www/manager6/Utils.js | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/www/manager6/Utils.js b/www/manag

[pve-devel] [PATCH manager v4 8/9] ui: guest import: change icon/text for non-esxi import storage

2024-05-24 Thread Dominik Csapak
since 'virtual guests' only make sense for a hypervisor, not e.g. a directory for OVAs also change the icon from 'desktop' to 'cloud-download' in the non-esxi case Signed-off-by: Dominik Csapak --- www/manager6/storage/Browser.js | 6 -- 1 file changed, 4 insertions(+), 2 deletions(-) diff

[pve-devel] [PATCH storage v4 10/12] plugin: enable import for nfs/btrfs/cifs/cephfs/glusterfs

2024-05-24 Thread Dominik Csapak
and reuse the DirPlugin implementation Signed-off-by: Dominik Csapak --- src/PVE/Storage/BTRFSPlugin.pm | 5 + src/PVE/Storage/CIFSPlugin.pm | 6 +- src/PVE/Storage/CephFSPlugin.pm| 6 +- src/PVE/Storage/GlusterfsPlugin.pm | 6 +- src/PVE/Storage/NFSPlugin.pm |

[pve-devel] [PATCH storage v4 05/12] ovf: implement parsing the ostype

2024-05-24 Thread Dominik Csapak
use the standards info about the ostypes to map to our own (see comment for link to the relevant part of the dmtf schema) every type that is not listed we map to 'other', so no need to have it in a list. Signed-off-by: Dominik Csapak --- src/PVE/GuestImport/OVF.pm | 69 +

[pve-devel] [PATCH manager v4 7/9] ui: guest import: add storage selector for ova extraction storage

2024-05-24 Thread Dominik Csapak
but only when we detect the 'ova-needs-extraction' warning. This can be used to select the storage where the disks contained in an OVA will be extracted to temporarily. Signed-off-by: Dominik Csapak --- www/manager6/window/GuestImport.js | 23 +++ 1 file changed, 23 insertion

[pve-devel] [PATCH qemu-server v4 2/4] use OVF from Storage

2024-05-24 Thread Dominik Csapak
and delete it here (incl tests; they live in pve-storage now). Signed-off-by: Dominik Csapak --- PVE/CLI/qm.pm | 4 +- PVE/QemuServer/Makefile | 1 - PVE/QemuServer/OVF.pm | 242 -- debian/control

[pve-devel] [PATCH manager v4 4/9] ui: enable upload/download/remove buttons for 'import' type storages

2024-05-24 Thread Dominik Csapak
but only for non esxi ones, since that does not allow uploading/downloading there Signed-off-by: Dominik Csapak --- www/manager6/storage/Browser.js| 9 +++-- www/manager6/window/UploadToStorage.js | 1 + 2 files changed, 8 insertions(+), 2 deletions(-) diff --git a/www/manager6/stor

[pve-devel] [PATCH storage v4 01/12] copy OVF.pm from qemu-server

2024-05-24 Thread Dominik Csapak
copies the OVF.pm and relevant ovf tests from qemu-server. We need it here, and it uses PVE::Storage already, and since there is no intermediary package/repository we could put it, it seems fitting in here. Put it in a new GuestImport module Signed-off-by: Dominik Csapak --- debian/control

[pve-devel] [PATCH manager v4 5/9] ui: disable 'import' button for non importable formats

2024-05-24 Thread Dominik Csapak
importable formats are currently ova/ovf/vmx Signed-off-by: Dominik Csapak --- www/manager6/storage/Browser.js | 8 +++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git a/www/manager6/storage/Browser.js b/www/manager6/storage/Browser.js index 934ce706..822257e7 100644 --- a/www/ma

[pve-devel] [PATCH manager v4 6/9] ui: import: improve rendering of volume names

2024-05-24 Thread Dominik Csapak
in directory storages, we don't need the 'import/' part of the volumes, as that is implied in dir based storages Signed-off-by: Dominik Csapak --- www/manager6/Utils.js | 8 +++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git a/www/manager6/Utils.js b/www/manager6/Utils.js index

Re: [pve-devel] [PATCH storage/qemu-server/manager v3] implement ova/ovf import for file based storages

2024-05-24 Thread Dominik Csapak
sent a v4 of this ___ pve-devel mailing list pve-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel