Re: [pve-devel] applied: [PATCH v2] pmxcfs: fix wrong information now covered in pvecm

2016-10-20 Thread Thomas Lamprecht
On 10/20/2016 05:34 PM, Dietmar Maurer wrote: applied, but see comment inline: On October 20, 2016 at 5:11 PM Thomas Lamprecht wrote: The "Remove Cluster configuration" section is outdated and has also missing steps (e.g. stopping corosync before removing its config) We have the informatio

[pve-devel] [PATCH 3/5] add targetstorage to vm_start

2016-10-20 Thread Alexandre Derumier
This will create a new drive for each local drive found, and start the vm with this new drives. if targetstorage == 1, we use same sid than original vm disk a nbd server is started in qemu and expose local volumes to network port Signed-off-by: Alexandre Derumier --- PVE/API2/Qemu.pm | 15 +++

[pve-devel] [PATCH 1/5] qemu_drive_mirror : handle multiple jobs

2016-10-20 Thread Alexandre Derumier
we can use multiple drive_mirror in parralel. block-job-complete can be skipped, if we want to add more mirror job later. also add support for nbd uri to qemu_drive_mirror Signed-off-by: Alexandre Derumier --- PVE/QemuServer.pm | 141 +++--- 1 fi

[pve-devel] Live storage migration v3

2016-10-20 Thread Alexandre Derumier
changelog: - mirror disks 1 by 1 to avoid storage && network overload - use vm_start targetstorage = 1 instead 'auto' - add eval for drive_mirror qmp - errors messages improvements ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxm

[pve-devel] [PATCH 5/5] add live storage migration with vm migration

2016-10-20 Thread Alexandre Derumier
This allow to migrate disks on local storage to a remote node storage. When the target node start, a new volumes are created and exposed through qemu embedded nbd server. qemu drive-mirror is launch on source vm for each disk with nbd server as target. when drive-mirror reach 100% of 1 disk,

[pve-devel] [PATCH 4/5] add qm nbdstop

2016-10-20 Thread Alexandre Derumier
we use it to stop remote nbd server Signed-off-by: Alexandre Derumier --- PVE/CLI/qm.pm | 24 PVE/QemuServer.pm | 6 ++ 2 files changed, 30 insertions(+) diff --git a/PVE/CLI/qm.pm b/PVE/CLI/qm.pm index e513f33..a44204c 100755 --- a/PVE/CLI/qm.pm +++ b/PVE/CLI/

[pve-devel] [PATCH 2/5] clone live vm : add support for multiple jobs

2016-10-20 Thread Alexandre Derumier
Signed-off-by: Alexandre Derumier --- PVE/API2/Qemu.pm | 12 +++- 1 file changed, 11 insertions(+), 1 deletion(-) diff --git a/PVE/API2/Qemu.pm b/PVE/API2/Qemu.pm index ad7a0c0..7ec2591 100644 --- a/PVE/API2/Qemu.pm +++ b/PVE/API2/Qemu.pm @@ -2398,21 +2398,29 @@ __PACKAGE__->register_met

[pve-devel] applied: [PATCH v2] pmxcfs: fix wrong information now covered in pvecm

2016-10-20 Thread Dietmar Maurer
applied, but see comment inline: > On October 20, 2016 at 5:11 PM Thomas Lamprecht > wrote: > > > The "Remove Cluster configuration" section is outdated and has also > missing steps (e.g. stopping corosync before removing its config) > > We have the information in the pvecm.adoc (Cluster Manag

[pve-devel] applied: [PATCH manager] fix #1175: make error messages more verbose

2016-10-20 Thread Dietmar Maurer
applied ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

[pve-devel] applied: [PATCH docs] add external metric server to sysadmin.adoc

2016-10-20 Thread Dietmar Maurer
applied ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

Re: [pve-devel] firewall permissions / network permissions

2016-10-20 Thread Dietmar Maurer
> A firewall change is simple sysadmin task. But in worst case a user can > deaktivate the ip/mac spoofing or connect to another bridge. > In our case we have some windows vms to mange the cluster and network. They > have access to another bridge which is connected to the internal network. Any > us

[pve-devel] [PATCH v2] pmxcfs: fix wrong information now covered in pvecm

2016-10-20 Thread Thomas Lamprecht
The "Remove Cluster configuration" section is outdated and has also missing steps (e.g. stopping corosync before removing its config) We have the information in the pvecm.adoc (Cluster Manager) so delete the howto and reference the one from pvecm instead. Signed-off-by: Thomas Lamprecht --- cha

[pve-devel] firewall permissions / network permissions

2016-10-20 Thread VELARTIS Philipp Dürhammer
I was checking also in the forum and seems that other users miss this too. Shouldn't it be better to distinguish between firewall and network config? Actually even all firewall config like on/off an ip/mac filter should be placed in different priviledges. Only für giving a user the permission to

[pve-devel] applied+cleanup: [RFC zfsonlinux 0/3] Update ZFS to 0.6.5.8

2016-10-20 Thread Fabian Grünbichler
applied whole series, minor cleanup for makefile: - fix typo - make download uses tag for pkg-zfs (was not available originally) On Fri, Oct 14, 2016 at 03:22:36PM +0200, Fabian Grünbichler wrote: > this patch series moves from the ZoL package base to a Debian Jessie package > base. because of the

[pve-devel] applied: [PATCH kernel 3/3] bump version to 4.4.21-70

2016-10-20 Thread Fabian Grünbichler
--- Makefile | 2 +- changelog.Debian | 8 2 files changed, 9 insertions(+), 1 deletion(-) diff --git a/Makefile b/Makefile index f4b023c..90680ef 100644 --- a/Makefile +++ b/Makefile @@ -2,7 +2,7 @@ RELEASE=4.3 # also update proxmox-ve/changelog if you change KERNEL_VER or KR

[pve-devel] applied: [PATCH kernel 2/3] update ZFS/SPL to 0.6.5.8

2016-10-20 Thread Fabian Grünbichler
--- pkg-spl.tar.gz | Bin 14477761 -> 4037090 bytes pkg-zfs.tar.gz | Bin 38521842 -> 11026286 bytes 2 files changed, 0 insertions(+), 0 deletions(-) diff --git a/pkg-spl.tar.gz b/pkg-spl.tar.gz index c4ac665..d8009c9 100644 Binary files a/pkg-spl.tar.gz and b/pkg-spl.tar.gz differ diff --git a/p

[pve-devel] applied: [PATCH kernel 1/3] update to Ubuntu-4.4.0-45.66

2016-10-20 Thread Fabian Grünbichler
--- Makefile | 2 +- ubuntu-xenial.tgz | Bin 145650761 -> 145653568 bytes 2 files changed, 1 insertion(+), 1 deletion(-) diff --git a/Makefile b/Makefile index 0f41f5a..f4b023c 100644 --- a/Makefile +++ b/Makefile @@ -127,7 +127,7 @@ ${VIRTUAL_HDR_DEB} pve-headers: proxmox-ve/pve-hea

Re: [pve-devel] [PATCH 2/7] use qemu_drive_mirror_monitor in live full clone

2016-10-20 Thread Alexandre DERUMIER
>>That was what the code did previously. In cose of clone_vm I'm not sure how >>much sense that made before. A job count should be easy to implement though? >>(Add a counter to the loop and when it hits the desired number call >>qemu_drive_mirror_monitor() and reset the counter, then also call it a

Re: [pve-devel] [PATCH 1/7] split qemu_drive_mirror_monitor from qemu_drive_mirror.

2016-10-20 Thread Alexandre DERUMIER
>>Doesn't make sense given the patch snippet: Ok, sorry, I think I have read an old git code in my sources. I'll fix that - Mail original - De: "Wolfgang Bumiller" À: "Alexandre Derumier" Cc: "pve-devel" Envoyé: Jeudi 20 Octobre 2016 12:51:42 Objet: Re: [pve-devel] [PATCH 1/7] split q

[pve-devel] [PATCH manager] fix #1175: make error messages more verbose

2016-10-20 Thread Dominik Csapak
the error messages for several input fields (e.g. snapshot name) did not correctly reflect the regex which was checked this patch adds additional information about the required format Signed-off-by: Dominik Csapak --- www/manager6/Toolkit.js | 15 +++ 1 file changed, 11 insertions(+

[pve-devel] [RFC v1/2 manager] pvestatd: add simple container cpuset balancing

2016-10-20 Thread Wolfgang Bumiller
--- PVE/Service/pvestatd.pm | 171 1 file changed, 171 insertions(+) diff --git a/PVE/Service/pvestatd.pm b/PVE/Service/pvestatd.pm index 98e5844..0d51574 100755 --- a/PVE/Service/pvestatd.pm +++ b/PVE/Service/pvestatd.pm @@ -15,6 +15,7 @@ use PVE:

[pve-devel] [RFC v2/2 manager] pvestatd: cpu utilization based rebalancing

2016-10-20 Thread Wolfgang Bumiller
--- PVE/Service/pvestatd.pm | 335 +++- 1 file changed, 332 insertions(+), 3 deletions(-) diff --git a/PVE/Service/pvestatd.pm b/PVE/Service/pvestatd.pm index 98e5844..6164546 100755 --- a/PVE/Service/pvestatd.pm +++ b/PVE/Service/pvestatd.pm @@ -3,6 +3

[pve-devel] [RFC v0/2 manager] statd: cpuset scheduling for containers

2016-10-20 Thread Wolfgang Bumiller
These patches are two versions of cpuset scheduling: The first is similar to what lxd does: it just spreads containers across cores balanced by numbers. This is simple and effectice, but can lead to cases where two busy containers share the same cores while other containers are sitting around idle

Re: [pve-devel] [PATCH] pmxcfs: fix wrong information now covered in pvecm

2016-10-20 Thread Thomas Lamprecht
FYI: the preprocessor which parses the links is not multiline aware currently I had a longer name and id and thus wrapped it, it looked like: > pvecm_separate_node_without_reinstalling,Separate A Node Without > Reinstalling'>> which then won't work. So do not wrap links for now :) On 10/20

Re: [pve-devel] [PATCH 1/7] split qemu_drive_mirror_monitor from qemu_drive_mirror.

2016-10-20 Thread Wolfgang Bumiller
On Thu, Oct 20, 2016 at 10:57:22AM +0200, Alexandre DERUMIER wrote: > >> + vm_mon_cmd($vmid, "drive-mirror", %$opts); > > >>This is now outside an eval block which otherwise had a cancel_job() > >>error case. (Note that it looks like the error cases of vm_mon_cmd() > >>*should* not need a cance

Re: [pve-devel] [PATCH 4/7] add targetstorage to vm_start

2016-10-20 Thread Wolfgang Bumiller
> On October 20, 2016 at 11:00 AM Alexandre DERUMIER > wrote: > > > >>Maybe don't use 'pve-storage-id' for targetstorage in the schema and > >>use a '1' instead of 'auto', since 'auto' is a valid storage name while > >>'1' is not. > > Yes, I had tried that but had pve-storage-id format error.

Re: [pve-devel] [PATCH 2/7] use qemu_drive_mirror_monitor in live full clone

2016-10-20 Thread Wolfgang Bumiller
> On October 20, 2016 at 11:03 AM Alexandre DERUMIER > wrote: > > > >>I wonder if we should give the clone_disk() - which is called above in a > >>loop - a parameter telling it to do this. Not only would save us a > >>query-block-job call in the cases where we qemu_drive_mirror() isn't > >>cal

Re: [pve-devel] [PATCH] pmxcfs: fix wrong information now covered in pvecm

2016-10-20 Thread Thomas Lamprecht
On 10/20/2016 12:23 PM, Fabian Grünbichler wrote: On Thu, Oct 20, 2016 at 12:01:48PM +0200, Thomas Lamprecht wrote: Linking stuff is currently not trivial, multiple ifdef have to be defined. Further asciidoc cannot do "elsif" or "else" which makes the process cumbersome. Also inter linking to

Re: [pve-devel] [PATCH] pmxcfs: fix wrong information now covered in pvecm

2016-10-20 Thread Fabian Grünbichler
On Thu, Oct 20, 2016 at 12:01:48PM +0200, Thomas Lamprecht wrote: > Linking stuff is currently not trivial, multiple ifdef have to be defined. > Further asciidoc cannot do "elsif" or "else" which makes the process > cumbersome. > Also inter linking to other chapters is not really possible, afaik. A

[pve-devel] [PATCH] pmxcfs: fix wrong information now covered in pvecm

2016-10-20 Thread Thomas Lamprecht
The "Remove Cluster configuration" section is outdated and has also missing steps (e.g. stopping corosync before removing its config) We have the information in the pvecm.adoc (Cluster Manager) so delete the howto and reference the one from pvecm instead. Signed-off-by: Thomas Lamprecht --- Lin

[pve-devel] [PATCH docs] add external metric server to sysadmin.adoc

2016-10-20 Thread Dominik Csapak
this did only exist as a wiki article, but since we ship with it, this should be in the reference documentation Signed-off-by: Dominik Csapak --- pve-external-metric-server.adoc | 57 + sysadmin.adoc | 4 +++ 2 files changed, 61 insertio

[pve-devel] applied: [PATCH qemu-server] Close #351: add more info to backup log

2016-10-20 Thread Dietmar Maurer
applied ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

[pve-devel] applied: [PATCH docs] rename Download Link to Link

2016-10-20 Thread Dietmar Maurer
applied ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

[pve-devel] [PATCH qemu-server] Close #351: add more info to backup log

2016-10-20 Thread Emmanuel Kasper
Before patch: INFO: exclude disk 'scsi1' (backup=no) INFO: skip unused drive 'local:401/vm-401-disk-3.raw' (not included into backup) INFO: skip unused drive 'local:401/vm-401-disk-1.raw' (not included into backup) After patch applied: INFO: include disk 'scsi0' local:401/vm-401-disk-4.qcow2 INFO:

Re: [pve-devel] Live storage migration V2

2016-10-20 Thread Fabian Grünbichler
On Thu, Oct 20, 2016 at 02:35:09AM +0200, Alexandre Derumier wrote: > changelog: > - add support for multiple local disks > - complete the mirror jobs after the vm migration > - rewrote qemu-mirror block jobs monitoring to handle multiple jobs in > parralel > - qm migrate -online will try to

Re: [pve-devel] [PATCH 2/7] use qemu_drive_mirror_monitor in live full clone

2016-10-20 Thread Alexandre DERUMIER
>>I wonder if we should give the clone_disk() - which is called above in a >>loop - a parameter telling it to do this. Not only would save us a >>query-block-job call in the cases where we qemu_drive_mirror() isn't >>called, but since this is the $running case, I'm worried about too many >>parallel

Re: [pve-devel] [PATCH 4/7] add targetstorage to vm_start

2016-10-20 Thread Alexandre DERUMIER
>>Maybe don't use 'pve-storage-id' for targetstorage in the schema and >>use a '1' instead of 'auto', since 'auto' is a valid storage name while >>'1' is not. Yes, I had tried that but had pve-storage-id format error. I'll remove the pve-storage-id format if it's ok for you. - Mail original -

Re: [pve-devel] [PATCH 1/7] split qemu_drive_mirror_monitor from qemu_drive_mirror.

2016-10-20 Thread Alexandre DERUMIER
>> + vm_mon_cmd($vmid, "drive-mirror", %$opts); >>This is now outside an eval block which otherwise had a cancel_job() >>error case. (Note that it looks like the error cases of vm_mon_cmd() >>*should* not need a cancel_job() call, but it's better to be safe than >>sorry. This was already out

[pve-devel] [PATCH docs] rename Download Link to Link

2016-10-20 Thread Dominik Csapak
because apart from the complete guide on the top, the sites are not intended to be downloaded, but simply clicked Signed-off-by: Dominik Csapak --- i guess you could download the sites, but i don't think this is practical? index.adoc | 8 1 file changed, 4 insertions(+), 4 deletions(-)

Re: [pve-devel] [PATCH 4/7] add targetstorage to vm_start

2016-10-20 Thread Wolfgang Bumiller
On Thu, Oct 20, 2016 at 02:35:13AM +0200, Alexandre Derumier wrote: > This will create a new drive for each local drive found, > and start the vm with this new drives. > > if targetstorage == 'auto', we use same sid than original vm disk Maybe don't use 'pve-storage-id' for targetstorage in the s

Re: [pve-devel] [PATCH 1/7] split qemu_drive_mirror_monitor from qemu_drive_mirror.

2016-10-20 Thread Wolfgang Bumiller
On Thu, Oct 20, 2016 at 02:35:10AM +0200, Alexandre Derumier wrote: > we can use multiple drive_mirror in parralel > > Signed-off-by: Alexandre Derumier > --- > PVE/QemuServer.pm | 98 > +-- > 1 file changed, 59 insertions(+), 39 deletions(-)

Re: [pve-devel] [PATCH 3/7] add drive_mirror_monitor to move_disk

2016-10-20 Thread Wolfgang Bumiller
On Thu, Oct 20, 2016 at 02:35:12AM +0200, Alexandre Derumier wrote: > Signed-off-by: Alexandre Derumier > --- > PVE/API2/Qemu.pm | 2 ++ > 1 file changed, 2 insertions(+) > > diff --git a/PVE/API2/Qemu.pm b/PVE/API2/Qemu.pm > index 98865f6..62055d1 100644 > --- a/PVE/API2/Qemu.pm > +++ b/PVE/API

Re: [pve-devel] [PATCH 2/7] use qemu_drive_mirror_monitor in live full clone

2016-10-20 Thread Wolfgang Bumiller
On Thu, Oct 20, 2016 at 02:35:11AM +0200, Alexandre Derumier wrote: > Signed-off-by: Alexandre Derumier > --- > PVE/API2/Qemu.pm | 1 + > 1 file changed, 1 insertion(+) > > diff --git a/PVE/API2/Qemu.pm b/PVE/API2/Qemu.pm > index ad7a0c0..98865f6 100644 > --- a/PVE/API2/Qemu.pm > +++ b/PVE/API2/