Re: [pve-devel] [PATCH] Add qga freeze in vzdump in snapshot mode

2014-12-09 Thread Dietmar Maurer
comments inline:

  PVE/VZDump/QemuServer.pm |   19 +--
  1 file changed, 17 insertions(+), 2 deletions(-)
 
 diff --git a/PVE/VZDump/QemuServer.pm b/PVE/VZDump/QemuServer.pm index
 fd36c69..2c62de3 100644
 --- a/PVE/VZDump/QemuServer.pm
 +++ b/PVE/VZDump/QemuServer.pm
 @@ -286,8 +286,8 @@ sub archive {
  my $resume_on_backup;
 
  my $skiplock = 1;
 -
 -if (!PVE::QemuServer::check_running($vmid)) {
 +my $vm_is_running = PVE::QemuServer::check_running($vmid);
 +if (!$vm_is_running) {
   eval {
   $self-loginfo(starting kvm to execute backup task);
   PVE::QemuServer::vm_start($self-{storecfg}, $vmid, undef, @@ -
 380,8 +380,23 @@ sub archive {
 
   $qmpclient-queue_cmd($vmid, $add_fd_cb, 'getfd',
 fd = $outfileno, fdname = backup);
 +
 + my $freeze_fs = 0;
 +
 + if ( $self-{vmlist}-{$vmid}-{agent} == 1  $vm_is_running ){

please use:

if ( $self-{vmlist}-{$vmid}-{agent}  $vm_is_running ) {

 + $freeze_fs = PVE::QemuServer::vm_mon_cmd($vmid,guest-fsfreeze-
 freeze);
 + $self-loginfo(Can't freeze fs!)if ( defined($freeze_fs) 
 $freeze_fs == 0 );
 + }
 +

Please note that the result from qqa command is not trusted, so you need to 
parse
the result if you really want to use it.
Also, sometime guest-fsfreeze-freeze just returns an empty string ''.
Also, it can run into timeouts, and can raise other exceptions.
So please catch exceptions here.

   $qmpclient-queue_execute();
 
 + my $thaw_fs = 0;
 + $thaw_fs= PVE::QemuServer::vm_mon_cmd($vmid,guest-fsfreeze-
 thaw)
 + if ( $freeze_fs  0 );
 +
 + $self-loginfo(Error by trying thaw fs, you must unlock manually)
 + if ( $freeze_fs  0  0 != $freeze_fs - $thaw_fs );
 +

Same here (exceptions, parse result).

I would simply ignore the result of those commands (to keep it simple).


___
pve-devel mailing list
pve-devel@pve.proxmox.com
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


[pve-devel] [PATCH] Add qga freeze in vzdump in snapshot mode

2014-12-09 Thread Wolfgang Link
it will freeze the filesystem to provide consistents.

Signed-off-by: Wolfgang Link wolfg...@linksystems.org
---
 PVE/VZDump/QemuServer.pm |   18 --
 1 file changed, 16 insertions(+), 2 deletions(-)

diff --git a/PVE/VZDump/QemuServer.pm b/PVE/VZDump/QemuServer.pm
index fd36c69..b9edea1 100644
--- a/PVE/VZDump/QemuServer.pm
+++ b/PVE/VZDump/QemuServer.pm
@@ -286,8 +286,8 @@ sub archive {
 my $resume_on_backup;
 
 my $skiplock = 1;
-
-if (!PVE::QemuServer::check_running($vmid)) {
+my $vm_is_running = PVE::QemuServer::check_running($vmid);
+if (!$vm_is_running) {
eval {
$self-loginfo(starting kvm to execute backup task);
PVE::QemuServer::vm_start($self-{storecfg}, $vmid, undef, 
@@ -380,8 +380,22 @@ sub archive {
 
$qmpclient-queue_cmd($vmid, $add_fd_cb, 'getfd', 
  fd = $outfileno, fdname = backup);
+
+   if ($self-{vmlist}-{$vmid}-{agent}  $vm_is_running){
+   eval {PVE::QemuServer::vm_mon_cmd($vmid,guest-fsfreeze-freeze);};
+   if (my $err = $@) {
+   $self-logerr($err);
+   }  
+   }
+   
$qmpclient-queue_execute();
 
+   if ($self-{vmlist}-{$vmid}-{agent}  $vm_is_running ){
+   eval {PVE::QemuServer::vm_mon_cmd($vmid,guest-fsfreeze-thaw);};
+   if (my $err = $@) {
+   $self-logerr($err);
+   }
+   }
die $qmpclient-{errors}-{$vmid} if $qmpclient-{errors}-{$vmid};
 
if ($cpid) {
-- 
1.7.10.4

___
pve-devel mailing list
pve-devel@pve.proxmox.com
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


[pve-devel] Qemu nic link status

2014-12-09 Thread Wolfgang
Hallo,

is there a way to get the Nic Link status from Qemu?

Thanks for replying.

Regrades
Wolfgang
___
pve-devel mailing list
pve-devel@pve.proxmox.com
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] backup ceph high iops and slow

2014-12-09 Thread VELARTIS Philipp Dürhammer
HI,

we talked about this some month ago..
does anybody know if it will be improved soon?

So mainly ist a ceph problem. Or also should we communicate with the qemu devs?
making bigger backups now takes way to much time. Making a backup from a node 
wich has about 5tb will take  about 36 hours :-(



-Ursprüngliche Nachricht-
Von: pve-devel [mailto:pve-devel-boun...@pve.proxmox.com] Im Auftrag von Dmitry 
Petuhov
Gesendet: Freitag, 17. Oktober 2014 08:04
An: pve-devel@pve.proxmox.com
Betreff: Re: [pve-devel] backup ceph high iops and slow

16.10.2014 22:33, VELARTIS Philipp Dürhammer пишет:
 Why do backups with ceph make so high iops?
 I get around 600 iops for 40mb/sec which is by the way very slow for a backup.
 When I make a disk clone from local to ceph I get 120mb/sec (which is the 
 network limit from the old proxmox nodes) and only around 100-120 iops which 
 is the normal for a seq read with 120mb/sec...
 Is the vzdump making problems?
It's not vzdump's issue, but qemu's. See 
http://forum.proxmox.com/threads/19341-Ceph-backup

--
С уважением,
   Дмитрий Петухов
   Ведущий системный администратор
   Отдел информационных технологий
   ЗАО Электро-ком
   phone: +79209755610
   email: d.petu...@electro-com.ru

___
pve-devel mailing list
pve-devel@pve.proxmox.com
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
___
pve-devel mailing list
pve-devel@pve.proxmox.com
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] Qemu nic link status

2014-12-09 Thread Alexandre DERUMIER
Hi,

is there a way to get the Nic Link status from Qemu?

I have check the qemu code (net/net.c), I don't think it's implemented.

we can only have info through hmp info network, qmp not implemented.

and we can only set the status with qmp set_link



- Mail original -
De: Wolfgang Link wolfg...@linksystems.org
À: pve-devel pve-devel@pve.proxmox.com
Envoyé: Mardi 9 Décembre 2014 11:36:09
Objet: [pve-devel] Qemu nic link status

Hallo, 

is there a way to get the Nic Link status from Qemu? 

Thanks for replying. 

Regrades 
Wolfgang 

___ 
pve-devel mailing list 
pve-devel@pve.proxmox.com 
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel 

___
pve-devel mailing list
pve-devel@pve.proxmox.com
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] Qemu nic link status

2014-12-09 Thread Wolfgang
Hi Alexandre,

thanks for your answer.
When i use hmp info network i get only informations about the network
settings.
nothing about the status.

qm info network
net0: index=0,type=nic,model=virtio-net-pci,macaddr=e2:cf:7e:db:6f:e0
net0:
index=0,type=tap,ifname=tap100i0,script=/var/lib/qemu-server/pve-bridge,downscript=
/var/lib/qemu-server/pve-bridgedown

Is there something I have been missed?

Regrades
Wolfgang

2014-12-09 12:38 GMT+01:00 Alexandre DERUMIER aderum...@odiso.com:

 Hi,

 is there a way to get the Nic Link status from Qemu?

 I have check the qemu code (net/net.c), I don't think it's implemented.

 we can only have info through hmp info network, qmp not implemented.

 and we can only set the status with qmp set_link



 - Mail original -
 De: Wolfgang Link wolfg...@linksystems.org
 À: pve-devel pve-devel@pve.proxmox.com
 Envoyé: Mardi 9 Décembre 2014 11:36:09
 Objet: [pve-devel] Qemu nic link status

 Hallo,

 is there a way to get the Nic Link status from Qemu?

 Thanks for replying.

 Regrades
 Wolfgang

 ___
 pve-devel mailing list
 pve-devel@pve.proxmox.com
 http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


___
pve-devel mailing list
pve-devel@pve.proxmox.com
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] New virtio-win driver 0.1-94.iso version in fedora proyect

2014-12-09 Thread Cesar Peschiera
are you sure that virtio-net driver is correctly upgraded to last version 
?

Yes,  i saw the creation date on the window of the configuration NIC.
Tested in Dell poweredge 9500 and Dell R720 (each one with with 2 sockets)

And if you want more speed of network, please see this link about of I/OAT 
DMA Engine, and if you can, also answer my questions.

http://forum.proxmox.com/threads/20523-Quorum-problems-with-PVE-2-3-and-3-3?p=104678#post104678

- Original Message - 
From: Alexandre DERUMIER aderum...@odiso.com

To: Cesar Peschiera br...@click.com.py
Cc: pve-devel@pve.proxmox.com
Sent: Saturday, December 06, 2014 2:36 AM
Subject: Re: [pve-devel] New virtio-win driver 0.1-94.iso version in fedora 
proyect



mine was a dell r620, 2x intel 8 cores, so almost same than you.

but win2012r2.

I'll do tests with win2008r2 next week.


(are you sure that virtio-net driver is correctly upgraded to last version 
?)




- Mail original - 


De: Cesar Peschiera br...@click.com.py
À: Alexandre DERUMIER aderum...@odiso.com, pve-devel@pve.proxmox.com
Envoyé: Samedi 6 Décembre 2014 04:22:34
Objet: Re: [pve-devel] New virtio-win driver 0.1-94.iso version in fedora 
proyect


I have tested with:
Server: Dell r720 (New)
PVE latest version with kernel 3.10 version
RAM total in Hardware: 256 GB.
RAM for the Win2008R2 SP1 VM: 248 GB.
Processors: 2 sockets of 10 cores each one (20 threads with Hyperthreading)

Maybe numa (in Bios hardware DELL R720 configured) have something that see
in this topic the bsod (that appears sometimes)


- Original Message - 
From: Alexandre DERUMIER aderum...@odiso.com

To: Cesar Peschiera br...@click.com.py
Cc: pve-devel@pve.proxmox.com
Sent: Friday, December 05, 2014 8:30 AM
Subject: Re: [pve-devel] New virtio-win driver 0.1-94.iso version in fedora
proyect


I have tested with win2012R2,

I don't have BSOD, but network don't work when multiqueue is enabled.

I'll try to dig a little more.


- Mail original - 


De: Alexandre DERUMIER aderum...@odiso.com
À: Cesar Peschiera br...@click.com.py
Cc: pve-devel@pve.proxmox.com
Envoyé: Vendredi 5 Décembre 2014 08:18:25
Objet: Re: [pve-devel] New virtio-win driver 0.1-94.iso version in fedora
proyect


I have tested this:

Win2008R2 SP1 VM +
net0: ..,queues=numberofqueue
- 
= bsod


With 8 and 4 numbers of queues, it isn't stable.


Thanks for the report, I'll try today with win2008R2 and win2012r2



- Mail original - 


De: Cesar Peschiera br...@click.com.py
À: Cesar Peschiera br...@click.com.py, Alexandre DERUMIER
aderum...@odiso.com, pve-devel@pve.proxmox.com
Envoyé: Vendredi 5 Décembre 2014 08:10:24
Objet: Re: [pve-devel] New virtio-win driver 0.1-94.iso version in fedora
proyect

Hi

I have tested this:

Win2008R2 SP1 VM +
net0: ..,queues=numberofqueue
- 
= bsod


With 8 and 4 numbers of queues, it isn't stable.

- Original Message - 
From: Alexandre DERUMIER aderum...@odiso.com

To: Cesar Peschiera br...@click.com.py
Cc: pve-devel@pve.proxmox.com
Sent: Tuesday, December 02, 2014 10:25 AM
Subject: Re: [pve-devel] New virtio-win driver 0.1-94.iso version in
fedora proyect



Will work network multiqueue support?,
Does QEMU support for network multiqueue?

yes, and proxmox already support it. (not in gui)

just edit your vm config file:

net0: ..,queues=numberofqueue

(and use new drivers, if not I think you'll have a bsod)

it should improve rx or tx, I don't remember exactly.




- Mail original - 


De: Cesar Peschiera br...@click.com.py
À: Alexandre DERUMIER aderum...@odiso.com, pve-devel@pve.proxmox.com
Envoyé: Mardi 2 Décembre 2014 14:21:20
Objet: Re: [pve-devel] New virtio-win driver 0.1-94.iso version in fedora
proyect

Hi Alexandre

Will work network multiqueue support?,
Does QEMU support for network multiqueue?

- Original Message - 
From: Alexandre DERUMIER aderum...@odiso.com

To: Cesar Peschiera br...@click.com.py
Cc: pve-devel@pve.proxmox.com
Sent: Tuesday, December 02, 2014 2:57 AM
Subject: Re: [pve-devel] New virtio-win driver 0.1-94.iso version in
fedora
proyect


Oh Great !

I known that the net driver has been greatly improved with multiqueue
support.

and also some critical bugfix in virtio-blk flush (fua) support.

I'll test it this week :)

- Mail original - 


De: Cesar Peschiera br...@click.com.py
À: pve-devel@pve.proxmox.com
Envoyé: Mardi 2 Décembre 2014 03:49:11
Objet: [pve-devel] New virtio-win driver 0.1-94.iso version in fedora
proyect

Yesterday fedora proyect has a new version of Virtio Win drivers, it is
the
0.1-94 version, that can be downloaded of here:
http://alt.fedoraproject.org/pub/alt/virtio-win/latest/images/bin/virtio-win-0.1-94.iso

Best regards
Cesar

___
pve-devel mailing list
pve-devel@pve.proxmox.com
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel



Re: [pve-devel] [PATCH] Add qga freeze in vzdump in snapshot mode

2014-12-09 Thread Dietmar Maurer
applied, thanks!

 
 it will freeze the filesystem to provide consistents.
 
 Signed-off-by: Wolfgang Link wolfg...@linksystems.org
 ---
  PVE/VZDump/QemuServer.pm |   18 --
  1 file changed, 16 insertions(+), 2 deletions(-)

___
pve-devel mailing list
pve-devel@pve.proxmox.com
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] Qemu nic link status

2014-12-09 Thread Alexandre DERUMIER
Is there something I have been missed?

No, links status is not implemented.

Maybe can we make a qemu patch for this ?

(They are some example in net.c , qmp_set_link (), to get the current status 
link.)

Why do you need it exactly ?



- Mail original -
De: Wolfgang Link wolfg...@linksystems.org
À: aderumier aderum...@odiso.com
Cc: pve-devel pve-devel@pve.proxmox.com
Envoyé: Mardi 9 Décembre 2014 15:32:40
Objet: Re: [pve-devel] Qemu nic link status

Hi Alexandre, 

thanks for your answer. 
When i use hmp info network i get only informations about the network 
settings. 
nothing about the status. 

qm info network 
net0: index=0,type=nic,model=virtio-net-pci,macaddr=e2:cf:7e:db:6f:e0 
net0: 
index=0,type=tap,ifname=tap100i0,script=/var/lib/qemu-server/pve-bridge,downscript=
 /var/lib/qemu-server/pve-bridgedown 

Is there something I have been missed? 

Regrades 
Wolfgang 

2014-12-09 12:38 GMT+01:00 Alexandre DERUMIER  aderum...@odiso.com  : 


Hi, 

is there a way to get the Nic Link status from Qemu? 

I have check the qemu code (net/net.c), I don't think it's implemented. 

we can only have info through hmp info network, qmp not implemented. 

and we can only set the status with qmp set_link 



- Mail original - 
De: Wolfgang Link  wolfg...@linksystems.org  
À: pve-devel  pve-devel@pve.proxmox.com  
Envoyé: Mardi 9 Décembre 2014 11:36:09 
Objet: [pve-devel] Qemu nic link status 

Hallo, 

is there a way to get the Nic Link status from Qemu? 

Thanks for replying. 

Regrades 
Wolfgang 

___ 
pve-devel mailing list 
pve-devel@pve.proxmox.com 
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel 




___
pve-devel mailing list
pve-devel@pve.proxmox.com
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] [PATCH] Add qga freeze in vzdump in snapshot mode

2014-12-09 Thread Lindsay Mathieson
This will invoke vss on Windows clients?

Lindsay Mathieson 

-Original Message-
From: Wolfgang Link wolfg...@linksystems.org
Sent: ‎9/‎12/‎2014 8:13 PM
To: pve-devel@pve.proxmox.com pve-devel@pve.proxmox.com
Subject: [pve-devel] [PATCH] Add qga freeze in vzdump in snapshot mode

it will freeze the filesystem to provide consistents.

Signed-off-by: Wolfgang Link wolfg...@linksystems.org
---
 PVE/VZDump/QemuServer.pm |   18 --
 1 file changed, 16 insertions(+), 2 deletions(-)

diff --git a/PVE/VZDump/QemuServer.pm b/PVE/VZDump/QemuServer.pm
index fd36c69..b9edea1 100644
--- a/PVE/VZDump/QemuServer.pm
+++ b/PVE/VZDump/QemuServer.pm
@@ -286,8 +286,8 @@ sub archive {
 my $resume_on_backup;
 
 my $skiplock = 1;
-
-if (!PVE::QemuServer::check_running($vmid)) {
+my $vm_is_running = PVE::QemuServer::check_running($vmid);
+if (!$vm_is_running) {
eval {
$self-loginfo(starting kvm to execute backup task);
PVE::QemuServer::vm_start($self-{storecfg}, $vmid, undef, 
@@ -380,8 +380,22 @@ sub archive {
 
$qmpclient-queue_cmd($vmid, $add_fd_cb, 'getfd', 
  fd = $outfileno, fdname = backup);
+
+   if ($self-{vmlist}-{$vmid}-{agent}  $vm_is_running){
+   eval {PVE::QemuServer::vm_mon_cmd($vmid,guest-fsfreeze-freeze);};
+   if (my $err = $@) {
+   $self-logerr($err);
+   }  
+   }
+   
$qmpclient-queue_execute();
 
+   if ($self-{vmlist}-{$vmid}-{agent}  $vm_is_running ){
+   eval {PVE::QemuServer::vm_mon_cmd($vmid,guest-fsfreeze-thaw);};
+   if (my $err = $@) {
+   $self-logerr($err);
+   }
+   }
die $qmpclient-{errors}-{$vmid} if $qmpclient-{errors}-{$vmid};
 
if ($cpid) {
-- 
1.7.10.4

___
pve-devel mailing list
pve-devel@pve.proxmox.com
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
___
pve-devel mailing list
pve-devel@pve.proxmox.com
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


Re: [pve-devel] [PATCH] Add qga freeze in vzdump in snapshot mode

2014-12-09 Thread Dietmar Maurer
 This will invoke vss on Windows clients?

yes.
___
pve-devel mailing list
pve-devel@pve.proxmox.com
http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel