Re: [Users] cant remove disks from iscsi domain
- Original Message - | From: Yuriy Demchenko demchenko...@gmail.com | To: Greg Padgett gpadg...@redhat.com | Cc: users@ovirt.org | Sent: Thursday, August 22, 2013 9:55:19 AM | Subject: Re: [Users] cant remove disks from iscsi domain | | I've done some more tests - and it seems quota error is not related to | my issue: I tried to remove another disk and this time there were no | quota errors in engine.log | New logs in attach. | | What catches my eye in logs is this errors, but maybe that's not the | root of case: | Thread-60725::DEBUG::2013-08-22 | 10:37:45,549::lvm::485::OperationMutex::(_invali datevgs) Operation | 'lvm invalidate operation' released the operation mutex | Thread-60725::WARNING::2013-08-22 | 10:37:45,549::blockSD::931::Storage.StorageDom ain::(rmDCVolLinks) | Can't unlink /rhev/data-center/mnt/blockSD/d786e2d5-05ab-4da | 6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da7937fbdfad/dfefc573-de85-40 | 85-8900-da271affe831. [Errno 2] No such file or directory: | '/rhev/data-center/mn | t/blockSD/d786e2d5-05ab-4da6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da | 7937fbdfad/dfefc573-de85-4085-8900-da271affe831' | Thread-60725::WARNING::2013-08-22 | 10:37:45,549::blockSD::931::Storage.StorageDom ain::(rmDCVolLinks) | Can't unlink /rhev/data-center/mnt/blockSD/d786e2d5-05ab-4da | 6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da7937fbdfad/c6cd6d1d-b70f-43 | 5d-bdc7-713b445a2326. [Errno 2] No such file or directory: | '/rhev/data-center/mn | t/blockSD/d786e2d5-05ab-4da6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da | 7937fbdfad/c6cd6d1d-b70f-435d-bdc7-713b445a2326' | Thread-60725::DEBUG::2013-08-22 | 10:37:45,549::blockSD::934::Storage.StorageDomai n::(rmDCVolLinks) | removed: [] | Thread-60725::ERROR::2013-08-22 | 10:37:45,549::task::833::TaskManager.Task::(_set Error) | Task=`83867bdc-48cd-4ba0-b453-6f8abbace13e`::Unexpected error | Traceback (most recent call last): |File /usr/share/vdsm/storage/task.py, line 840, in _run | return fn(*args, **kargs) |File /usr/share/vdsm/logUtils.py, line 42, in wrapper | res = f(*args, **kwargs) |File /usr/share/vdsm/storage/hsm.py, line 1460, in deleteImage | dom.deleteImage(sdUUID, imgUUID, volsByImg) |File /usr/share/vdsm/storage/blockSD.py, line 957, in deleteImage | self.rmDCImgDir(imgUUID, volsImgs) |File /usr/share/vdsm/storage/blockSD.py, line 943, in rmDCImgDir | self.log.warning(Can't rmdir %s. %s, imgPath, exc_info=True) |File /usr/lib64/python2.6/logging/__init__.py, line 1068, in warning | self._log(WARNING, msg, args, **kwargs) |File /usr/lib64/python2.6/logging/__init__.py, line 1173, in _log | self.handle(record) |File /usr/lib64/python2.6/logging/__init__.py, line 1183, in handle | self.callHandlers(record) |File /usr/lib64/python2.6/logging/__init__.py, line 1220, in | callHandlers | hdlr.handle(record) |File /usr/lib64/python2.6/logging/__init__.py, line 679, in handle | self.emit(record) |File /usr/lib64/python2.6/logging/handlers.py, line 780, in emit | msg = self.format(record) |File /usr/lib64/python2.6/logging/__init__.py, line 654, in format | return fmt.format(record) |File /usr/lib64/python2.6/logging/__init__.py, line 436, in format | record.message = record.getMessage() |File /usr/lib64/python2.6/logging/__init__.py, line 306, in getMessage | msg = msg % self.args | TypeError: not enough arguments for format string | | | Yuriy Demchenko Yuri, just to clarify the quota part, the stack trace you provided was resolved as the bz Greg described- https://bugzilla.redhat.com/show_bug.cgi?id=905891 This is unrelated to the storage issue, as the quota caching is an independent procedure running in parallel. So what we now need to focus on is this part: [Errno 2] No such file or directory: '/rhev/data-center/mnt/blockSD/d786e2d5-05ab-4da6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da7937fbdfad/dfefc573-de85-4085-8900-da271affe831' What we need to understand is how did we get into this state; Did you have network issues or relevant crashes? ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] Linux sysprep
On Wed, 2013-08-21 at 19:49 -0400, Greg Padgett wrote: On 08/21/2013 07:25 AM, René Koch (ovido) wrote: [snip] I'm just playing around with the payload feature but I can't access the cd/floppy in my vm. I adapted Yuriy's script (http://lists.ovirt.org/pipermail/users/2013-June/014907.html - which is working fine btw) to create payload xml content and write it with hooking.write_domxml(domxml). In vdsm.log I can see that my python script exits with status code 0 and that the content seems to be added to the vm definition: Thread-130844::DEBUG::2013-08-21 12:43:52,669::libvirtvm::1520::vm.Vm::(_run) vmId=`79dc3123-4584-4dd9-b0f0-c28ede13d672`::?xml version=1.0 encoding=utf-8?domain type=kvm namecentos6/name snip /cpu payloadspayload type=cdromfile name=unattended.txtcontenthostname: centos6/content/file/payload/payloads/domain But in my vm I can't mount the cd drive: # mount /dev/sr0 /media mount: you must specify the filesystem type Is there a special filesystem I have to specify? Furthermore shouldn't I be able to see the payloads content added to this vm via REST-API? Because I can't. Maybe I'm doing some wrong? Thanks, René That's a neat script. I haven't used it--instead I just send xml to the rest api, something like this, which looks a lot like yours: vm id=6aec2d40-e36f-4b02-ab75-933d93f4cb8b href=/api/vms/6aec2d40-e36f-4b02-ab75-933d93f4cb8b payloads payload type=cdrom file name=meta-data.txtcontentsome content/content /file /payload /payloads /vm To attach the payload via the rest api, note that you'd need to send a put request to /api/vms/uuid rather than pass the xml in the run/start action, because that's not yet supported. Doing this, inside my vm I see: [root@cloud-init-test ~]# blkid /dev/sr1: UUID=2013-08-21-19-39-40-00 LABEL=CDROM TYPE=iso9660 I see - so only via REST-API really means only with REST-API ;) I'll add the payload via put request - thanks a lot! And I can mount it without any problems. You can also check the qemu process listing on the host--for instance, mine shows: /usr/bin/qemu-system-x86_64 [...] -drive file=/var/run/vdsm/payload/29e331f9-42df-46e1-aad1-88101b134606.fe53caf3339d55b2b37a893e19e9f10a.img While the vm is running, you can check that file with `file` (should report ISO 9660), mount it on the host, etc. HTH, Greg ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] cant remove disks from iscsi domain
you said that the disks are deleted although an exception is given but the engine is reporting the delete as failed. I think that I remember a bug reported and fixed on that as well but I can't seem to find it. Adding Ayal and Eduardo On 08/22/2013 07:55 AM, Yuriy Demchenko wrote: I've done some more tests - and it seems quota error is not related to my issue: I tried to remove another disk and this time there were no quota errors in engine.log New logs in attach. What catches my eye in logs is this errors, but maybe that's not the root of case: Thread-60725::DEBUG::2013-08-22 10:37:45,549::lvm::485::OperationMutex::(_invali datevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-60725::WARNING::2013-08-22 10:37:45,549::blockSD::931::Storage.StorageDom ain::(rmDCVolLinks) Can't unlink /rhev/data-center/mnt/blockSD/d786e2d5-05ab-4da 6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da7937fbdfad/dfefc573-de85-40 85-8900-da271affe831. [Errno 2] No such file or directory: '/rhev/data-center/mn t/blockSD/d786e2d5-05ab-4da6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da 7937fbdfad/dfefc573-de85-4085-8900-da271affe831' Thread-60725::WARNING::2013-08-22 10:37:45,549::blockSD::931::Storage.StorageDom ain::(rmDCVolLinks) Can't unlink /rhev/data-center/mnt/blockSD/d786e2d5-05ab-4da 6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da7937fbdfad/c6cd6d1d-b70f-43 5d-bdc7-713b445a2326. [Errno 2] No such file or directory: '/rhev/data-center/mn t/blockSD/d786e2d5-05ab-4da6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da 7937fbdfad/c6cd6d1d-b70f-435d-bdc7-713b445a2326' Thread-60725::DEBUG::2013-08-22 10:37:45,549::blockSD::934::Storage.StorageDomai n::(rmDCVolLinks) removed: [] Thread-60725::ERROR::2013-08-22 10:37:45,549::task::833::TaskManager.Task::(_set Error) Task=`83867bdc-48cd-4ba0-b453-6f8abbace13e`::Unexpected error Traceback (most recent call last): File /usr/share/vdsm/storage/task.py, line 840, in _run return fn(*args, **kargs) File /usr/share/vdsm/logUtils.py, line 42, in wrapper res = f(*args, **kwargs) File /usr/share/vdsm/storage/hsm.py, line 1460, in deleteImage dom.deleteImage(sdUUID, imgUUID, volsByImg) File /usr/share/vdsm/storage/blockSD.py, line 957, in deleteImage self.rmDCImgDir(imgUUID, volsImgs) File /usr/share/vdsm/storage/blockSD.py, line 943, in rmDCImgDir self.log.warning(Can't rmdir %s. %s, imgPath, exc_info=True) File /usr/lib64/python2.6/logging/__init__.py, line 1068, in warning self._log(WARNING, msg, args, **kwargs) File /usr/lib64/python2.6/logging/__init__.py, line 1173, in _log self.handle(record) File /usr/lib64/python2.6/logging/__init__.py, line 1183, in handle self.callHandlers(record) File /usr/lib64/python2.6/logging/__init__.py, line 1220, in callHandlers hdlr.handle(record) File /usr/lib64/python2.6/logging/__init__.py, line 679, in handle self.emit(record) File /usr/lib64/python2.6/logging/handlers.py, line 780, in emit msg = self.format(record) File /usr/lib64/python2.6/logging/__init__.py, line 654, in format return fmt.format(record) File /usr/lib64/python2.6/logging/__init__.py, line 436, in format record.message = record.getMessage() File /usr/lib64/python2.6/logging/__init__.py, line 306, in getMessage msg = msg % self.args TypeError: not enough arguments for format string Yuriy Demchenko On 08/22/2013 04:11 AM, Greg Padgett wrote: On 08/21/2013 04:10 PM, Dafna Ron wrote: there is a is an exception in the log related to a quota calculation 2013-08-21 17:52:32,694 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQu artzImpl] (DefaultQuartzScheduler_Worker-7) failed to invoke sceduled method upd ateQuotaCache: java.lang.reflect.InvocationTargetException at sun.reflect.GeneratedMethodAccessor175.invoke(Unknown Source) [:1.7.0 _25] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces sorImpl.java:43) [rt.jar:1.7.0_25] at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_25] at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java: 60) [scheduler.jar:] at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.j ava:557) [quartz.jar:] Caused by: org.springframework.jdbc.BadSqlGrammarException: PreparedStatementCal lback; bad SQL grammar [select * from calculateallstorageusage()]; nested excep tion is org.postgresql.util.PSQLException: ERROR: column quota_limitation.quota _id must appear in the GROUP BY clause or be used in an aggregate function Where: PL/pgSQL function calculateallstorageusage line 3 at RETURN QUERY in any case this is a bug. I'm adding Doron to this mail, perhaps this was reported in the past and already solved in later versions. if not it should be reported and fixed. Dafna If I'm
Re: [Users] oVirt and Infiniband
On 08/21/2013 03:32 AM, René Koch (ovido) wrote: On Tue, 2013-08-20 at 00:24 +0200, René Koch wrote: -Original message- From:Dan Kenigsberg dan...@redhat.com Sent: Monday 19th August 2013 23:48 To: René Koch r.k...@ovido.at; Itzik Brown itz...@mellanox.com Cc: ovirt-users users@ovirt.org Subject: Re: [Users] oVirt and Infiniband On Tue, Aug 13, 2013 at 03:48:14PM +0200, René Koch (ovido) wrote: Hi, Does anyone have oVirt (or a plain KVM hypervisor) running on Infiniband where the virtual machines are bridged to an Infiniband interface (with EoIB kernel module)? As far as I recall the EoIB module is not yet in upstream kernel. Could you give more details on your setup (distro, kernel, module)? Do you get connectivity between the hosts? Maybe Itzik and his colleagues could help us here. Thanks for your answer. That's right - EoIB isn't in the kernel. I installed module from Mellanox OFED package and even there it's marked as unstable... OS is CentOS 6.4. At the moment I've also an open support case with Mellanox trying to solve the connectivity issue. So I have support from official site, but was thinking maybe someone has already experience with such a setup and also had some issues/tipps for me... My problem is some sort of a bridge or maybe MAC translation issue (unsure cause of a lot of unanswered ARP requests in tcpdump and bridge is working on Ethernet interfaces). I have bridge ovirtmgmt on eth2 interface (eth2 is a (virtual) ethernet interface bound to the Infiniband-interface) with an IP address configured on it. Hosts can reach each other, so ethernet to infiniband translation seems to work. But when I create a vm in oVirt this vm can only communicate with IPs/vms on the bridge. This mean I can ping the IP of the host and other vms on this bridge, but no host behind the bridge (like e.g. other hosts or vms on other hosts)... Mellanox support team found the issue: Daemon openibd requires write access to libvirt which is restricted by oVirt per default. When changing auth_unix_rw to none networking of the vms is working fine over the inifinband network. So my question is now: I think there's a good reason why write access to libvirt is restricted. In my particular setup no one will do a virsh start/stop/whatever so from a user point I can live with an open libvirt. But are there any troubles I can run into from oVirt side with auth_unix_rw=none beside users doing evil virsh stuff? Today I tested it and ran into a first issue which I didn't investigate so far (will do this week): - Started vm from oVirt on node - Changed auth_unix_rw to none - Restarted libvirt on node - VM was running according to virsh list - VM was stopped in oVirt - Started vm in oVirt on another node - vm was running twice Will have a look at the logs what append exactly this vm... isn't the right thing is to configure openibd to use same credentials vdsm is using (or with their own credentials)? Regards, René I'm having issues in such a setup where vms can't communicate over this bridge... Regards, René ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] How to define max number of running VMs on a host?
On 08/21/2013 01:19 AM, lof yer wrote: I didn't see anything like this in engine-config. Is it possible to do that without using host-hooks? ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users can you explain the use case a bit? ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] How to define max number of running VMs on a host?
On 2013/8/22 17:17, Itamar Heim wrote: On 08/21/2013 01:19 AM, lof yer wrote: I didn't see anything like this in engine-config. Is it possible to do that without using host-hooks? ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users can you explain the use case a bit? I have 4 graphic workstations with 3 graphic cards on each. I wanna passthrough graphic cards to the VMs one by one, since one workstation has only 3 cards, I must limit the number of running VM on a host to 3. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] oVirt and Infiniband
On Thu, 2013-08-22 at 05:16 -0400, Itamar Heim wrote: On 08/21/2013 03:32 AM, René Koch (ovido) wrote: On Tue, 2013-08-20 at 00:24 +0200, René Koch wrote: -Original message- From:Dan Kenigsberg dan...@redhat.com Sent: Monday 19th August 2013 23:48 To: René Koch r.k...@ovido.at; Itzik Brown itz...@mellanox.com Cc: ovirt-users users@ovirt.org Subject: Re: [Users] oVirt and Infiniband On Tue, Aug 13, 2013 at 03:48:14PM +0200, René Koch (ovido) wrote: Hi, Does anyone have oVirt (or a plain KVM hypervisor) running on Infiniband where the virtual machines are bridged to an Infiniband interface (with EoIB kernel module)? As far as I recall the EoIB module is not yet in upstream kernel. Could you give more details on your setup (distro, kernel, module)? Do you get connectivity between the hosts? Maybe Itzik and his colleagues could help us here. Thanks for your answer. That's right - EoIB isn't in the kernel. I installed module from Mellanox OFED package and even there it's marked as unstable... OS is CentOS 6.4. At the moment I've also an open support case with Mellanox trying to solve the connectivity issue. So I have support from official site, but was thinking maybe someone has already experience with such a setup and also had some issues/tipps for me... My problem is some sort of a bridge or maybe MAC translation issue (unsure cause of a lot of unanswered ARP requests in tcpdump and bridge is working on Ethernet interfaces). I have bridge ovirtmgmt on eth2 interface (eth2 is a (virtual) ethernet interface bound to the Infiniband-interface) with an IP address configured on it. Hosts can reach each other, so ethernet to infiniband translation seems to work. But when I create a vm in oVirt this vm can only communicate with IPs/vms on the bridge. This mean I can ping the IP of the host and other vms on this bridge, but no host behind the bridge (like e.g. other hosts or vms on other hosts)... Mellanox support team found the issue: Daemon openibd requires write access to libvirt which is restricted by oVirt per default. When changing auth_unix_rw to none networking of the vms is working fine over the inifinband network. So my question is now: I think there's a good reason why write access to libvirt is restricted. In my particular setup no one will do a virsh start/stop/whatever so from a user point I can live with an open libvirt. But are there any troubles I can run into from oVirt side with auth_unix_rw=none beside users doing evil virsh stuff? Today I tested it and ran into a first issue which I didn't investigate so far (will do this week): - Started vm from oVirt on node - Changed auth_unix_rw to none - Restarted libvirt on node - VM was running according to virsh list - VM was stopped in oVirt - Started vm in oVirt on another node - vm was running twice Will have a look at the logs what append exactly this vm... isn't the right thing is to configure openibd to use same credentials vdsm is using (or with their own credentials)? Absolutely agree that this would be the best solution, but unfortunately there's no config option for openibd to use credentials when connecting to libvirt :( Regards, René I'm having issues in such a setup where vms can't communicate over this bridge... Regards, René ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] cant remove disks from iscsi domain
Thanks a lot! Patch did the job, a few more disks were deleted successfully. One last question - how do i remove stale records of disks in illegal state? Yuriy Demchenko On 08/22/2013 01:25 PM, Eduardo Warszawski wrote: - Original Message - you said that the disks are deleted although an exception is given but the engine is reporting the delete as failed. I think that I remember a bug reported and fixed on that as well but I can't seem to find it. Adding Ayal and Eduardo The log issue already solved in v4.11.0~380. commit ad916c79e2b0959dea20dd19a21b99bc702d65ca Author: Eduardo Warszawski ewars...@redhat.com Date: Mon Dec 17 14:32:51 2012 +0200 Fix typo in negative flow log in blockSD.rmDCImgDir(). Related to BZ#885489. Change-Id: I951e582acc86e08d709da4249084015660fc4ea0 Signed-off-by: Eduardo ewars...@redhat.com Reviewed-on: http://gerrit.ovirt.org/10153 Reviewed-by: Yeela Kaplan ykap...@redhat.com Reviewed-by: Ayal Baron aba...@redhat.com Tested-by: Dan Kenigsberg dan...@redhat.com diff --git a/vdsm/storage/blockSD.py b/vdsm/storage/blockSD.py index b5447cd..22a434b 100644 --- a/vdsm/storage/blockSD.py +++ b/vdsm/storage/blockSD.py @@ -978,7 +978,7 @@ class BlockStorageDomain(sd.StorageDomain): try: os.rmdir(imgPath) except OSError: -self.log.warning(Can't rmdir %s. %s, imgPath, exc_info=True) +self.log.warning(Can't rmdir %s, imgPath, exc_info=True) else: self.log.debug(removed image dir: %s, imgPath) return imgPath On 08/22/2013 07:55 AM, Yuriy Demchenko wrote: I've done some more tests - and it seems quota error is not related to my issue: I tried to remove another disk and this time there were no quota errors in engine.log New logs in attach. What catches my eye in logs is this errors, but maybe that's not the root of case: Thread-60725::DEBUG::2013-08-22 10:37:45,549::lvm::485::OperationMutex::(_invali datevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-60725::WARNING::2013-08-22 10:37:45,549::blockSD::931::Storage.StorageDom ain::(rmDCVolLinks) Can't unlink /rhev/data-center/mnt/blockSD/d786e2d5-05ab-4da 6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da7937fbdfad/dfefc573-de85-40 85-8900-da271affe831. [Errno 2] No such file or directory: '/rhev/data-center/mn t/blockSD/d786e2d5-05ab-4da6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da 7937fbdfad/dfefc573-de85-4085-8900-da271affe831' Thread-60725::WARNING::2013-08-22 10:37:45,549::blockSD::931::Storage.StorageDom ain::(rmDCVolLinks) Can't unlink /rhev/data-center/mnt/blockSD/d786e2d5-05ab-4da 6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da7937fbdfad/c6cd6d1d-b70f-43 5d-bdc7-713b445a2326. [Errno 2] No such file or directory: '/rhev/data-center/mn t/blockSD/d786e2d5-05ab-4da6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da 7937fbdfad/c6cd6d1d-b70f-435d-bdc7-713b445a2326' Thread-60725::DEBUG::2013-08-22 10:37:45,549::blockSD::934::Storage.StorageDomai n::(rmDCVolLinks) removed: [] Thread-60725::ERROR::2013-08-22 10:37:45,549::task::833::TaskManager.Task::(_set Error) Task=`83867bdc-48cd-4ba0-b453-6f8abbace13e`::Unexpected error Traceback (most recent call last): File /usr/share/vdsm/storage/task.py, line 840, in _run return fn(*args, **kargs) File /usr/share/vdsm/logUtils.py, line 42, in wrapper res = f(*args, **kwargs) File /usr/share/vdsm/storage/hsm.py, line 1460, in deleteImage dom.deleteImage(sdUUID, imgUUID, volsByImg) File /usr/share/vdsm/storage/blockSD.py, line 957, in deleteImage self.rmDCImgDir(imgUUID, volsImgs) File /usr/share/vdsm/storage/blockSD.py, line 943, in rmDCImgDir self.log.warning(Can't rmdir %s. %s, imgPath, exc_info=True) File /usr/lib64/python2.6/logging/__init__.py, line 1068, in warning self._log(WARNING, msg, args, **kwargs) File /usr/lib64/python2.6/logging/__init__.py, line 1173, in _log self.handle(record) File /usr/lib64/python2.6/logging/__init__.py, line 1183, in handle self.callHandlers(record) File /usr/lib64/python2.6/logging/__init__.py, line 1220, in callHandlers hdlr.handle(record) File /usr/lib64/python2.6/logging/__init__.py, line 679, in handle self.emit(record) File /usr/lib64/python2.6/logging/handlers.py, line 780, in emit msg = self.format(record) File /usr/lib64/python2.6/logging/__init__.py, line 654, in format return fmt.format(record) File /usr/lib64/python2.6/logging/__init__.py, line 436, in format record.message = record.getMessage() File /usr/lib64/python2.6/logging/__init__.py, line 306, in getMessage msg = msg % self.args TypeError: not enough arguments for format string Yuriy Demchenko On 08/22/2013 04:11 AM, Greg Padgett wrote: On 08/21/2013 04:10 PM, Dafna Ron wrote: there is a is an exception in the log related to a quota calculation 2013-08-21
Re: [Users] received packet with own address as source address
I'd enable STP on all ports, including the port connecting your switch to the school switch. VSDSM configures the ovirtmgmt bridge on installation. The reason I'm suggesting that it's not VDSM at fault but rather the school network having a loop is that you mentioned that you get these messages even with no VMs running. - Original Message - From: H. Haven Liu haven@ucla.edu To: Assaf Muller amul...@redhat.com Cc: Users@ovirt.org Sent: Wednesday, August 21, 2013 11:26:57 PM Subject: Re: [Users] received packet with own address as source address The switch is connected to the internet via the school's switch. Currently (as well as when I received the error messages last time) portfast is disabled for all ports, and STP enabled for all ports except for the port connecting my switch to the school's. On Aug 20, 2013, at 11:50 PM, Assaf Muller amul...@redhat.com wrote: The problem was also present when I just had one interface connected to the switch, connected to the Internet. How was the switch connected to the internet? Is it connected to other switches? To solve the loop you can make sure that STP is enabled on all switches and to disable portfast. - Original Message - From: H. Haven Liu haven@ucla.edu To: Assaf Muller amul...@redhat.com Cc: Users@ovirt.org Sent: Tuesday, August 20, 2013 6:09:09 PM Subject: Re: [Users] received packet with own address as source address Hello, After I reinstalled the host, the problem seems to have disappeared. This is not to say it's not going to come back, as it has done before. I know the nodes were not receiving the error message *before* I installed VDSM (which configured the bridge?), but I haven't tried uninstalling to see if the problem would go away. The problem was also present when I just had one interface connected to the switch, connected to the Internet. If the problem is indeed a classic L2 loop, how do I go about resolving it? Is it due to bridge (mis)configuration, or is it in the network switch settings? I have tried enabling and disabling STP and portfast, which didn't seem to have any effect. Thanks, Haven On Aug 20, 2013, at 12:26 AM, Assaf Muller amul...@redhat.com wrote: Hello Mr. Liu, Sounds like a classic L2 loop. Hosts getting their own packets then losing connectivity for a few minutes while the switches restart. Can you try to rule out this possibility? For example: If you uninstall the engine and VDSM from all hosts does this still happen? Can you simplify the network topology and see if the issue persists? - Original Message - From: H. Haven Liu haven@ucla.edu To: Users@ovirt.org Sent: Saturday, August 17, 2013 10:06:07 PM Subject: [Users] received packet with own address as source address Hello, I have a oVirt installation with 6 CentOS 6.4 hosts. Some (not all) hosts are receiving these error messages, at a frequency of once every other minute: [root@vhost1 ~]# grep source address /var/log/messages | tail Aug 17 11:19:20 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:21:24 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:23:29 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:25:34 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:27:39 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:29:44 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:31:49 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:33:54 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:35:59 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:38:04 vhost1 kernel: em1: received packet with own address as source address These error messages are accompanied with loss of connectivity, with duration varies between a few seconds to minutes. The loss of connectivity would start just before the above error message. I don't *think* it's hardware because the received packet with own address error message would disappear from one of the hosts after a while. These error messages are also present whether or not any VM is running on the particular host. Here are some configurations: [root@vhost1 ~]# ifconfig em1 Link encap:Ethernet HWaddr aa:bb:cc:dd:ee:f1 inet6 addr: :::::eee1/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:37413202 errors:0 dropped:0 overruns:0 frame:0 TX packets:17822315 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:32444347931 (30.2 GiB) TX bytes:13715272213 (12.7 GiB) Interrupt:16 em2 Link encap:Ethernet HWaddr aa:bb:cc:dd:ee:f2 inet6
Re: [Users] cant remove disks from iscsi domain
deleting illegal objects from UI was added to the latest ovirt/vdsm are you getting any errors when trying to delete them now? On 08/22/2013 10:46 AM, Yuriy Demchenko wrote: Thanks a lot! Patch did the job, a few more disks were deleted successfully. One last question - how do i remove stale records of disks in illegal state? Yuriy Demchenko On 08/22/2013 01:25 PM, Eduardo Warszawski wrote: - Original Message - you said that the disks are deleted although an exception is given but the engine is reporting the delete as failed. I think that I remember a bug reported and fixed on that as well but I can't seem to find it. Adding Ayal and Eduardo The log issue already solved in v4.11.0~380. commit ad916c79e2b0959dea20dd19a21b99bc702d65ca Author: Eduardo Warszawski ewars...@redhat.com Date: Mon Dec 17 14:32:51 2012 +0200 Fix typo in negative flow log in blockSD.rmDCImgDir(). Related to BZ#885489. Change-Id: I951e582acc86e08d709da4249084015660fc4ea0 Signed-off-by: Eduardo ewars...@redhat.com Reviewed-on: http://gerrit.ovirt.org/10153 Reviewed-by: Yeela Kaplan ykap...@redhat.com Reviewed-by: Ayal Baron aba...@redhat.com Tested-by: Dan Kenigsberg dan...@redhat.com diff --git a/vdsm/storage/blockSD.py b/vdsm/storage/blockSD.py index b5447cd..22a434b 100644 --- a/vdsm/storage/blockSD.py +++ b/vdsm/storage/blockSD.py @@ -978,7 +978,7 @@ class BlockStorageDomain(sd.StorageDomain): try: os.rmdir(imgPath) except OSError: -self.log.warning(Can't rmdir %s. %s, imgPath, exc_info=True) +self.log.warning(Can't rmdir %s, imgPath, exc_info=True) else: self.log.debug(removed image dir: %s, imgPath) return imgPath On 08/22/2013 07:55 AM, Yuriy Demchenko wrote: I've done some more tests - and it seems quota error is not related to my issue: I tried to remove another disk and this time there were no quota errors in engine.log New logs in attach. What catches my eye in logs is this errors, but maybe that's not the root of case: Thread-60725::DEBUG::2013-08-22 10:37:45,549::lvm::485::OperationMutex::(_invali datevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-60725::WARNING::2013-08-22 10:37:45,549::blockSD::931::Storage.StorageDom ain::(rmDCVolLinks) Can't unlink /rhev/data-center/mnt/blockSD/d786e2d5-05ab-4da 6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da7937fbdfad/dfefc573-de85-40 85-8900-da271affe831. [Errno 2] No such file or directory: '/rhev/data-center/mn t/blockSD/d786e2d5-05ab-4da6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da 7937fbdfad/dfefc573-de85-4085-8900-da271affe831' Thread-60725::WARNING::2013-08-22 10:37:45,549::blockSD::931::Storage.StorageDom ain::(rmDCVolLinks) Can't unlink /rhev/data-center/mnt/blockSD/d786e2d5-05ab-4da 6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da7937fbdfad/c6cd6d1d-b70f-43 5d-bdc7-713b445a2326. [Errno 2] No such file or directory: '/rhev/data-center/mn t/blockSD/d786e2d5-05ab-4da6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da 7937fbdfad/c6cd6d1d-b70f-435d-bdc7-713b445a2326' Thread-60725::DEBUG::2013-08-22 10:37:45,549::blockSD::934::Storage.StorageDomai n::(rmDCVolLinks) removed: [] Thread-60725::ERROR::2013-08-22 10:37:45,549::task::833::TaskManager.Task::(_set Error) Task=`83867bdc-48cd-4ba0-b453-6f8abbace13e`::Unexpected error Traceback (most recent call last): File /usr/share/vdsm/storage/task.py, line 840, in _run return fn(*args, **kargs) File /usr/share/vdsm/logUtils.py, line 42, in wrapper res = f(*args, **kwargs) File /usr/share/vdsm/storage/hsm.py, line 1460, in deleteImage dom.deleteImage(sdUUID, imgUUID, volsByImg) File /usr/share/vdsm/storage/blockSD.py, line 957, in deleteImage self.rmDCImgDir(imgUUID, volsImgs) File /usr/share/vdsm/storage/blockSD.py, line 943, in rmDCImgDir self.log.warning(Can't rmdir %s. %s, imgPath, exc_info=True) File /usr/lib64/python2.6/logging/__init__.py, line 1068, in warning self._log(WARNING, msg, args, **kwargs) File /usr/lib64/python2.6/logging/__init__.py, line 1173, in _log self.handle(record) File /usr/lib64/python2.6/logging/__init__.py, line 1183, in handle self.callHandlers(record) File /usr/lib64/python2.6/logging/__init__.py, line 1220, in callHandlers hdlr.handle(record) File /usr/lib64/python2.6/logging/__init__.py, line 679, in handle self.emit(record) File /usr/lib64/python2.6/logging/handlers.py, line 780, in emit msg = self.format(record) File /usr/lib64/python2.6/logging/__init__.py, line 654, in format return fmt.format(record) File /usr/lib64/python2.6/logging/__init__.py, line 436, in format record.message = record.getMessage() File /usr/lib64/python2.6/logging/__init__.py, line 306, in getMessage msg = msg % self.args TypeError: not enough arguments for
Re: [Users] How to define max number of running VMs on a host?
On 08/22/2013 05:24 AM, lofyer wrote: On 2013/8/22 17:17, Itamar Heim wrote: On 08/21/2013 01:19 AM, lof yer wrote: I didn't see anything like this in engine-config. Is it possible to do that without using host-hooks? ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users can you explain the use case a bit? I have 4 graphic workstations with 3 graphic cards on each. I wanna passthrough graphic cards to the VMs one by one, since one workstation has only 3 cards, I must limit the number of running VM on a host to 3. 1. I assume you use a hook for the graphic passthrough? you can just fail it if no more devices, and engine will try to schedule on next host. 2. (ab)use the reserved RAM. if you allocate to each VM reserved RAM so 3 VMs can fit a host but 4 can't, engine won't try to schedule more than 3 on the same host as it would violate the reserved rAM 3. not a hook, but a filter. in 3.3 you can write a new filter to the pluggable scheduler of MaxNumberOfVms and pass a property of 3 to it. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] cant remove disks from iscsi domain
there are actually a lot of tables that have a reference to the image in the db. I am adding Liron who might be able to give you the patch needed for deleting these images or tell you in what rpm they were merged to. On 08/22/2013 11:06 AM, Yuriy Demchenko wrote: If by latest you mean head/nightly - i'm not using it yet, I'm using packets from stable el6 repo, so my test env match production env. Errors i get: User admin@internal failed to initiate removing of disk virt-dhcp-3_Disk1 from domain iscsi-store Thread-1196::ERROR::2013-08-22 14:00:57,736::task::833::TaskManager.Task::(_setError) Task=`b691e001-7d8e-46cc-a04e-3d89ffea8fe5`::Unexpected error Traceback (most recent call last): File /usr/share/vdsm/storage/task.py, line 840, in _run return fn(*args, **kargs) File /usr/share/vdsm/logUtils.py, line 42, in wrapper res = f(*args, **kwargs) File /usr/share/vdsm/storage/hsm.py, line 1434, in deleteImage raise se.ImageDoesNotExistInSD(imgUUID, sdUUID) ImageDoesNotExistInSD: Image does not exist in domain: 'image=dde47a09-81d9-4592-87e4-92398ea834ce, domain=d786e2d5-05ab-4da6-95fc-1af791a3c113' Maybe just do some sql-query to remove them from DB? Yuriy Demchenko On 08/22/2013 01:55 PM, Dafna Ron wrote: deleting illegal objects from UI was added to the latest ovirt/vdsm are you getting any errors when trying to delete them now? On 08/22/2013 10:46 AM, Yuriy Demchenko wrote: Thanks a lot! Patch did the job, a few more disks were deleted successfully. One last question - how do i remove stale records of disks in illegal state? Yuriy Demchenko On 08/22/2013 01:25 PM, Eduardo Warszawski wrote: - Original Message - you said that the disks are deleted although an exception is given but the engine is reporting the delete as failed. I think that I remember a bug reported and fixed on that as well but I can't seem to find it. Adding Ayal and Eduardo The log issue already solved in v4.11.0~380. commit ad916c79e2b0959dea20dd19a21b99bc702d65ca Author: Eduardo Warszawski ewars...@redhat.com Date: Mon Dec 17 14:32:51 2012 +0200 Fix typo in negative flow log in blockSD.rmDCImgDir(). Related to BZ#885489. Change-Id: I951e582acc86e08d709da4249084015660fc4ea0 Signed-off-by: Eduardo ewars...@redhat.com Reviewed-on: http://gerrit.ovirt.org/10153 Reviewed-by: Yeela Kaplan ykap...@redhat.com Reviewed-by: Ayal Baron aba...@redhat.com Tested-by: Dan Kenigsberg dan...@redhat.com diff --git a/vdsm/storage/blockSD.py b/vdsm/storage/blockSD.py index b5447cd..22a434b 100644 --- a/vdsm/storage/blockSD.py +++ b/vdsm/storage/blockSD.py @@ -978,7 +978,7 @@ class BlockStorageDomain(sd.StorageDomain): try: os.rmdir(imgPath) except OSError: -self.log.warning(Can't rmdir %s. %s, imgPath, exc_info=True) +self.log.warning(Can't rmdir %s, imgPath, exc_info=True) else: self.log.debug(removed image dir: %s, imgPath) return imgPath On 08/22/2013 07:55 AM, Yuriy Demchenko wrote: I've done some more tests - and it seems quota error is not related to my issue: I tried to remove another disk and this time there were no quota errors in engine.log New logs in attach. What catches my eye in logs is this errors, but maybe that's not the root of case: Thread-60725::DEBUG::2013-08-22 10:37:45,549::lvm::485::OperationMutex::(_invali datevgs) Operation 'lvm invalidate operation' released the operation mutex Thread-60725::WARNING::2013-08-22 10:37:45,549::blockSD::931::Storage.StorageDom ain::(rmDCVolLinks) Can't unlink /rhev/data-center/mnt/blockSD/d786e2d5-05ab-4da 6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da7937fbdfad/dfefc573-de85-40 85-8900-da271affe831. [Errno 2] No such file or directory: '/rhev/data-center/mn t/blockSD/d786e2d5-05ab-4da6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da 7937fbdfad/dfefc573-de85-4085-8900-da271affe831' Thread-60725::WARNING::2013-08-22 10:37:45,549::blockSD::931::Storage.StorageDom ain::(rmDCVolLinks) Can't unlink /rhev/data-center/mnt/blockSD/d786e2d5-05ab-4da 6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da7937fbdfad/c6cd6d1d-b70f-43 5d-bdc7-713b445a2326. [Errno 2] No such file or directory: '/rhev/data-center/mn t/blockSD/d786e2d5-05ab-4da6-95fc-1af791a3c113/images/5344ca63-302a-43de-9193-da 7937fbdfad/c6cd6d1d-b70f-435d-bdc7-713b445a2326' Thread-60725::DEBUG::2013-08-22 10:37:45,549::blockSD::934::Storage.StorageDomai n::(rmDCVolLinks) removed: [] Thread-60725::ERROR::2013-08-22 10:37:45,549::task::833::TaskManager.Task::(_set Error) Task=`83867bdc-48cd-4ba0-b453-6f8abbace13e`::Unexpected error Traceback (most recent call last): File /usr/share/vdsm/storage/task.py, line 840, in _run return fn(*args, **kargs) File /usr/share/vdsm/logUtils.py, line 42, in wrapper res = f(*args, **kwargs) File /usr/share/vdsm/storage/hsm.py, line 1460, in deleteImage
Re: [Users] RHEV-m hosts with certs configured
On 08/16/2013 04:14 AM, navin p wrote: Hi, I have couple of RHEV hosts (ovpxen,RHV2, RHV10 etc) and i'm trying to connect from one of the client machine (C1). All the RHEV host have libvirt modified by vdsm. It looks like the below ## beginning of configuration section by vdsm-4.10.2 listen_addr=0.0.0.0 unix_sock_group=kvm unix_sock_rw_perms=0770 auth_unix_rw=sasl host_uuid=036118ab-705f-4aeb-9a13-013dc8af6b41 keepalive_interval=-1 log_outputs=1:file:/var/log/libvirtd.log log_filters=3:virobject 3:virfile 2:virnetlink 3:cgroup 3:event 3:json 1:libvirt 1:util 1:qemu ca_file=/etc/pki/vdsm/certs/cacert.pem cert_file=/etc/pki/vdsm/certs/vdsmcert.pem key_file=/etc/pki/vdsm/keys/vdsmkey.pem ## end of configuration section by vdsm-4.10.2 # ls bkp-2013-08-16_110734_cacert.pemcacert.pem vdsmcert.pem bkp-2013-08-16_110734_vdsmcert.pem engine_web_ca.pem [root@ovpxen certs]# pwd /etc/pki/vdsm/certs [root@ovpxen certs]# certtool -i --infile engine_web_ca.pem | head X.509 Certificate Information: Version: 3 Serial Number (hex): 09 Issuer: C=US,O=HP,CN=CA-IWFVM00772.hpswlabs.adapps.hp.com.64431 Validity: Not Before: Wed Jan 23 13:24:14 UTC 2013 Not After: Sun Jan 22 07:54:14 UTC 2023 Subject: C=US,O=HP,CN=CA-IWFVM00772.hpswlabs.adapps.hp.com.64431 Subject Public Key Algorithm: RSA Modulus (bits 1024): certtool -i --infile cacert.pem | head X.509 Certificate Information: Version: 3 Serial Number (hex): 09 Issuer: C=US,O=HP,CN=CA-IWFVM00772.hpswlabs.adapps.hp.com.64431 Validity: Not Before: Wed Jan 23 13:24:14 UTC 2013 Not After: Sun Jan 22 07:54:14 UTC 2023 Subject: C=US,O=HP,CN=CA-IWFVM00772.hpswlabs.adapps.hp.com.64431 Subject Public Key Algorithm: RSA Modulus (bits 1024): [root@ovpxen certs]# certtool -i --infile vdsmcert.pem | head X.509 Certificate Information: Version: 3 Serial Number (hex): 0c Issuer: C=US,O=HP,CN=CA-IWFVM00772.hpswlabs.adapps.hp.com.64431 Validity: Not Before: Thu Aug 15 11:09:22 UTC 2013 Not After: Wed Aug 15 05:39:22 UTC 2018 Subject: O=HP,CN=16.184.46.53 Subject Public Key Algorithm: RSA Modulus (bits 2048): Now from the client C1 which cert should i place in /etc/pki/CA/cacert.pem so that i can access from the client using the URI qemu+tls://ovpxen.ind.hp.com/system http://ovpxen.ind.hp.com/system. Please note the host IWFVM00772.hpswlabs.adapps.hp.com http://IWFVM00772.hpswlabs.adapps.hp.com is ovirt managed host. It is not the client. My problem here is i can't change the hypervisor hosts as there are too many of them and it is configured by vdsm . What certs should i take from host so that i can use it in the client so that i can connect to multiple hosts from the client using virsh or virt-manager . I need tls as remote protocol as i'm trying to automate commands. you should be able to do read-only access without special config iirc. taking actions requires the vdsm password, but worth discussing if you want to take actions under the feet of vdsm what they would be. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] When adding another storage domain (gluster), knocks all storage(NFS, Gluster, etc) offline in Data Center and then fails to add new storage domain
On 08/06/2013 12:57 AM, Bert Magleo wrote: Vdsm log Aug 5 21:51:25 vh02 sanlock[1388]: 2013-08-05 21:51:25-0700 358 [3568]: write_sectors delta_leader offset 0 rv -22 /rhev/data-center/mnt/10.10.35.58:storage02/4705355f-1d03-4754-89e4-cf08f6f6caca/dom_md/ids Aug 5 21:51:26 vh02 sanlock[1388]: 2013-08-05 21:51:26-0700 359 [1404]: s2 add_lockspace fail result -22 Aug 5 21:51:26 vh02 vdsm TaskManager.Task ERROR Task=`99f801b2-e56b-4c5f-b6a0-d12b29e7d6bb`::Unexpected error Aug 5 21:51:26 vh02 vdsm Storage.Dispatcher.Protect ERROR {'status': {'message': Cannot acquire host id: ('4705355f-1d03-4754-89e4-cf08f6f6caca', SanlockException(22, 'Sanlock lockspace add failure', 'Invalid argument')), 'code': 661}} Aug 5 21:51:27 vh02 vdsm TaskManager.Task ERROR Task=`c08cc772-cb5c-49a1-9e65-bb45c82a2709`::Unexpected error Aug 5 21:51:27 vh02 vdsm Storage.Dispatcher.Protect ERROR Any ideas on how I can fix this issue? ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users Bert - was this resolved? ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] How to define max number of running VMs on a host?
On 2013/8/22 18:07, Itamar Heim wrote: On 08/22/2013 05:24 AM, lofyer wrote: On 2013/8/22 17:17, Itamar Heim wrote: On 08/21/2013 01:19 AM, lof yer wrote: I didn't see anything like this in engine-config. Is it possible to do that without using host-hooks? ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users can you explain the use case a bit? I have 4 graphic workstations with 3 graphic cards on each. I wanna passthrough graphic cards to the VMs one by one, since one workstation has only 3 cards, I must limit the number of running VM on a host to 3. 1. I assume you use a hook for the graphic passthrough? you can just fail it if no more devices, and engine will try to schedule on next host. 2. (ab)use the reserved RAM. if you allocate to each VM reserved RAM so 3 VMs can fit a host but 4 can't, engine won't try to schedule more than 3 on the same host as it would violate the reserved rAM 3. not a hook, but a filter. in 3.3 you can write a new filter to the pluggable scheduler of MaxNumberOfVms and pass a property of 3 to it. Thank you very much, I think the filter is very suitable for this senerio. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] so, what do you want next in oVirt?
Hi Itamar , I would be happy to throw in an idea . I think oVirt is lacking the ability to assign permissions on multiple VMs at once . For example , if I want to grant permissions to a certain user on 30 VMs , I need to do it manually (or with some script). I think this feature is essential for an enterprise aimed product. Also it would be really cool to have an ability to create groups within oVirt and not in the directory, and grant a group permissions on a vm instead of adding them one by one . For example , creating a group called Dev and give the group permissions on all relevant VMs instead of adding each user one by one . Hope to see this feature in the next versions . Thanks, Dotan Paz , - Original Message - From: Itamar Heim ih...@redhat.com To: users@ovirt.org Sent: Wednesday, August 21, 2013 12:19:16 AM Subject: [Users] so, what do you want next in oVirt? earlier in the year we did a survey for feature requests / improvements / etc. since a lot of things were added, and priorities usually change, I'd like to ask again for what do you need the most from oVirt / what are your pain points next? below[1] I've listed my understanding of what already went in from previous survey requests (to various degrees of coverage). Thanks, Itamar [1] from the top 12 V Allow disk resize V Integrate Nagios/Zabbix monitoring - via a ui plugin V Highly Available engine - via hosted engine[2] V Open vSwitch integration - via neutron integration X Allow cloning VMs without template ? Enable hypervisor upgrade/updates through engine[3] V Allow engine on an oVirt hosted VM - via hosted engine[2] V Enable guest configuration (root password, SSH keys, network) via guest agent in engine - via cloud-init X Integrate v2v into engine ? Bond/extend ovirtmgmt with a second network for HA/increased bandwidth[4] X Integrate scheduling of snapshots and VM export for backups in engine[5] V Spice – support Google Chrome - via mime based launch Other items mentioned in previous survey which should be covered by now: - Fix timeout when adding local host during all-in-one configuration - Fix engine set-up when SELinux is disabled - Provide packages for el6 (CentOS, Red Hat Enterprise Linux) - Allow multiple VMs to be deployed from the same template at the same time - ISO domains on local/GlusterS - Show IP addresses in Virtual Machines-Network Interfaces - OpenStack Quantum support (now called Neutron) - noVNC support - Support spice.html5 and websocket proxy - Add other guest OSes to list - Port oVirt guest agent to Ubuntu[6] - SLA - Allow resource time-sharing - Spice - Mac client (via mime based launch) - Spice - port XPI plug-in to Windows (not sure this will happen, but mime based launch allows using firefox now) - Spice - client for Ubuntu/Debian (should be covered via mime based launch) [2] hosted engine is in active development, but not released yet. [3] host update is supported, but not for general yum update. [4] a lot of improvements were done in this space, but i'm not sure if they cover this exact use case [5] backup api is now being pushed to master, and orchestration of backups should probably happen via 3rd part backup vendors? [6] I'm not sure packaging exists yet, but ubuntu is covered for the basic functionality of the guest agent. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] so, what do you want next in oVirt?
- Original Message - From: Dotan Paz d...@redhat.com To: Itamar Heim ih...@redhat.com Cc: users@ovirt.org Sent: Thursday, August 22, 2013 3:14:42 PM Subject: Re: [Users] so, what do you want next in oVirt? Hi Itamar , I would be happy to throw in an idea . I think oVirt is lacking the ability to assign permissions on multiple VMs at once . For example , if I want to grant permissions to a certain user on 30 VMs , I need to do it manually (or with some script). I think this feature is essential for an enterprise aimed product. Also it would be really cool to have an ability to create groups within oVirt and not in the directory, and grant a group permissions on a vm instead of adding them one by one . For example , creating a group called Dev and give the group permissions on all relevant VMs instead of adding each user one by one . Hope to see this feature in the next versions . Thanks, Dotan Paz , 1. Following the discussion at users this week about clustered engine + load balancing, what about a feature in which each engine will manage X data centers (let's call this a site - I took the term from past experience), but using the web admin you will be able to view/manage data centers that belong to different sites? 2. Keystone authentication? - Original Message - From: Itamar Heim ih...@redhat.com To: users@ovirt.org Sent: Wednesday, August 21, 2013 12:19:16 AM Subject: [Users] so, what do you want next in oVirt? earlier in the year we did a survey for feature requests / improvements / etc. since a lot of things were added, and priorities usually change, I'd like to ask again for what do you need the most from oVirt / what are your pain points next? below[1] I've listed my understanding of what already went in from previous survey requests (to various degrees of coverage). Thanks, Itamar [1] from the top 12 V Allow disk resize V Integrate Nagios/Zabbix monitoring - via a ui plugin V Highly Available engine - via hosted engine[2] V Open vSwitch integration - via neutron integration X Allow cloning VMs without template ? Enable hypervisor upgrade/updates through engine[3] V Allow engine on an oVirt hosted VM - via hosted engine[2] V Enable guest configuration (root password, SSH keys, network) via guest agent in engine - via cloud-init X Integrate v2v into engine ? Bond/extend ovirtmgmt with a second network for HA/increased bandwidth[4] X Integrate scheduling of snapshots and VM export for backups in engine[5] V Spice – support Google Chrome - via mime based launch Other items mentioned in previous survey which should be covered by now: - Fix timeout when adding local host during all-in-one configuration - Fix engine set-up when SELinux is disabled - Provide packages for el6 (CentOS, Red Hat Enterprise Linux) - Allow multiple VMs to be deployed from the same template at the same time - ISO domains on local/GlusterS - Show IP addresses in Virtual Machines-Network Interfaces - OpenStack Quantum support (now called Neutron) - noVNC support - Support spice.html5 and websocket proxy - Add other guest OSes to list - Port oVirt guest agent to Ubuntu[6] - SLA - Allow resource time-sharing - Spice - Mac client (via mime based launch) - Spice - port XPI plug-in to Windows (not sure this will happen, but mime based launch allows using firefox now) - Spice - client for Ubuntu/Debian (should be covered via mime based launch) [2] hosted engine is in active development, but not released yet. [3] host update is supported, but not for general yum update. [4] a lot of improvements were done in this space, but i'm not sure if they cover this exact use case [5] backup api is now being pushed to master, and orchestration of backups should probably happen via 3rd part backup vendors? [6] I'm not sure packaging exists yet, but ubuntu is covered for the basic functionality of the guest agent. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] Linux sysprep
On Thu, 2013-08-22 at 09:55 +0200, René Koch (ovido) wrote: On Wed, 2013-08-21 at 19:49 -0400, Greg Padgett wrote: On 08/21/2013 07:25 AM, René Koch (ovido) wrote: [snip] I'm just playing around with the payload feature but I can't access the cd/floppy in my vm. I adapted Yuriy's script (http://lists.ovirt.org/pipermail/users/2013-June/014907.html - which is working fine btw) to create payload xml content and write it with hooking.write_domxml(domxml). In vdsm.log I can see that my python script exits with status code 0 and that the content seems to be added to the vm definition: Thread-130844::DEBUG::2013-08-21 12:43:52,669::libvirtvm::1520::vm.Vm::(_run) vmId=`79dc3123-4584-4dd9-b0f0-c28ede13d672`::?xml version=1.0 encoding=utf-8?domain type=kvm namecentos6/name snip /cpu payloadspayload type=cdromfile name=unattended.txtcontenthostname: centos6/content/file/payload/payloads/domain But in my vm I can't mount the cd drive: # mount /dev/sr0 /media mount: you must specify the filesystem type Is there a special filesystem I have to specify? Furthermore shouldn't I be able to see the payloads content added to this vm via REST-API? Because I can't. Maybe I'm doing some wrong? Thanks, René That's a neat script. I haven't used it--instead I just send xml to the rest api, something like this, which looks a lot like yours: vm id=6aec2d40-e36f-4b02-ab75-933d93f4cb8b href=/api/vms/6aec2d40-e36f-4b02-ab75-933d93f4cb8b payloads payload type=cdrom file name=meta-data.txtcontentsome content/content /file /payload /payloads /vm To attach the payload via the rest api, note that you'd need to send a put request to /api/vms/uuid rather than pass the xml in the run/start action, because that's not yet supported. Doing this, inside my vm I see: [root@cloud-init-test ~]# blkid /dev/sr1: UUID=2013-08-21-19-39-40-00 LABEL=CDROM TYPE=iso9660 Hm, for some strange reason I can PUT the payloads XML to a specific vm without any errors using REST-API, but it seems to never really update the vm definition (when testing with GET payloads is missing again and no cd in my vm). PUT for e.g. usb definitions is working fine (system is oVirt 3.2). Anyway, I don't have enough time at the moment to investigate this further, so I use Yuriy's script (thanks!) and add the hostname via SKU number. But will maybe play with vm payloads later again. If anyone is interested in the scripts, feel free to use them: https://github.com/ovido/ovirt-stuff/tree/master/sysprep_linux (please note that these will only work for RHEL/CentOS/Fedora/other clones) Regards, René And I can mount it without any problems. You can also check the qemu process listing on the host--for instance, mine shows: /usr/bin/qemu-system-x86_64 [...] -drive file=/var/run/vdsm/payload/29e331f9-42df-46e1-aad1-88101b134606.fe53caf3339d55b2b37a893e19e9f10a.img While the vm is running, you can check that file with `file` (should report ISO 9660), mount it on the host, etc. HTH, Greg ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] Linux sysprep
On 08/22/2013 10:19 AM, René Koch (ovido) wrote: ... Hm, for some strange reason I can PUT the payloads XML to a specific vm without any errors using REST-API, but it seems to never really update the vm definition (when testing with GET payloads is missing again and no cd in my vm). PUT for e.g. usb definitions is working fine (system is oVirt 3.2). Anyway, I don't have enough time at the moment to investigate this further, so I use Yuriy's script (thanks!) and add the hostname via SKU number. But will maybe play with vm payloads later again. If anyone is interested in the scripts, feel free to use them: https://github.com/ovido/ovirt-stuff/tree/master/sysprep_linux (please note that these will only work for RHEL/CentOS/Fedora/other clones) iirc, that's by design actually... since the payload may contain passwords for sysprep, etc... so do the PUT and check its there by launching the VM ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] received packet with own address as source address
While I see the messages even with no VMs running, I don't see any messages before installing oVirt. Additionally, is there any reason that the school network would selectively affect some nodes but not others? Thanks On Aug 22, 2013, at 2:49 AM, Assaf Muller amul...@redhat.com wrote: I'd enable STP on all ports, including the port connecting your switch to the school switch. VSDSM configures the ovirtmgmt bridge on installation. The reason I'm suggesting that it's not VDSM at fault but rather the school network having a loop is that you mentioned that you get these messages even with no VMs running. - Original Message - From: H. Haven Liu haven@ucla.edu To: Assaf Muller amul...@redhat.com Cc: Users@ovirt.org Sent: Wednesday, August 21, 2013 11:26:57 PM Subject: Re: [Users] received packet with own address as source address The switch is connected to the internet via the school's switch. Currently (as well as when I received the error messages last time) portfast is disabled for all ports, and STP enabled for all ports except for the port connecting my switch to the school's. On Aug 20, 2013, at 11:50 PM, Assaf Muller amul...@redhat.com wrote: The problem was also present when I just had one interface connected to the switch, connected to the Internet. How was the switch connected to the internet? Is it connected to other switches? To solve the loop you can make sure that STP is enabled on all switches and to disable portfast. - Original Message - From: H. Haven Liu haven@ucla.edu To: Assaf Muller amul...@redhat.com Cc: Users@ovirt.org Sent: Tuesday, August 20, 2013 6:09:09 PM Subject: Re: [Users] received packet with own address as source address Hello, After I reinstalled the host, the problem seems to have disappeared. This is not to say it's not going to come back, as it has done before. I know the nodes were not receiving the error message *before* I installed VDSM (which configured the bridge?), but I haven't tried uninstalling to see if the problem would go away. The problem was also present when I just had one interface connected to the switch, connected to the Internet. If the problem is indeed a classic L2 loop, how do I go about resolving it? Is it due to bridge (mis)configuration, or is it in the network switch settings? I have tried enabling and disabling STP and portfast, which didn't seem to have any effect. Thanks, Haven On Aug 20, 2013, at 12:26 AM, Assaf Muller amul...@redhat.com wrote: Hello Mr. Liu, Sounds like a classic L2 loop. Hosts getting their own packets then losing connectivity for a few minutes while the switches restart. Can you try to rule out this possibility? For example: If you uninstall the engine and VDSM from all hosts does this still happen? Can you simplify the network topology and see if the issue persists? - Original Message - From: H. Haven Liu haven@ucla.edu To: Users@ovirt.org Sent: Saturday, August 17, 2013 10:06:07 PM Subject: [Users] received packet with own address as source address Hello, I have a oVirt installation with 6 CentOS 6.4 hosts. Some (not all) hosts are receiving these error messages, at a frequency of once every other minute: [root@vhost1 ~]# grep source address /var/log/messages | tail Aug 17 11:19:20 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:21:24 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:23:29 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:25:34 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:27:39 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:29:44 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:31:49 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:33:54 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:35:59 vhost1 kernel: em1: received packet with own address as source address Aug 17 11:38:04 vhost1 kernel: em1: received packet with own address as source address These error messages are accompanied with loss of connectivity, with duration varies between a few seconds to minutes. The loss of connectivity would start just before the above error message. I don't *think* it's hardware because the received packet with own address error message would disappear from one of the hosts after a while. These error messages are also present whether or not any VM is running on the particular host. Here are some configurations: [root@vhost1 ~]# ifconfig em1 Link encap:Ethernet HWaddr aa:bb:cc:dd:ee:f1 inet6 addr: :::::eee1/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:37413202 errors:0
Re: [Users] Setup Host Network dialog - actions availability [ux][BZ#984737]
On 22/08/13 20:04, Einav Cohen wrote: Hi, This is about attempting to address the difficulty of finding the edit-action in the Setup Host Network dialog, as documented in Bug 984737 - usability: webadmin difficulty in assigning client ip, no gateway possible in bugzilla. We have a suggestion from Eldan (see attached HostSetupNetworks-HoverPopUp.png) which was described in the BZ (comment #3) and seemed acceptable by the reporter (comment #4), however IIUC - one of the main pain points described in the BZ was the fact that the user could not find the option to Edit the connection properties since he was looking in the wrong place, and needed to hover on the correct place, in order to find that option. So although the idea is somewhat helpful, my concern is that this solution is not enough (comment #5). Another proposal from Malini (comment #6) is to add an actions drop-down menu in the form of a small gear icon-button - see attached HostSetupNetworks-DropDownMenu.png. This proposal addresses my concern, however I have a question about another concern with this solution: would the actions-drop-down menu-items panel be revealed appear upon click or upon hover? if it will be upon hover, it might seem weird/be conflicted/be somewhat confusing with the hover functionality that reveals the logical-network details pop-up. If this proposal is accepted (see my comments below about both proposals), one solution might be to get rid of the network details tooltip. Most people probably don't use MTU, and the rest is just explaining the network role icons; so maybe not that useful. if it will be upon click, it means that in order to edit a logical network, two clicks will be required in order to get to the edit dialog, as opposed to one click in the current state and in Eldan's suggestion. maybe having two clicks in order to get to the edit dialog is acceptable, however there may be some solutions for that: one possible solution would be to combine both attached suggestions, i.e. the actions within the hover pop-up, as well as the actions drop-down menu, however it means that there will be some redundancy of the actions availability. That sounds bad to me regardless of the other alternatives. another possible solution is to keep only the gear + down-arrow icon (or maybe only the down-arrow icon), without the actual drop-down menu there, just in order to indicate that there are some options available in that area, and have Eldan's pop-up appear when hovering on that icon (or even on the entire logical-network area, as happens today with the current details pop-up) thoughts? I like the gear icon because it's noticeable and easily recognizable. However, keep in mind that bonds should also have the same icon to keep a consistent design. Now imagine a configuration with several bonds on the left-hand-side and quite a few networks on the right-hand-side; I'm no designer, but it could get cluttered with all those gear icons. It MIGHT be preferable to use the other design (tooltip with action bar) and risk the odd person not easily finding it (no disrespect intended, Jason). I have no idea, however, if it's gonna be just the odd person or most people. I'd love to hear others' opinions. Regards, Einav ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [Users] Setup Host Network dialog - actions availability [ux][BZ#984737]
On 08/22/2013 01:43 PM, Lior Vernia wrote: On 22/08/13 20:04, Einav Cohen wrote: Hi, This is about attempting to address the difficulty of finding the edit-action in the Setup Host Network dialog, as documented in Bug 984737 - usability: webadmin difficulty in assigning client ip, no gateway possible in bugzilla. We have a suggestion from Eldan (see attached HostSetupNetworks-HoverPopUp.png) which was described in the BZ (comment #3) and seemed acceptable by the reporter (comment #4), however IIUC - one of the main pain points described in the BZ was the fact that the user could not find the option to Edit the connection properties since he was looking in the wrong place, and needed to hover on the correct place, in order to find that option. So although the idea is somewhat helpful, my concern is that this solution is not enough (comment #5). Another proposal from Malini (comment #6) is to add an actions drop-down menu in the form of a small gear icon-button - see attached HostSetupNetworks-DropDownMenu.png. This proposal addresses my concern, however I have a question about another concern with this solution: would the actions-drop-down menu-items panel be revealed appear upon click or upon hover? if it will be upon hover, it might seem weird/be conflicted/be somewhat confusing with the hover functionality that reveals the logical-network details pop-up. The suggestion from Lior did include redesigning the tooltip frame to include an Edit command, which is certainly more intuitive than a pencil. That being said, I do agree that the gear solution which has been proposed is *more* intuitive and honestly more in line with what I was expecting. I didn't complain about Lior's response even though it didn't completely address my issue because it came from a designer, and I realized, looking at my desktop, that configurable elements often *do not* have hints that they are configurable. If this proposal is accepted (see my comments below about both proposals), one solution might be to get rid of the network details tooltip. Most people probably don't use MTU, and the rest is just explaining the network role icons; so maybe not that useful. if it will be upon click, it means that in order to edit a logical network, two clicks will be required in order to get to the edit dialog, as opposed to one click in the current state and in Eldan's suggestion. maybe having two clicks in order to get to the edit dialog is acceptable, however there may be some solutions for that: one possible solution would be to combine both attached suggestions, i.e. the actions within the hover pop-up, as well as the actions drop-down menu, however it means that there will be some redundancy of the actions availability. That sounds bad to me regardless of the other alternatives. another possible solution is to keep only the gear + down-arrow icon (or maybe only the down-arrow icon), without the actual drop-down menu there, just in order to indicate that there are some options available in that area, and have Eldan's pop-up appear when hovering on that icon (or even on the entire logical-network area, as happens today with the current details pop-up) thoughts? I like the gear icon because it's noticeable and easily recognizable. However, keep in mind that bonds should also have the same icon to keep a consistent design. Now imagine a configuration with several bonds on the left-hand-side and quite a few networks on the right-hand-side; I'm no designer, but it could get cluttered with all those gear icons. It MIGHT be preferable to use the other design (tooltip with action bar) and risk the odd person not easily finding it (no disrespect intended, Jason). I have no idea, however, if it's gonna be just the odd person or most people. I'd love to hear others' opinions. Having not used bridging/multiple VLANS prior to my experimentation with ovirt, it's always been the network interface itself that I have configured with IP/subnet/etc (eg. /etc/sysconfig/network-scripts/ifcfg-eth0). Most of my machines (hundreds) have single network interfaces, and I've never needed to use bonding/bridging/etc which kept my network configuration very simple. After experimenting with oVirt, and doing my share of reading, I certainly understand the concept of logical networks and their configuration with oVirt, and yes, it all makes a lot of sense NOW (well, except for the fact that really when it comes down to it, the Linux configuration for anything but basic networking is, in my opinion, anything but intuitive.) Nonetheless, please keep in mind that a concept which might be completely crystal clear to someone who uses it on a daily basis might be a little less intuitive to someone who is using it for the first time. Fortunately, I've got *plenty* of patience. :) Regards, Einav Thanks for your help! Jason. ___ Users mailing list Users@ovirt.org
Re: [Users] Setup Host Network dialog - actions availability [ux][BZ#984737]
tor 2013-08-22 klockan 20:43 +0300 skrev Lior Vernia: On 22/08/13 20:04, Einav Cohen wrote: Hi, This is about attempting to address the difficulty of finding the edit-action in the Setup Host Network dialog, as documented in Bug 984737 - usability: webadmin difficulty in assigning client ip, no gateway possible in bugzilla. We have a suggestion from Eldan (see attached HostSetupNetworks-HoverPopUp.png) which was described in the BZ (comment #3) and seemed acceptable by the reporter (comment #4), however IIUC - one of the main pain points described in the BZ was the fact that the user could not find the option to Edit the connection properties since he was looking in the wrong place, and needed to hover on the correct place, in order to find that option. So although the idea is somewhat helpful, my concern is that this solution is not enough (comment #5). Another proposal from Malini (comment #6) is to add an actions drop-down menu in the form of a small gear icon-button - see attached HostSetupNetworks-DropDownMenu.png. This proposal addresses my concern, however I have a question about another concern with this solution: would the actions-drop-down menu-items panel be revealed appear upon click or upon hover? if it will be upon hover, it might seem weird/be conflicted/be somewhat confusing with the hover functionality that reveals the logical-network details pop-up. If this proposal is accepted (see my comments below about both proposals), one solution might be to get rid of the network details tooltip. Most people probably don't use MTU, Just a FYI there Lior; we do:) And when 10GbE becomes available, Jumbo Frames is going to be required to use all that bandwidth. Otherwise you are capped at about half(500MB/s as opposed to 1,2GB/s). /Karli and the rest is just explaining the network role icons; so maybe not that useful. if it will be upon click, it means that in order to edit a logical network, two clicks will be required in order to get to the edit dialog, as opposed to one click in the current state and in Eldan's suggestion. maybe having two clicks in order to get to the edit dialog is acceptable, however there may be some solutions for that: one possible solution would be to combine both attached suggestions, i.e. the actions within the hover pop-up, as well as the actions drop-down menu, however it means that there will be some redundancy of the actions availability. That sounds bad to me regardless of the other alternatives. another possible solution is to keep only the gear + down-arrow icon (or maybe only the down-arrow icon), without the actual drop-down menu there, just in order to indicate that there are some options available in that area, and have Eldan's pop-up appear when hovering on that icon (or even on the entire logical-network area, as happens today with the current details pop-up) thoughts? I like the gear icon because it's noticeable and easily recognizable. However, keep in mind that bonds should also have the same icon to keep a consistent design. Now imagine a configuration with several bonds on the left-hand-side and quite a few networks on the right-hand-side; I'm no designer, but it could get cluttered with all those gear icons. It MIGHT be preferable to use the other design (tooltip with action bar) and risk the odd person not easily finding it (no disrespect intended, Jason). I have no idea, however, if it's gonna be just the odd person or most people. I'd love to hear others' opinions. Regards, Einav ___ Users mailing list Users@ovirt.orgmailto:Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users -- Med Vänliga Hälsningar --- Karli Sjöberg Swedish University of Agricultural Sciences Box 7079 (Visiting Address Kronåsvägen 8) S-750 07 Uppsala, Sweden Phone: +46-(0)18-67 15 66 karli.sjob...@slu.semailto:karli.sjob...@adm.slu.se ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users