Re: [ovirt-users] sanlock ids file broken after server crash
On Sun, Jul 30, 2017 at 4:24 PM, Maor Lipchuk wrote: > Hi David, Sorry, I meant Johan > > I'm not sure how it got to that character in the first place. > Nir, Is there a safe way to fix that while there are running VMs? > > Regards, > Maor > > On Sun, Jul 30, 2017 at 11:58 AM, Johan Bernhardsson wrote: >> (First reply did not get to the list) >> >> From sanlock.log: >> >> 2017-07-30 10:49:31+0200 1766275 [1171]: s310751 lockspace 0924ff77- >> ef51-435b-b90d-50bfbf2e8de7:1:/rhev/data- >> center/mnt/glusterSD/vbgsan02:_fs02/0924ff77-ef51-435b-b90d- >> 50bfbf2e8de7/dom_md/ids:0 >> 2017-07-30 10:49:31+0200 1766275 [10496]: verify_leader 1 wrong space >> name 0924ff77-ef51-435b-b90d-50bfbf2eke7 0924ff77-ef51-435b-b90d- >> 50bfbf2e8de7 /rhev/data-center/mnt/glusterSD/vbgsan02:_fs02/0924ff77- >> ef51-435b-b90d-50bfbf2e8de7/dom_md/ids >> 2017-07-30 10:49:31+0200 1766275 [10496]: leader1 delta_acquire_begin >> error -226 lockspace 0924ff77-ef51-435b-b90d-50bfbf2e8de7 host_id 1 >> 2017-07-30 10:49:31+0200 1766275 [10496]: leader2 path /rhev/data- >> center/mnt/glusterSD/vbgsan02:_fs02/0924ff77-ef51-435b-b90d- >> 50bfbf2e8de7/dom_md/ids offset 0 >> 2017-07-30 10:49:31+0200 1766275 [10496]: leader3 m 12212010 v 30003 ss >> 512 nh 0 mh 4076 oi 1 og 2031079063 lv 0 >> 2017-07-30 10:49:31+0200 1766275 [10496]: leader4 sn 0924ff77-ef51- >> 435b-b90d-50bfbf2eke7 rn <93>7^\afa5-3a91-415b-a04c- >> 221d3e060163.vbgkvm01.a ts 4351980 cs eefa4dd7 >> 2017-07-30 10:49:32+0200 1766276 [1171]: s310751 add_lockspace fail >> result -226 >> >> >> vdsm logs doesnt have any errors and engine.log does not have any >> errors. >> >> And if i check the ids file manually. I can see that everything in it >> is correct except for the first host in the cluster where the space >> name and host id is broken. >> >> >> /Johan >> >> On Sun, 2017-07-30 at 11:18 +0300, Maor Lipchuk wrote: >>> Hi Johan, >>> >>> Can you please share the vdsm and engine logs. >>> >>> Also, it won't harm to also get the sanlock logs just in case sanlock >>> was configured to save all debugging in a log file (see >>> http://people.redhat.com/teigland/sanlock-messages.txt)). >>> Try to share the sanlock ouput by running 'sanlock client status', >>> 'sanlock client log_dump'. >>> >>> Regards, >>> Maor >>> >>> On Thu, Jul 27, 2017 at 6:18 PM, Johan Bernhardsson >>> wrote: >>> > >>> > Hello, >>> > >>> > The ids file for sanlock is broken on one setup. The first host id >>> > in >>> > the file is wrong. >>> > >>> > From the logfile i have: >>> > >>> > verify_leader 1 wrong space name 0924ff77-ef51-435b-b90d- >>> > 50bfbf2e�ke7 >>> > 0924ff77-ef51-435b-b90d-50bfbf2e8de7 /rhev/data- >>> > center/mnt/glusterSD/ >>> > >>> > >>> > >>> > Note the broken char in the space name. >>> > >>> > This also apears. And it seams as the hostid too is broken in the >>> > ids >>> > file: >>> > >>> > leader4 sn 0924ff77-ef51-435b-b90d-50bfbf2e�ke7 rn ��7 afa5-3a91- >>> > 415b- >>> > a04c-221d3e060163.vbgkvm01.a ts 4351980 cs eefa4dd7 >>> > >>> > Note the broken chars there as well. >>> > >>> > If i check the ids file with less or strings the first row where my >>> > vbgkvm01 host are. That has broken chars. >>> > >>> > Can this be repaired in some way without taking down all the >>> > virtual >>> > machines on that storage? >>> > >>> > >>> > /Johan >>> > ___ >>> > Users mailing list >>> > Users@ovirt.org >>> > http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] sanlock ids file broken after server crash
Hi David, I'm not sure how it got to that character in the first place. Nir, Is there a safe way to fix that while there are running VMs? Regards, Maor On Sun, Jul 30, 2017 at 11:58 AM, Johan Bernhardsson wrote: > (First reply did not get to the list) > > From sanlock.log: > > 2017-07-30 10:49:31+0200 1766275 [1171]: s310751 lockspace 0924ff77- > ef51-435b-b90d-50bfbf2e8de7:1:/rhev/data- > center/mnt/glusterSD/vbgsan02:_fs02/0924ff77-ef51-435b-b90d- > 50bfbf2e8de7/dom_md/ids:0 > 2017-07-30 10:49:31+0200 1766275 [10496]: verify_leader 1 wrong space > name 0924ff77-ef51-435b-b90d-50bfbf2eke7 0924ff77-ef51-435b-b90d- > 50bfbf2e8de7 /rhev/data-center/mnt/glusterSD/vbgsan02:_fs02/0924ff77- > ef51-435b-b90d-50bfbf2e8de7/dom_md/ids > 2017-07-30 10:49:31+0200 1766275 [10496]: leader1 delta_acquire_begin > error -226 lockspace 0924ff77-ef51-435b-b90d-50bfbf2e8de7 host_id 1 > 2017-07-30 10:49:31+0200 1766275 [10496]: leader2 path /rhev/data- > center/mnt/glusterSD/vbgsan02:_fs02/0924ff77-ef51-435b-b90d- > 50bfbf2e8de7/dom_md/ids offset 0 > 2017-07-30 10:49:31+0200 1766275 [10496]: leader3 m 12212010 v 30003 ss > 512 nh 0 mh 4076 oi 1 og 2031079063 lv 0 > 2017-07-30 10:49:31+0200 1766275 [10496]: leader4 sn 0924ff77-ef51- > 435b-b90d-50bfbf2eke7 rn <93>7^\afa5-3a91-415b-a04c- > 221d3e060163.vbgkvm01.a ts 4351980 cs eefa4dd7 > 2017-07-30 10:49:32+0200 1766276 [1171]: s310751 add_lockspace fail > result -226 > > > vdsm logs doesnt have any errors and engine.log does not have any > errors. > > And if i check the ids file manually. I can see that everything in it > is correct except for the first host in the cluster where the space > name and host id is broken. > > > /Johan > > On Sun, 2017-07-30 at 11:18 +0300, Maor Lipchuk wrote: >> Hi Johan, >> >> Can you please share the vdsm and engine logs. >> >> Also, it won't harm to also get the sanlock logs just in case sanlock >> was configured to save all debugging in a log file (see >> http://people.redhat.com/teigland/sanlock-messages.txt)). >> Try to share the sanlock ouput by running 'sanlock client status', >> 'sanlock client log_dump'. >> >> Regards, >> Maor >> >> On Thu, Jul 27, 2017 at 6:18 PM, Johan Bernhardsson >> wrote: >> > >> > Hello, >> > >> > The ids file for sanlock is broken on one setup. The first host id >> > in >> > the file is wrong. >> > >> > From the logfile i have: >> > >> > verify_leader 1 wrong space name 0924ff77-ef51-435b-b90d- >> > 50bfbf2e�ke7 >> > 0924ff77-ef51-435b-b90d-50bfbf2e8de7 /rhev/data- >> > center/mnt/glusterSD/ >> > >> > >> > >> > Note the broken char in the space name. >> > >> > This also apears. And it seams as the hostid too is broken in the >> > ids >> > file: >> > >> > leader4 sn 0924ff77-ef51-435b-b90d-50bfbf2e�ke7 rn ��7 afa5-3a91- >> > 415b- >> > a04c-221d3e060163.vbgkvm01.a ts 4351980 cs eefa4dd7 >> > >> > Note the broken chars there as well. >> > >> > If i check the ids file with less or strings the first row where my >> > vbgkvm01 host are. That has broken chars. >> > >> > Can this be repaired in some way without taking down all the >> > virtual >> > machines on that storage? >> > >> > >> > /Johan >> > ___ >> > Users mailing list >> > Users@ovirt.org >> > http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] supervdsmd IOError to /dev/stdout
Hi Yaniv, On this one node, it happened from 3.6 -> 4.0. It persisted after 4.0->4.1. Current: vdsm-4.19.24-1.el7.centos.x86_64 In systemd override I now have to have: StandardOutput=null Jul 29 01:19:21 systemd[1]: Starting Auxiliary vdsm service for running helper functions as root... Jul 29 01:19:21 python2[39124]: detected unhandled Python exception in '/usr/share/vdsm/supervdsmServer' Jul 29 01:19:21 daemonAdapter[39124]: Traceback (most recent call last): Jul 29 01:19:21 daemonAdapter[39124]: File "/usr/share/vdsm/supervdsmServer", line 45, in Jul 29 01:19:21 daemonAdapter[39124]: level=logging.DEBUG) Jul 29 01:19:21 daemonAdapter[39124]: File "/usr/lib64/python2.7/logging/__init__.py", line 1529, in basicConfig Jul 29 01:19:21 daemonAdapter[39124]: hdlr = FileHandler(filename, mode) Jul 29 01:19:21 daemonAdapter[39124]: File "/usr/lib64/python2.7/logging/__init__.py", line 902, in __init__ Jul 29 01:19:21 daemonAdapter[39124]: StreamHandler.__init__(self, self._open()) Jul 29 01:19:21 daemonAdapter[39124]: File "/usr/lib64/python2.7/logging/__init__.py", line 925, in _open Jul 29 01:19:21 daemonAdapter[39124]: stream = open(self.baseFilename, self.mode) Jul 29 01:19:21 daemonAdapter[39124]: IOError: [Errno 6] No such device or address: '/dev/stdout' Jul 29 01:19:21 systemd[1]: supervdsmd.service: main process exited, code=exited, status=1/FAILURE On Sun, Jul 30, 2017 at 3:47 PM, Yaniv Kaul wrote: > > > On Fri, Jul 28, 2017 at 8:37 PM, Richard Chan < > rich...@treeboxsolutions.com> wrote: > >> After an upgrade to 4.0 I have a single host that cannot start supervdsmd >> because of IOError on /dev/stdout. All other hosts upgraded correctly. >> > > Upgrade from which version? 3.6? Did you stay on 4.0 or continued to 4.1? > > >> >> In the systemd unit I have to hack StandardOutput=null. >> >> Any thing I have overlooked? The hosts are all identical and it is just >> this one >> that has this weird behaviour. >> > > Any logs that you can share? > Y. > > >> >> -- >> Richard Chan >> >> >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> >> > -- Richard Chan Chief Architect TreeBox Solutions Pte Ltd 1 Commonwealth Lane #03-01 Singapore 149544 Tel: 6570 3725 http://www.treeboxsolutions.com Co.Reg.No. 201100585R ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] problem while moving/copying disks: vdsm low level image copy failed
OS Version: RHEL - 7 - 3.1611.el7.centos OS Description: CentOS Linux 7 (Core) Kernel Version: 3.10.0 - 514.16.1.el7.x86_64 KVM Version: 2.6.0 - 28.el7_3.9.1 LIBVIRT Version: libvirt-2.0.0-10.el7_3.9 VDSM Version: vdsm- 4.19.15-1.el7.centos SPICE Version: 0.12.4 - 20.el7_3 GlusterFS Version: gl usterfs-3.8.11-1.el7 CEPH Version: librbd1-0.94.5-1.el7 qemu-img version 2.6.0 (qemu-kvm-ev-2.6.0-28.el7_3.9.1), Copyright (c) 2004-2008 Fabrice Bellard This is what i have on the hosts. /Johan On Sun, 2017-07-30 at 13:56 +0300, Benny Zlotnik wrote: > Hi, > > Can please you provide the versions of vdsm, qemu, libvirt? > > On Sun, Jul 30, 2017 at 1:01 PM, Johan Bernhardsson > wrote: > > Hello, > > > > We get this error message while moving or copying some of the disks > > on > > our main cluster running 4.1.2 on centos7 > > > > This is shown in the engine: > > VDSM vbgkvm02 command HSMGetAllTasksStatusesVDS failed: low level > > Image > > copy failed > > > > I can copy it inside the host. And i can use dd to copy. Haven't > > tried > > to run qemu-img manually yet. > > > > > > This is from vdsm.log on the host: > > 2017-07-28 09:07:22,741+0200 ERROR (tasks/6) [root] Job u'c82d4c53- > > 3eb4-405e-a2d5-c4c77519360e' failed (jobs:217) > > Traceback (most recent call last): > > File "/usr/lib/python2.7/site-packages/vdsm/jobs.py", line 154, > > in > > run > > self._run() > > File "/usr/share/vdsm/storage/sdm/api/copy_data.py", line 88, in > > _run > > self._operation.wait_for_completion() > > File "/usr/lib/python2.7/site-packages/vdsm/qemuimg.py", line > > 329, in > > wait_for_completion > > self.poll(timeout) > > File "/usr/lib/python2.7/site-packages/vdsm/qemuimg.py", line > > 324, in > > poll > > self.error) > > QImgError: cmd=['/usr/bin/taskset', '--cpu-list', '0-15', > > '/usr/bin/nice', '-n', '19', '/usr/bin/ionice', '-c', '3', > > '/usr/bin/qemu-img', 'convert', '-p', '-t', 'none', '-T', 'none', > > '-f', > > 'raw', u'/rhev/data-center/mnt/glusterSD/vbgsan02:_fs02/0924ff77- > > ef51- > > 43 > > 5b-b90d-50bfbf2e8de7/images/750f4184-b852-4b00-94fc- > > 476f3f5b93c7/3fe43487-3302-4b34-865a-07c5c6aedbf2', '-O', 'raw', > > u'/rhev/data-center/mnt/glusterSD/10.137.30.105:_fs03/5d47a297- > > a21f- > > 4587-bb7c-dd00d52010d5/images/750f4184-b852-4b00-94fc- > > 476f3f5b93c7/3fe43487-3302-4b34-865 > > a-07c5c6aedbf2'], ecode=1, stdout=, stderr=qemu-img: error while > > reading sector 12197886: No data available > > , message=None > > > > > > The storage domains are all based on gluster. The storage domains > > that > > we see this on is configured as dispersed volumes. > > > > Found a way to "fix" the problem. And that is to run dd if=/dev/vda > > of=/dev/null bs=1M inside the virtual guest. After that we can > > copy an > > image or use storage livemigration. > > > > Is this a gluster problem or an vdsm problem? Or could it be > > something > > with qemu-img? > > > > /Johan > > ___ > > Users mailing list > > Users@ovirt.org > > http://lists.ovirt.org/mailman/listinfo/users > > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] problem while moving/copying disks: vdsm low level image copy failed
Hi, Can please you provide the versions of vdsm, qemu, libvirt? On Sun, Jul 30, 2017 at 1:01 PM, Johan Bernhardsson wrote: > Hello, > > We get this error message while moving or copying some of the disks on > our main cluster running 4.1.2 on centos7 > > This is shown in the engine: > VDSM vbgkvm02 command HSMGetAllTasksStatusesVDS failed: low level Image > copy failed > > I can copy it inside the host. And i can use dd to copy. Haven't tried > to run qemu-img manually yet. > > > This is from vdsm.log on the host: > 2017-07-28 09:07:22,741+0200 ERROR (tasks/6) [root] Job u'c82d4c53- > 3eb4-405e-a2d5-c4c77519360e' failed (jobs:217) > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/vdsm/jobs.py", line 154, in > run > self._run() > File "/usr/share/vdsm/storage/sdm/api/copy_data.py", line 88, in _run > self._operation.wait_for_completion() > File "/usr/lib/python2.7/site-packages/vdsm/qemuimg.py", line 329, in > wait_for_completion > self.poll(timeout) > File "/usr/lib/python2.7/site-packages/vdsm/qemuimg.py", line 324, in > poll > self.error) > QImgError: cmd=['/usr/bin/taskset', '--cpu-list', '0-15', > '/usr/bin/nice', '-n', '19', '/usr/bin/ionice', '-c', '3', > '/usr/bin/qemu-img', 'convert', '-p', '-t', 'none', '-T', 'none', '-f', > 'raw', u'/rhev/data-center/mnt/glusterSD/vbgsan02:_fs02/0924ff77-ef51- > 43 > 5b-b90d-50bfbf2e8de7/images/750f4184-b852-4b00-94fc- > 476f3f5b93c7/3fe43487-3302-4b34-865a-07c5c6aedbf2', '-O', 'raw', > u'/rhev/data-center/mnt/glusterSD/10.137.30.105:_fs03/5d47a297-a21f- > 4587-bb7c-dd00d52010d5/images/750f4184-b852-4b00-94fc- > 476f3f5b93c7/3fe43487-3302-4b34-865 > a-07c5c6aedbf2'], ecode=1, stdout=, stderr=qemu-img: error while > reading sector 12197886: No data available > , message=None > > > The storage domains are all based on gluster. The storage domains that > we see this on is configured as dispersed volumes. > > Found a way to "fix" the problem. And that is to run dd if=/dev/vda > of=/dev/null bs=1M inside the virtual guest. After that we can copy an > image or use storage livemigration. > > Is this a gluster problem or an vdsm problem? Or could it be something > with qemu-img? > > /Johan > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Deploying training lab
If you are referring to a plain OS to run the laptops from on, I'm not aware of any specific OS. maybe DSL (http://www.damnsmalllinux.org/)? On Sun, Jul 30, 2017 at 1:01 PM, Maor Lipchuk wrote: > What about ovirt-live? >http://www.ovirt.org/download/ovirt-live/ > > On Sun, Jul 30, 2017 at 12:40 PM, Andy Michielsen > wrote: >> Hi Maor, >> >> Thanks for pitching in. I have to admit it isn't really an oVirt issue but >> more on how to allow users working with it. >> >> I do use the pool methode to provide the virtual servers and dektops. >> For developers and support services I just let them use rdp for windows or >> even virt-viewer but for giving demo's or education I would like to provide >> something like thinclients or boot from usb linux solution who just start >> with firefox or virt-viewer. >> >> All idea's and suggestions are welcome. >> >> Thanks. >> >>> Op 30 jul. 2017 om 10:32 heeft Maor Lipchuk het >>> volgende geschreven: >>> >>> Hi Andy, >>> >>> Can you please elaborate more regarding the requirements and what you >>> are trying to achieve. >>> Have you tried to use vm-pool? Those VMs should be configured as >>> stateless and acquire minimal storage capacity. >>> >>> Regards, >>> Maor >>> >>> On Fri, Jul 28, 2017 at 10:19 PM, Andy Michielsen >>> wrote: Hello all, Don't know if this is the right place to ask this but I would like to set up a trainingslab with oVirt. I have deployed an engine and a host with local storage and want to run 1 server and 5 desktops off it. But the desktops will be used on thin clients or old laptops with some minimal os installation running spice client or a webbrowser. I was wondering if anyone can give me pointer in how to set up a minimal laptop which only need to run an spice client. Kind regards. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Hosted Engine increase memory
I believe it depends on the version of Ovirt that you use, the Yanir solution can be relevant only for the 3.5 version. Started from version 3.6 you can edit HE VM memory via UI without any troubles, the only thing that you must be aware of under 4.1 you will need to wait for some time, until the engine update HE VM OVF file(in 4.2 you do not need to wait). 1. Enable global maintenance 2. To reduce wait time you can change # engine-config OvfUpdateIntervalInMinutes=1 && systemctl restart ovirt-engine 3. Change HE VM memory via UI and wait for 1-2 minutes 4. Change OvfUpdateIntervalInMinutes parameter to default value 5. Restart HE VM # hosted-engine --vm-poweroff && hosted-engine --vm-start 6. Disable global maintenance In 4.2 you do not need to apply steps 2-4 Best Regards On Sun, Jul 30, 2017 at 11:25 AM, Yanir Quinn wrote: > Hi, > In order to increase the memory allocation or the cpu cores of the hosted > engine VM, the VM must be brought down and the vm.conf configuration file > must be edited on every hypervisor: > > Set global maintenance mode from the hypervisor the VM is currently > running on: > # hosted-engine --set-maintenance --mode=global > > Cleanly shutdown the engine VM: > # hosted-engine --vm-shutdown > Makes sure the VM is Down and not 'Powering Off' before proceeding: > # hosted-engine --vm-status > Edit /etc/ovirt-hosted-engine/vm.conf on *each* hypervisor, and change these > lines to whatever amount of RAM in MB / CPU cores you wish the VM to have: > > memSize=4096 > smp=1 *smp = number of virtual cores* > > Start the VM again:# hosted-engine --vm-start > And take it out of maintenance mode: > # hosted-engine --set-maintenance --mode=none > > Regards, > Yanir Quinn > > > On Sat, Jul 29, 2017 at 1:36 AM, gregor wrote: > >> Hi, >> >> is it possible to increase the memory of an hosted engine after the >> installation? >> >> cheers >> gregor >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> > > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Deploying training lab
What about ovirt-live? http://www.ovirt.org/download/ovirt-live/ On Sun, Jul 30, 2017 at 12:40 PM, Andy Michielsen wrote: > Hi Maor, > > Thanks for pitching in. I have to admit it isn't really an oVirt issue but > more on how to allow users working with it. > > I do use the pool methode to provide the virtual servers and dektops. > For developers and support services I just let them use rdp for windows or > even virt-viewer but for giving demo's or education I would like to provide > something like thinclients or boot from usb linux solution who just start > with firefox or virt-viewer. > > All idea's and suggestions are welcome. > > Thanks. > >> Op 30 jul. 2017 om 10:32 heeft Maor Lipchuk het >> volgende geschreven: >> >> Hi Andy, >> >> Can you please elaborate more regarding the requirements and what you >> are trying to achieve. >> Have you tried to use vm-pool? Those VMs should be configured as >> stateless and acquire minimal storage capacity. >> >> Regards, >> Maor >> >> On Fri, Jul 28, 2017 at 10:19 PM, Andy Michielsen >> wrote: >>> Hello all, >>> >>> Don't know if this is the right place to ask this but I would like to set up >>> a trainingslab with oVirt. >>> >>> I have deployed an engine and a host with local storage and want to run 1 >>> server and 5 desktops off it. >>> >>> But the desktops will be used on thin clients or old laptops with some >>> minimal os installation running spice client or a webbrowser. >>> >>> I was wondering if anyone can give me pointer in how to set up a minimal >>> laptop which only need to run an spice client. >>> >>> Kind regards. >>> >>> ___ >>> Users mailing list >>> Users@ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/users >>> ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] problem while moving/copying disks: vdsm low level image copy failed
Hello, We get this error message while moving or copying some of the disks on our main cluster running 4.1.2 on centos7 This is shown in the engine: VDSM vbgkvm02 command HSMGetAllTasksStatusesVDS failed: low level Image copy failed I can copy it inside the host. And i can use dd to copy. Haven't tried to run qemu-img manually yet. This is from vdsm.log on the host: 2017-07-28 09:07:22,741+0200 ERROR (tasks/6) [root] Job u'c82d4c53- 3eb4-405e-a2d5-c4c77519360e' failed (jobs:217) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/jobs.py", line 154, in run self._run() File "/usr/share/vdsm/storage/sdm/api/copy_data.py", line 88, in _run self._operation.wait_for_completion() File "/usr/lib/python2.7/site-packages/vdsm/qemuimg.py", line 329, in wait_for_completion self.poll(timeout) File "/usr/lib/python2.7/site-packages/vdsm/qemuimg.py", line 324, in poll self.error) QImgError: cmd=['/usr/bin/taskset', '--cpu-list', '0-15', '/usr/bin/nice', '-n', '19', '/usr/bin/ionice', '-c', '3', '/usr/bin/qemu-img', 'convert', '-p', '-t', 'none', '-T', 'none', '-f', 'raw', u'/rhev/data-center/mnt/glusterSD/vbgsan02:_fs02/0924ff77-ef51- 43 5b-b90d-50bfbf2e8de7/images/750f4184-b852-4b00-94fc- 476f3f5b93c7/3fe43487-3302-4b34-865a-07c5c6aedbf2', '-O', 'raw', u'/rhev/data-center/mnt/glusterSD/10.137.30.105:_fs03/5d47a297-a21f- 4587-bb7c-dd00d52010d5/images/750f4184-b852-4b00-94fc- 476f3f5b93c7/3fe43487-3302-4b34-865 a-07c5c6aedbf2'], ecode=1, stdout=, stderr=qemu-img: error while reading sector 12197886: No data available , message=None The storage domains are all based on gluster. The storage domains that we see this on is configured as dispersed volumes. Found a way to "fix" the problem. And that is to run dd if=/dev/vda of=/dev/null bs=1M inside the virtual guest. After that we can copy an image or use storage livemigration. Is this a gluster problem or an vdsm problem? Or could it be something with qemu-img? /Johan ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Deploying training lab
Hi Maor, Thanks for pitching in. I have to admit it isn't really an oVirt issue but more on how to allow users working with it. I do use the pool methode to provide the virtual servers and dektops. For developers and support services I just let them use rdp for windows or even virt-viewer but for giving demo's or education I would like to provide something like thinclients or boot from usb linux solution who just start with firefox or virt-viewer. All idea's and suggestions are welcome. Thanks. > Op 30 jul. 2017 om 10:32 heeft Maor Lipchuk het > volgende geschreven: > > Hi Andy, > > Can you please elaborate more regarding the requirements and what you > are trying to achieve. > Have you tried to use vm-pool? Those VMs should be configured as > stateless and acquire minimal storage capacity. > > Regards, > Maor > > On Fri, Jul 28, 2017 at 10:19 PM, Andy Michielsen > wrote: >> Hello all, >> >> Don't know if this is the right place to ask this but I would like to set up >> a trainingslab with oVirt. >> >> I have deployed an engine and a host with local storage and want to run 1 >> server and 5 desktops off it. >> >> But the desktops will be used on thin clients or old laptops with some >> minimal os installation running spice client or a webbrowser. >> >> I was wondering if anyone can give me pointer in how to set up a minimal >> laptop which only need to run an spice client. >> >> Kind regards. >> >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] sanlock ids file broken after server crash
(First reply did not get to the list) From sanlock.log: 2017-07-30 10:49:31+0200 1766275 [1171]: s310751 lockspace 0924ff77- ef51-435b-b90d-50bfbf2e8de7:1:/rhev/data- center/mnt/glusterSD/vbgsan02:_fs02/0924ff77-ef51-435b-b90d- 50bfbf2e8de7/dom_md/ids:0 2017-07-30 10:49:31+0200 1766275 [10496]: verify_leader 1 wrong space name 0924ff77-ef51-435b-b90d-50bfbf2eke7 0924ff77-ef51-435b-b90d- 50bfbf2e8de7 /rhev/data-center/mnt/glusterSD/vbgsan02:_fs02/0924ff77- ef51-435b-b90d-50bfbf2e8de7/dom_md/ids 2017-07-30 10:49:31+0200 1766275 [10496]: leader1 delta_acquire_begin error -226 lockspace 0924ff77-ef51-435b-b90d-50bfbf2e8de7 host_id 1 2017-07-30 10:49:31+0200 1766275 [10496]: leader2 path /rhev/data- center/mnt/glusterSD/vbgsan02:_fs02/0924ff77-ef51-435b-b90d- 50bfbf2e8de7/dom_md/ids offset 0 2017-07-30 10:49:31+0200 1766275 [10496]: leader3 m 12212010 v 30003 ss 512 nh 0 mh 4076 oi 1 og 2031079063 lv 0 2017-07-30 10:49:31+0200 1766275 [10496]: leader4 sn 0924ff77-ef51- 435b-b90d-50bfbf2eke7 rn <93>7^\afa5-3a91-415b-a04c- 221d3e060163.vbgkvm01.a ts 4351980 cs eefa4dd7 2017-07-30 10:49:32+0200 1766276 [1171]: s310751 add_lockspace fail result -226 vdsm logs doesnt have any errors and engine.log does not have any errors. And if i check the ids file manually. I can see that everything in it is correct except for the first host in the cluster where the space name and host id is broken. /Johan On Sun, 2017-07-30 at 11:18 +0300, Maor Lipchuk wrote: > Hi Johan, > > Can you please share the vdsm and engine logs. > > Also, it won't harm to also get the sanlock logs just in case sanlock > was configured to save all debugging in a log file (see > http://people.redhat.com/teigland/sanlock-messages.txt)). > Try to share the sanlock ouput by running 'sanlock client status', > 'sanlock client log_dump'. > > Regards, > Maor > > On Thu, Jul 27, 2017 at 6:18 PM, Johan Bernhardsson > wrote: > > > > Hello, > > > > The ids file for sanlock is broken on one setup. The first host id > > in > > the file is wrong. > > > > From the logfile i have: > > > > verify_leader 1 wrong space name 0924ff77-ef51-435b-b90d- > > 50bfbf2e�ke7 > > 0924ff77-ef51-435b-b90d-50bfbf2e8de7 /rhev/data- > > center/mnt/glusterSD/ > > > > > > > > Note the broken char in the space name. > > > > This also apears. And it seams as the hostid too is broken in the > > ids > > file: > > > > leader4 sn 0924ff77-ef51-435b-b90d-50bfbf2e�ke7 rn ��7 afa5-3a91- > > 415b- > > a04c-221d3e060163.vbgkvm01.a ts 4351980 cs eefa4dd7 > > > > Note the broken chars there as well. > > > > If i check the ids file with less or strings the first row where my > > vbgkvm01 host are. That has broken chars. > > > > Can this be repaired in some way without taking down all the > > virtual > > machines on that storage? > > > > > > /Johan > > ___ > > Users mailing list > > Users@ovirt.org > > http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Yum error while installing host on Centos7
Might be a selinux related issue, similar threads suggest either to disable selinux completely or run on host: # setenforce 0 # yum clean expire-cache # yum update selinux-policy\* # setenforce 1 keeping an eye out for other reasons/solutions. Regards, Yanir Quinn On Thu, Jul 27, 2017 at 5:32 PM, Iurcev, Massimiliano wrote: > I installed ovirt-engine on Centos7. My target is to have a single host > machine. > During the installation of the (first and unique) host, I get an error: > > Failed to install Host . Yum Non-fatal POSTIN scriptlet failure in rpm > package gtk2-2.24.28-8.el7.x86_64. > > This error is followed by other errors: > > Failed to install Host . Failed to execute stage 'Package > installation': One or more elements within Yum transaction failed. > > and finally: > Host installation failed. Command returned failure code 1 during SSH > session 'r...@.mydomain.it'. > > All other libraries are yum-installed without problems. > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] ovirt and mixed selinux
As far as it goes for RHEV: - Virtual machine migration will fail if migrating from a hypervisor with SELinux enabled to one with SELinux disabled - A virtual machine previously started on a hypervisor with SELinux enabled will not start on a hypervisor with SELinux disable. RHEV manages the SELinux configuration on RHEV Hypervisors in a persistent state, SELinux is enabled by default. You'll need to run sestatus as a superuser on each host in the cluster and observe the output, evaluate each host in the cluster to make sure the setting for "SELinux status" is consistent. Regards, Yanir Quinn On Sat, Jul 29, 2017 at 12:21 AM, Bill James wrote: > I was hoping to migrate my systems to using selinux gradually. > I added 3 new nodes with selinux in permissive mode. > Migration fails to any of the previous hosts that currently have selinux > disabled. > Is it an all or nothing deal? Obviously not easy to reboot all nodes at > once. > > 2017-07-28 09:35:43,616 ERROR (migsrc/8c566813) [virt.vm] > (vmId='8c566813-4bee-4f04-be23-c9fc10e1e1f2') unsupported configuration: > Unable to find security driver for model selinux (migration:265) > 2017-07-28 09:35:43,641 ERROR (migsrc/8c566813) [virt.vm] > (vmId='8c566813-4bee-4f04-be23-c9fc10e1e1f2') Failed to migrate > (migration:405) > Traceback (most recent call last): > > > ovirt-engine-4.1.0.4-1.el7.centos.noarch > libselinux-utils-2.5-6.el7.x86_64 > > > related: http://lists.ovirt.org/pipermail/users/2016-October/076878.html > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Deploying training lab
Hi Andy, Can you please elaborate more regarding the requirements and what you are trying to achieve. Have you tried to use vm-pool? Those VMs should be configured as stateless and acquire minimal storage capacity. Regards, Maor On Fri, Jul 28, 2017 at 10:19 PM, Andy Michielsen wrote: > Hello all, > > Don't know if this is the right place to ask this but I would like to set up > a trainingslab with oVirt. > > I have deployed an engine and a host with local storage and want to run 1 > server and 5 desktops off it. > > But the desktops will be used on thin clients or old laptops with some > minimal os installation running spice client or a webbrowser. > > I was wondering if anyone can give me pointer in how to set up a minimal > laptop which only need to run an spice client. > > Kind regards. > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Hosted Engine increase memory
Hi, In order to increase the memory allocation or the cpu cores of the hosted engine VM, the VM must be brought down and the vm.conf configuration file must be edited on every hypervisor: Set global maintenance mode from the hypervisor the VM is currently running on: # hosted-engine --set-maintenance --mode=global Cleanly shutdown the engine VM: # hosted-engine --vm-shutdown Makes sure the VM is Down and not 'Powering Off' before proceeding: # hosted-engine --vm-status Edit /etc/ovirt-hosted-engine/vm.conf on *each* hypervisor, and change these lines to whatever amount of RAM in MB / CPU cores you wish the VM to have: memSize=4096 smp=1 *smp = number of virtual cores* Start the VM again:# hosted-engine --vm-start And take it out of maintenance mode: # hosted-engine --set-maintenance --mode=none Regards, Yanir Quinn On Sat, Jul 29, 2017 at 1:36 AM, gregor wrote: > Hi, > > is it possible to increase the memory of an hosted engine after the > installation? > > cheers > gregor > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] sanlock ids file broken after server crash
Hi Johan, Can you please share the vdsm and engine logs. Also, it won't harm to also get the sanlock logs just in case sanlock was configured to save all debugging in a log file (see http://people.redhat.com/teigland/sanlock-messages.txt)). Try to share the sanlock ouput by running 'sanlock client status', 'sanlock client log_dump'. Regards, Maor On Thu, Jul 27, 2017 at 6:18 PM, Johan Bernhardsson wrote: > Hello, > > The ids file for sanlock is broken on one setup. The first host id in > the file is wrong. > > From the logfile i have: > > verify_leader 1 wrong space name 0924ff77-ef51-435b-b90d-50bfbf2e�ke7 > 0924ff77-ef51-435b-b90d-50bfbf2e8de7 /rhev/data-center/mnt/glusterSD/ > > > > Note the broken char in the space name. > > This also apears. And it seams as the hostid too is broken in the ids > file: > > leader4 sn 0924ff77-ef51-435b-b90d-50bfbf2e�ke7 rn ��7 afa5-3a91-415b- > a04c-221d3e060163.vbgkvm01.a ts 4351980 cs eefa4dd7 > > Note the broken chars there as well. > > If i check the ids file with less or strings the first row where my > vbgkvm01 host are. That has broken chars. > > Can this be repaired in some way without taking down all the virtual > machines on that storage? > > > /Johan > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] supervdsmd IOError to /dev/stdout
On Fri, Jul 28, 2017 at 8:37 PM, Richard Chan wrote: > After an upgrade to 4.0 I have a single host that cannot start supervdsmd > because of IOError on /dev/stdout. All other hosts upgraded correctly. > Upgrade from which version? 3.6? Did you stay on 4.0 or continued to 4.1? > > In the systemd unit I have to hack StandardOutput=null. > > Any thing I have overlooked? The hosts are all identical and it is just > this one > that has this weird behaviour. > Any logs that you can share? Y. > > -- > Richard Chan > > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
