Artur, could you please add some additional logging into the engine HTTP client to find out why apache-http-client complains about the certificate?
Thanks, Martin On Wed, Jul 15, 2020 at 9:43 AM Yedidyah Bar David <d...@redhat.com> wrote: > On Thu, Jul 9, 2020 at 12:32 PM Marcin Sobczyk <msobc...@redhat.com> > wrote: > > > > Hi, > > > > On 7/8/20 3:34 PM, Yedidyah Bar David wrote: > > > Did you also get in engine.log > "javax.net.ssl.SSLPeerUnverifiedException"? > > I was also able to reproduce this on my server, but I'm baffled by this > > one... > > I enabled debug logs on the engine with [1] and got this stack trace [2], > > but the certs seem ok to me: > > > > 1. I verified the hostname in the certificate by running on the host: > > > > openssl s_client \ > > -connect 127.0.0.1:54321 \ > > -CAfile /etc/pki/vdsm/certs/cacert.pem \ > > -cert /etc/pki/vdsm/certs/vdsmcert.pem \ > > -key /etc/pki/vdsm/keys/vdsmkey.pem \ > > -verify_hostname lago-he-basic-suite-master-host-0.lago.local > > > > 2. curl is also happy: > > > > curl \ > > --cacert /etc/pki/vdsm/certs/cacert.pem \ > > --cert /etc/pki/vdsm/certs/vdsmcert.pem \ > > --key /etc/pki/vdsm/keys/vdsmkey.pem \ > > https://lago-he-basic-suite-master-host-0.lago.local:54321 > > > > 3. on the hosted engine there is proper entry in '/etc/hosts': > > > > [root@lago-he-basic-suite-master-engine certs]# cat /etc/hosts > > 127.0.0.1 localhost localhost.localdomain localhost4 > > localhost4.localdomain4 > > ::1 localhost localhost.localdomain localhost6 > > localhost6.localdomain6 > > 192.168.200.3 lago-he-basic-suite-master-host-0.lago.local > > 192.168.222.76 lago-he-basic-suite-master-engine.lago.local # > > hosted-engine-setup-/var/tmp/localvm9k3eqtf7 > > > > 4. and dig -x seems to resolve properly: > > > > [root@lago-he-basic-suite-master-engine certs]# dig +short -x > 192.168.200.3 > > lago-he-basic-suite-master-host-0.lago.local. > > > > If anyone else has some ideas what else could be checked then please > > ping me. > > > > Marcin > > > > [1] https://gerrit.ovirt.org/110211 > > [2] http://pastebin.test.redhat.com/882851 > > > > > > > > On Wed, Jul 8, 2020 at 4:25 PM Artem Hrechanychenko < > ahrec...@redhat.com> wrote: > > >> Reproduced locally without using Jenkins > > >> > > >>> [ INFO ] TASK [ovirt.hosted_engine_setup : Add HE disks] > > >>> [ ERROR ] {'msg': 'Timeout exceed while waiting on result state of > the entity.', 'exception': 'Traceback (most recent call last):\n File > "/tmp/ansible_ovirt_disk_28_payload_vtqyyibx/ansible_ovirt_disk_28_payload.zip/ansible/modules/ovirt_disk_28.py", > line 678, in main\n File > "/tmp/ansible_ovirt_disk_28_payload_vtqyyibx/ansible_ovirt_disk_28_payload.zip/ansible/module_utils/ovirt.py", > line 646, in create\n > poll_interval=self._module.params[\'poll_interval\'],\n File > "/tmp/ansible_ovirt_disk_28_payload_vtqyyibx/ansible_ovirt_disk_28_payload.zip/ansible/module_utils/ovirt.py", > line 364, in wait\n raise Exception("Timeout exceed while waiting on > result state of the entity.")\nException: Timeout exceed while waiting on > result state of the entity.\n', 'failed': True, 'invocation': > {'module_args': {'name': 'HostedEngineConfigurationImage', 'size': '1GiB', > 'format': 'raw', 'sparse': False, 'description': 'Hosted-Engine > configuration disk', 'content_type': 'hosted_engine_configuration', > 'interface': 'virtio', 'storage_domain': 'hosted_storage', 'wait': True, > 'timeout': 600, 'auth': {'token': > 'rAqX1OJIbJyMrA1aWVR-AR54T2lsiBbalN80dWugpfHFBqwiCe4rz3porngvlFSE90k-FEqagPPFboU6ew1hPw', > 'url': ' > https://lago-he-basic-suite-master-engine.lago.local/ovirt-engine/api', > 'ca_file': None, 'insecure': True, 'timeout': 0, 'compress': True, > 'kerberos': False, 'headers': None}, 'poll_interval': 3, 'fetch_nested': > False, 'nested_attributes': [], 'state': 'present', 'force': False, 'id': > None, 'vm_name': None, 'vm_id': None, 'storage_domains': None, 'profile': > None, 'quota_id': None, 'bootable': None, 'shareable': None, > 'logical_unit': None, 'download_image_path': None, 'upload_image_path': > None, 'sparsify': None, 'openstack_volume_type': None, 'image_provider': > None, 'host': None, 'wipe_after_delete': None, 'activate': None}}, > '_ansible_no_log': False, 'changed': False, 'item': {'name': > 'HostedEngineConfigurationImage', 'description': 'Hosted-Engine > configuration disk', 'size': '1GiB', 'format': 'raw', 'sparse': False, > 'content': 'hosted_engine_configuration'}, 'ansible_loop_var': 'item', > '_ansible_item_label': {'name': 'HostedEngineConfigurationImage', > 'description': 'Hosted-Engine configuration disk', 'size': '1GiB', > 'format': 'raw', 'sparse': False, 'content': 'hosted_engine_configuration'}} > > >> > > >> On Tue, Jul 7, 2020 at 4:22 PM Martin Perina <mper...@redhat.com> > wrote: > > >>> Hi, > > >>> > > >>> I'm not aware of change regarding certificates recently. So is this > error reproducible outside Jenkins? Or even better is it reproducible on > some easier flow other than HE installation so we can debug what > certificate is loaded in VDSM? > > It (or probably something similar) was now reported also on users@, see > thread: > > [ovirt-users] Ovirt 4.4.1 Install failure at OVF_Store check > > I now checked again latest he-basic failure, and noticed this, right > before the error: > > 2020-07-14 22:57:03,197-04 INFO > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] > (default task-1) [4abbccc] EVENT_ID: USER_VDC_LOGOUT(31), User > admin@internal-authz connected from '192.168.222.1' using session > > 'W5qdcPNyRLHmMnbMz7i+ZP85De1GjKq7+V1hqbKEeD+QJtpcFGpITEVFIHbUvz+2wF+GTAB6qnCY1gHxBHkGLA==' > logged out. > 2020-07-14 22:57:03,242-04 ERROR > [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-29) > [313eed07] Command 'UploadStreamVDSCommand(HostName = > lago-he-basic-suite-master-host-0.lago.local, > > UploadStreamVDSCommandParameters:{hostId='c6d33fd9-5137-49fc-815a-94baf2d58b93'})' > execution failed: javax.net.ssl.SSLPeerUnverifiedException: > Certificate for <lago-he-basic-suite-master-host-0.lago.local> doesn't > match any of the subject alternative names: > [lago-he-basic-suite-master-host-0.lago.local] > > Meaning - user was logged out, and probably on re-login attempt > failed. Still not sure why, will look later. > > > >>> > > >>> Thanks, > > >>> Martin > > >>> > > >>> On Tue, Jul 7, 2020 at 2:07 PM Yedidyah Bar David <d...@redhat.com> > wrote: > > >>>> On Tue, Jul 7, 2020 at 12:50 PM Yedidyah Bar David <d...@redhat.com> > wrote: > > >>>>> On Wed, Jun 24, 2020 at 2:14 PM Evgeny Slutsky < > eslut...@redhat.com> wrote: > > >>>>>> Hi, > > >>>>>> changing the hostname to include also the domain name fixed the > cert deployment issue: > > >>>>>> https://gerrit.ovirt.org/#/c/109842/ > > >>>>>> > > >>>>>> not sure how it affects the engine certificate content. > > >>>>>> from my offline discussion with @Martin Perina this was that > change that could cause it: > > >>>>>> https://gerrit.ovirt.org/#/c/109636/ > > >>>>>> > > >>>>>> any thoughts? > > >>>>> Above two patches are merged, but we still fail the same way: > > >>>>> > > >>>>> > https://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/1664/ > > >>>>> > > >>>>> > https://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/1664/artifact/exported-artifacts/test_logs/he-basic-suite-master/post-he_deploy/lago-he-basic-suite-master-host-0/_var_log/ovirt-hosted-engine-setup/engine-logs-2020-07-07T03%3A15%3A01Z/ovirt-engine/engine.log > > >>>>> > > >>>>> 2020-07-06 23:04:25,555-04 ERROR > > >>>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-38) > > >>>>> [fb28ce9] Command 'UploadStreamVDSCommand(HostName = > > >>>>> lago-he-basic-suite-master-host-0.lago.local, > > >>>>> > UploadStreamVDSCommandParameters:{hostId='e096650f-a7d6-4383-b1bb-f2e61327aac0'})' > > >>>>> execution failed: javax.net.ssl.SSLPeerUnverifiedException: > > >>>>> Certificate for <lago-he-basic-suite-master-host-0.lago.local> > doesn't > > >>>>> match any of the subject alternative names: > > >>>>> [lago-he-basic-suite-master-host-0.lago.local] > > >>>>> > > >>>>> Any idea? > > >>>> And I now see this is indeed what's failing hosted-engine deploy at: > > >>>> > > >>>> 2020-07-07 05:51:58,573-0400 INFO ansible task start {'status': > 'OK', > > >>>> 'ansible_type': 'task', 'ansible_playbook': > > >>>> '/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml', > > >>>> 'ansible_task': 'ovirt.hosted_engine_setup : Check OVF_STORE volume > > >>>> status'} > > >>>> > > >>>> (See other thread: [oVirt Jenkins] > > >>>> ovirt-system-tests_he-basic-suite-master - Build # 1655 - Still > > >>>> Failing! ) > > >>>> > > >>>> On a successful run, engine.log has: > > >>>> > > >>>> 2020-07-02 18:01:55,527+03 INFO > > >>>> > [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStorageDomainCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] Running command: > ProcessOvfUpdateForStorageDomainCommand > > >>>> internal: true. Entities affected : ID: > > >>>> e102d7b5-1a37-490f-a3e7-20e56c37791f Type: StorageAction group > > >>>> MANIPULATE_STORAG > > >>>> E_DOMAIN with role type ADMIN > > >>>> 2020-07-02 18:01:55,607+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8 > > >>>> ] START, SetVolumeDescriptionVDSCommand( > > >>>> > SetVolumeDescriptionVDSCommandParameters:{storagePoolId='b9dccefe-bc61-11ea-8ebe-001a4a231728', > > >>>> ignoreFailoverLimit='false', storageDomainId='e102d7b > > >>>> 5-1a37-490f-a3e7-20e56c37791f', > > >>>> imageGroupId='db934a98-4111-4faf-8cb9-6b36928cd61c', > > >>>> imageId='f898c40e-1f88-48db-b59b-f2c73162ddb7'}), log id: e203e51 > > >>>> 2020-07-02 18:01:55,609+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8 > > >>>> ] -- executeIrsBrokerCommand: calling 'setVolumeDescription', > parameters: > > >>>> 2020-07-02 18:01:55,609+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8 > > >>>> ] ++ spUUID=b9dccefe-bc61-11ea-8ebe-001a4a231728 > > >>>> 2020-07-02 18:01:55,609+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8 > > >>>> ] ++ sdUUID=e102d7b5-1a37-490f-a3e7-20e56c37791f > > >>>> 2020-07-02 18:01:55,609+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8 > > >>>> ] ++ imageGroupGUID=db934a98-4111-4faf-8cb9-6b36928cd61c > > >>>> 2020-07-02 18:01:55,610+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8 > > >>>> ] ++ volUUID=f898c40e-1f88-48db-b59b-f2c73162ddb7 > > >>>> 2020-07-02 18:01:55,610+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8 > > >>>> ] ++ description={"Updated":false,"Last Updated":"Thu Jul 02 > 17:35:07 > > >>>> IDT 2020","Storage > > >>>> Domains":[{"uuid":"e102d7b5-1a37-490f-a3e7-20e56c37791f"}],"Disk > > >>>> Description":"OVF_STORE"} > > >>>> 2020-07-02 18:01:55,717+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8 > > >>>> ] FINISH, SetVolumeDescriptionVDSCommand, return: , log id: e203e51 > > >>>> 2020-07-02 18:01:55,829+03 INFO > > >>>> [org.ovirt.engine.core.bll.storage.ovfstore.UploadStreamCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] Lock Acq > > >>>> uired to object 'EngineLock:{exclusiveLocks='', > > >>>> sharedLocks='[a4fc6701-e2c7-4770-896a-d0ee74f9c7b8=VDS_EXECUTION]'}' > > >>>> 2020-07-02 18:01:55,912+03 INFO > > >>>> [org.ovirt.engine.core.bll.storage.ovfstore.UploadStreamCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] Running > > >>>> command: UploadStreamCommand internal: true. Entities affected : > ID: > > >>>> e102d7b5-1a37-490f-a3e7-20e56c37791f Type: Storage > > >>>> 2020-07-02 18:01:55,914+03 INFO > > >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] START, > > >>>> UploadStreamVDSCommand(HostName = > > >>>> didi-centos8-host.lab.eng.tlv2.redhat.com, > > >>>> > UploadStreamVDSCommandParameters:{hostId='a4fc6701-e2c7-4770-896a-d0ee74f9c7b8'}), > > >>>> log id: 674791e5 > > >>>> 2020-07-02 18:01:55,914+03 INFO > > >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] -- exe > > >>>> cuteVdsBrokerCommand, parameters: > > >>>> 2020-07-02 18:01:55,914+03 INFO > > >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] ++ spU > > >>>> UID=b9dccefe-bc61-11ea-8ebe-001a4a231728 > > >>>> 2020-07-02 18:01:55,914+03 INFO > > >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] ++ sdU > > >>>> UID=e102d7b5-1a37-490f-a3e7-20e56c37791f > > >>>> 2020-07-02 18:01:55,914+03 INFO > > >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] ++ ima > > >>>> geGUID=db934a98-4111-4faf-8cb9-6b36928cd61c > > >>>> 2020-07-02 18:01:55,914+03 INFO > > >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] ++ vol > > >>>> UUID=f898c40e-1f88-48db-b59b-f2c73162ddb7 > > >>>> 2020-07-02 18:01:55,914+03 INFO > > >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] ++ siz > > >>>> e=23552 > > >>>> 2020-07-02 18:01:56,419+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand]Signed-off-by: > Marcin Sobczyk <msobc...@redhat.com> > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] FINISH > > >>>> , UploadStreamVDSCommand, return: , log id: 674791e5 > > >>>> 2020-07-02 18:01:58,732+03 INFO > > >>>> [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] CommandAsyncTask::Adding CommandMultiAsyncTasks object > for > > >>>> command 'ed1ff9b8-8cfd-489b-9cad-f078029a3cc1' > > >>>> 2020-07-02 18:01:58,732+03 INFO > > >>>> [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] CommandMultiAsyncTasks::attachTask: Attaching task > > >>>> '997accaf-aa33-4632-a0bf-24d59a637255' to command > > >>>> 'ed1ff9b8-8cfd-489b-9cad-f078029a3cc1'. > > >>>> 2020-07-02 18:01:58,937+03 INFO > > >>>> [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] Adding task '997accaf-aa33-4632-a0bf-24d59a637255' > (Parent > > >>>> Command 'UploadStream', Parameters Type > > >>>> 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters'), > > >>>> polling hasn't started yet.. > > >>>> 2020-07-02 18:01:58,963+03 INFO > > >>>> [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] BaseAsyncTask::startPollingTask: Starting to poll task > > >>>> '997accaf-aa33-4632-a0bf-24d59a637255'. > > >>>> 2020-07-02 18:01:58,973+03 INFO > > >>>> [org.ovirt.engine.core.bll.storage.ovfstore.UploadStreamCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] Lock freed to object 'EngineLock:{exclusiveLocks='', > > >>>> sharedLocks='[a4fc6701-e2c7-4770-896a-d0ee74f9c7b8=VDS_EXECUTION]'}' > > >>>> 2020-07-02 18:01:58,979+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] START, SetVolumeDescriptionVDSCommand( > > >>>> > SetVolumeDescriptionVDSCommandParameters:{storagePoolId='b9dccefe-bc61-11ea-8ebe-001a4a231728', > > >>>> ignoreFailoverLimit='false', > > >>>> storageDomainId='e102d7b5-1a37-490f-a3e7-20e56c37791f', > > >>>> imageGroupId='db934a98-4111-4faf-8cb9-6b36928cd61c', > > >>>> imageId='f898c40e-1f88-48db-b59b-f2c73162ddb7'}), log id: 5cea0ad3 > > >>>> 2020-07-02 18:01:58,979+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] -- executeIrsBrokerCommand: calling > 'setVolumeDescription', > > >>>> parameters: > > >>>> 2020-07-02 18:01:58,979+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] ++ spUUID=b9dccefe-bc61-11ea-8ebe-001a4a231728 > > >>>> 2020-07-02 18:01:58,980+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] ++ sdUUID=e102d7b5-1a37-490f-a3e7-20e56c37791f > > >>>> 2020-07-02 18:01:58,980+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] ++ imageGroupGUID=db934a98-4111-4faf-8cb9-6b36928cd61c > > >>>> 2020-07-02 18:01:58,980+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] ++ volUUID=f898c40e-1f88-48db-b59b-f2c73162ddb7 > > >>>> 2020-07-02 18:01:58,980+03 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-84) > > >>>> [2b0721d8] ++ description={"Updated":true,"Size":23552,"Last > > >>>> Updated":"Thu Jul 02 18:01:55 IDT 2020","Storage > > >>>> Domains":[{"uuid":"e102d7b5-1a37-490f-a3e7-20e56c37791f"}],"Disk > > >>>> Description":"OVF_STORE"} > > >>>> > > >>>> This ('"Updated":true') is what our ansible code looks for. > > >>>> > > >>>> In a failed run, e.g. > > >>>> > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/10162/artifact/check-patch.he-basic_suite_master.el8.x86_64/test_logs/he-basic-suite-master/post-he_deploy/lago-he-basic-suite-master-host-0/_var_log/ovirt-hosted-engine-setup/engine-logs-2020-07-07T09%3A56%3A20Z/ovirt-engine/engine.log > > >>>> : > > >>>> > > >>>> 2020-07-07 05:51:53,662-04 INFO > > >>>> > [org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStorageDomainCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] Running command: ProcessOvfUpdateForStorageDomainCommand > > >>>> internal: true. Entities affected : ID: > > >>>> 812ecaaa-1227-46f9-92d6-634f6a34a943 Type: StorageAction group > > >>>> MANIPULATE_STORAGE_DOMAIN with role type ADMIN > > >>>> 2020-07-07 05:51:53,686-04 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] START, SetVolumeDescriptionVDSCommand( > > >>>> > SetVolumeDescriptionVDSCommandParameters:{storagePoolId='b089490e-c035-11ea-a9e2-5452c0a8c863', > > >>>> ignoreFailoverLimit='false', > > >>>> storageDomainId='812ecaaa-1227-46f9-92d6-634f6a34a943', > > >>>> imageGroupId='33dcdbdd-cc35-403a-9855-7d2eb1176a31', > > >>>> imageId='7f6b26c9-3eb8-4c58-9627-37b411cb46bd'}), log id: 12e48aac > > >>>> 2020-07-07 05:51:53,686-04 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] -- executeIrsBrokerCommand: calling > 'setVolumeDescription', > > >>>> parameters: > > >>>> 2020-07-07 05:51:53,687-04 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] ++ spUUID=b089490e-c035-11ea-a9e2-5452c0a8c863 > > >>>> 2020-07-07 05:51:53,687-04 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] ++ sdUUID=812ecaaa-1227-46f9-92d6-634f6a34a943 > > >>>> 2020-07-07 05:51:53,687-04 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] ++ imageGroupGUID=33dcdbdd-cc35-403a-9855-7d2eb1176a31 > > >>>> 2020-07-07 05:51:53,687-04 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] ++ volUUID=7f6b26c9-3eb8-4c58-9627-37b411cb46bd > > >>>> 2020-07-07 05:51:53,687-04 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] ++ description={"Updated":false,"Last > Updated":null,"Storage > > >>>> Domains":[{"uuid":"812ecaaa-1227-46f9-92d6-634f6a34a943"}],"Disk > > >>>> Description":"OVF_STORE"} > > >>>> 2020-07-07 05:51:53,938-04 INFO > > >>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] FINISH, SetVolumeDescriptionVDSCommand, return: , log id: > > >>>> 12e48aac > > >>>> 2020-07-07 05:51:54,006-04 INFO > > >>>> [org.ovirt.engine.core.bll.storage.ovfstore.UploadStreamCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] Lock Acquired to object 'EngineLock:{exclusiveLocks='', > > >>>> sharedLocks='[0a166780-eb5b-46c2-a27f-df15d12594b5=VDS_EXECUTION]'}' > > >>>> 2020-07-07 05:51:54,066-04 INFO > > >>>> [org.ovirt.engine.core.bll.storage.ovfstore.UploadStreamCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] Running command: UploadStreamCommand internal: true. > > >>>> Entities affected : ID: 812ecaaa-1227-46f9-92d6-634f6a34a943 Type: > > >>>> Storage > > >>>> 2020-07-07 05:51:54,068-04 INFO > > >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] START, UploadStreamVDSCommand(HostName = > > >>>> lago-he-basic-suite-master-host-0.lago.local, > > >>>> > UploadStreamVDSCommandParameters:{hostId='0a166780-eb5b-46c2-a27f-df15d12594b5'}), > > >>>> log id: 2704d3cb > > >>>> 2020-07-07 05:51:54,068-04 INFO > > >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] -- executeVdsBrokerCommand, parameters: > > >>>> 2020-07-07 05:51:54,068-04 INFO > > >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] ++ spUUID=b089490e-c035-11ea-a9e2-5452c0a8c863 > > >>>> 2020-07-07 05:51:54,069-04 INFO > > >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] ++ sdUUID=812ecaaa-1227-46f9-92d6-634f6a34a943 > > >>>> 2020-07-07 05:51:54,069-04 INFO > > >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] ++ imageGUID=33dcdbdd-cc35-403a-9855-7d2eb1176a31 > > >>>> 2020-07-07 05:51:54,069-04 INFO > > >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] ++ volUUID=7f6b26c9-3eb8-4c58-9627-37b411cb46bd > > >>>> 2020-07-07 05:51:54,069-04 INFO > > >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] ++ size=23552 > > >>>> 2020-07-07 05:51:54,104-04 ERROR > > >>>> [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-78) > > >>>> [a0f7806] Command 'UploadStreamVDSCommand(HostName = > > >>>> lago-he-basic-suite-master-host-0.lago.local, > > >>>> > UploadStreamVDSCommandParameters:{hostId='0a166780-eb5b-46c2-a27f-df15d12594b5'})' > > >>>> execution failed: javax.net.ssl.SSLPeerUnverifiedException: > > >>>> Certificate for <lago-he-basic-suite-master-host-0.lago.local> > doesn't > > >>>> match any of the subject alternative names: > > >>>> [lago-he-basic-suite-master-host-0.lago.local] > > >>>> > > >>>> (The "successful" log before is from a local test with a > deliberately > > >>>> somewhat-old ovirt-engine-appliance-4.4-20200617065310.1.el8.x86_64 > > >>>> and with a patch to prevent engine-setup from updating the engine, > > >>>> https://gerrit.ovirt.org/109730 . Verifying this patch was the > reason > > >>>> to run it locally). > > >>>> > > >>>> Thanks and best regards, > > >>>> > > >>>>>> > > >>>>>> > > >>>>>> > > >>>>>> On Wed, Jun 17, 2020 at 9:32 AM Yedidyah Bar David < > d...@redhat.com> wrote: > > >>>>>>> On Wed, Jun 17, 2020 at 6:28 AM <jenk...@jenkins.phx.ovirt.org> > wrote: > > >>>>>>>> Project: > https://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/ > > >>>>>>>> Build: > https://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/1641/ > > >>>>>>> This one failed while trying to create the disk image for the > hosted-egnine VM: > > >>>>>>> > > >>>>>>> > https://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/1641/artifact/exported-artifacts/test_logs/he-basic-suite-master/post-he_deploy/lago-he-basic-suite-master-host-0/_var_log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-ansible-create_target_vm-20200616230220-yfumoc.log > > >>>>>>> : > > >>>>>>> > > >>>>>>> 2020-06-16 23:03:20,527-0400 INFO ansible task start {'status': > 'OK', > > >>>>>>> 'ansible_type': 'task', 'ansible_playbook': > > >>>>>>> '/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml', > > >>>>>>> 'ansible_task': 'ovirt.hosted_engine_setup : Add HE disks'} > > >>>>>>> ... > > >>>>>>> 2020-06-16 23:14:12,702-0400 DEBUG var changed: host "localhost" > var > > >>>>>>> "add_disks" type "<class 'dict'>" value: "{ > > >>>>>>> ... > > >>>>>>> "msg": "Timeout exceed while waiting on result > state of the entity." > > >>>>>>> > > >>>>>>> > https://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/1641/artifact/exported-artifacts/test_logs/he-basic-suite-master/post-he_deploy/lago-he-basic-suite-master-host-0/_var_log/ovirt-hosted-engine-setup/engine-logs-2020-06-17T03%3A14%3A18Z/ovirt-engine/engine.log > > >>>>>>> : > > >>>>>>> > > >>>>>>> 2020-06-16 23:03:22,612-04 INFO > > >>>>>>> [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (default > task-1) > > >>>>>>> [16c24599-0048-44eb-a410-d39b7ce98712] > > >>>>>>> CommandMultiAsyncTasks::attachTask: Attaching task > > >>>>>>> '6b2a7648-748c-430b-94b6-5e3f719df2ac' to command > > >>>>>>> 'fa81759d-c57a-4237-81e0-beb210faa64d'. > > >>>>>>> 2020-06-16 23:03:22,659-04 INFO > > >>>>>>> [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (default > task-1) > > >>>>>>> [16c24599-0048-44eb-a410-d39b7ce98712] Adding task > > >>>>>>> '6b2a7648-748c-430b-94b6-5e3f719df2ac' (Parent Command > > >>>>>>> 'AddImageFromScratch', Parameters Type > > >>>>>>> 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters'), > > >>>>>>> polling hasn't started yet.. > > >>>>>>> 2020-06-16 23:03:22,699-04 INFO > > >>>>>>> [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (default task-1) > > >>>>>>> [16c24599-0048-44eb-a410-d39b7ce98712] > > >>>>>>> BaseAsyncTask::startPollingTask: Starting to poll task > > >>>>>>> '6b2a7648-748c-430b-94b6-5e3f719df2ac'. > > >>>>>>> ... > > >>>>>>> 2020-06-16 23:03:25,835-04 INFO > > >>>>>>> [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] > > >>>>>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-25) > > >>>>>>> [] SPMAsyncTask::PollTask: Polling task > > >>>>>>> '6b2a7648-748c-430b-94b6-5e3f719df2ac' (Parent Command > > >>>>>>> 'AddImageFromScratch', Parameters Type > > >>>>>>> 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters') > > >>>>>>> returned status 'finished', result 'success'. > > >>>>>>> 2020-06-16 23:03:25,863-04 INFO > > >>>>>>> [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] > > >>>>>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-25) > > >>>>>>> [] BaseAsyncTask::onTaskEndSuccess: Task > > >>>>>>> '6b2a7648-748c-430b-94b6-5e3f719df2ac' (Parent Command > > >>>>>>> 'AddImageFromScratch', Parameters Type > > >>>>>>> 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters') > ended > > >>>>>>> successfully. > > >>>>>>> > > >>>>>>> But then: > > >>>>>>> > > >>>>>>> 2020-06-16 23:03:25,897-04 INFO > > >>>>>>> [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] > > >>>>>>> (EE-ManagedThreadFactory-engine-Thread-29) > > >>>>>>> [16c24599-0048-44eb-a410-d39b7ce98712] > > >>>>>>> CommandAsyncTask::HandleEndActionResult [within thread]: > endAction for > > >>>>>>> action type 'AddImageFromScratch' succeeded, clearing tasks. > > >>>>>>> 2020-06-16 23:03:25,897-04 INFO > > >>>>>>> [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] > > >>>>>>> (EE-ManagedThreadFactory-engine-Thread-29) > > >>>>>>> [16c24599-0048-44eb-a410-d39b7ce98712] > SPMAsyncTask::ClearAsyncTask: > > >>>>>>> Attempting to clear task '6b2a7648-748c-430b-94b6-5e3f719df2ac' > > >>>>>>> 2020-06-16 23:03:25,899-04 INFO > > >>>>>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] > > >>>>>>> (EE-ManagedThreadFactory-engine-Thread-29) > > >>>>>>> [16c24599-0048-44eb-a410-d39b7ce98712] START, > SPMClearTaskVDSCommand( > > >>>>>>> > SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='3bcde3b4-b044-11ea-bbb6-5452c0a8c863', > > >>>>>>> ignoreFailoverLimit='false', > > >>>>>>> taskId='6b2a7648-748c-430b-94b6-5e3f719df2ac'}), log id: 481c2d3d > > >>>>>>> 2020-06-16 23:03:25,900-04 INFO > > >>>>>>> > [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] > > >>>>>>> (EE-ManagedThreadFactory-engine-Thread-29) > > >>>>>>> [16c24599-0048-44eb-a410-d39b7ce98712] START, > > >>>>>>> HSMClearTaskVDSCommand(HostName = > lago-he-basic-suite-master-host-0, > > >>>>>>> > HSMTaskGuidBaseVDSCommandParameters:{hostId='85ecc51c-f2cb-46a1-9452-fd487399d8dd', > > >>>>>>> taskId='6b2a7648-748c-430b-94b6-5e3f719df2ac'}), log id: 17360b3d > > >>>>>>> ... > > >>>>>>> 2020-06-16 23:03:26,054-04 INFO > > >>>>>>> [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] > > >>>>>>> (EE-ManagedThreadFactory-engine-Thread-29) > > >>>>>>> [16c24599-0048-44eb-a410-d39b7ce98712] > > >>>>>>> BaseAsyncTask::removeTaskFromDB: Removed task > > >>>>>>> '6b2a7648-748c-430b-94b6-5e3f719df2ac' from DataBase > > >>>>>>> > > >>>>>>> But then: > > >>>>>>> > > >>>>>>> 2020-06-16 23:03:26,315-04 ERROR > > >>>>>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>>>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-55) > > >>>>>>> [7fe7b467] Command 'UploadStreamVDSCommand(HostName = > > >>>>>>> lago-he-basic-suite-master-host-0, > > >>>>>>> > UploadStreamVDSCommandParameters:{hostId='85ecc51c-f2cb-46a1-9452-fd487399d8dd'})' > > >>>>>>> execution failed: javax.net.ssl.SSLPeerUnverifiedException: > > >>>>>>> Certificate for <lago-he-basic-suite-master-host-0.lago.local> > doesn't > > >>>>>>> match any of the subject alternative names: > > >>>>>>> [lago-he-basic-suite-master-host-0.lago.local] > > >>>>>>> 2020-06-16 23:03:26,315-04 INFO > > >>>>>>> > [org.ovirt.engine.core.vdsbroker.irsbroker.UploadStreamVDSCommand] > > >>>>>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-55) > > >>>>>>> [7fe7b467] FINISH, UploadStreamVDSCommand, return: , log id: > 7e3a3e80 > > >>>>>>> 2020-06-16 23:03:26,316-04 ERROR > > >>>>>>> [org.ovirt.engine.core.bll.storage.ovfstore.UploadStreamCommand] > > >>>>>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-55) > > >>>>>>> [7fe7b467] Command > > >>>>>>> 'org.ovirt.engine.core.bll.storage.ovfstore.UploadStreamCommand' > > >>>>>>> failed: EngineException: > > >>>>>>> org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: > > >>>>>>> javax.net.ssl.SSLPeerUnverifiedException: Certificate for > > >>>>>>> <lago-he-basic-suite-master-host-0.lago.local> doesn't match any > of > > >>>>>>> the subject alternative names: > > >>>>>>> [lago-he-basic-suite-master-host-0.lago.local] (Failed with error > > >>>>>>> VDS_NETWORK_ERROR and code 5022) > > >>>>>>> > > >>>>>>> Any idea why? > > >>>>>>> Anything changed in how we check the certificate? > > >>>>>>> Perhaps related to upgrade to CentOS 8.2? > > >>>>>>> And, how come it failed only this late? Don't we check the > certificate earlier? > > >>>>>>> > > >>>>>>> Anyway, this left the host in "not responding" state, so: > > >>>>>>> > > >>>>>>> 2020-06-16 23:03:29,994-04 ERROR > > >>>>>>> [org.ovirt.engine.core.bll.storage.disk.AddDiskCommandCallback] > > >>>>>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-79) > > >>>>>>> [16c24599-0048-44eb-a410-d39b7ce98712] Failed to get volume info: > > >>>>>>> org.ovirt.engine.core.common.errors.EngineException: > EngineException: > > >>>>>>> No host was found to perform the operation (Failed with error > > >>>>>>> RESOURCE_MANAGER_VDS_NOT_FOUND and code 5004) > > >>>>>>> > > >>>>>>> And perhaps due to an unrelated issue, also: > > >>>>>>> > > >>>>>>> 2020-06-16 23:03:31,177-04 ERROR > > >>>>>>> > [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMRevertTaskVDSCommand] > > >>>>>>> > (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-43) > > >>>>>>> [16c24599-0048-44eb-a410-d39b7ce98712] Trying to revert unknown > task > > >>>>>>> '6b2a7648-748c-430b-94b6-5e3f719df2ac' > > >>>>>>> > > >>>>>>> I looked a bit also at: > > >>>>>>> > > >>>>>>> > https://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/1641/artifact/exported-artifacts/test_logs/he-basic-suite-master/post-he_deploy/lago-he-basic-suite-master-host-0/_var_log/vdsm/vdsm.log > > >>>>>>> > > >>>>>>> and see there some relevant stuff, but nothing I can spot about > the > > >>>>>>> root cause (e.g. the word "cert" does not appear there). > > >>>>>>> > > >>>>>>> Can anyone please have a look? Thanks. > > >>>>>>> > > >>>>>>>> Build Number: 1641 > > >>>>>>>> Build Status: Still Failing > > >>>>>>>> Triggered By: Started by timer > > >>>>>>>> > > >>>>>>>> ------------------------------------- > > >>>>>>>> Changes Since Last Success: > > >>>>>>>> ------------------------------------- > > >>>>>>>> Changes for Build #1633 > > >>>>>>>> [Marcin Sobczyk] ost-images: Drop rebasing of qcows > > >>>>>>>> > > >>>>>>>> [Ehud Yonasi] mock: fix yum repos injection. > > >>>>>>>> > > >>>>>>>> [Ehud Yonasi] onboard ost-images to stdci. > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> Changes for Build #1634 > > >>>>>>>> [Marcin Sobczyk] ost-images: Drop rebasing of qcows > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> Changes for Build #1635 > > >>>>>>>> [Marcin Sobczyk] ost-images: Drop rebasing of qcows > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> Changes for Build #1636 > > >>>>>>>> [Marcin Sobczyk] ost-images: Drop rebasing of qcows > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> Changes for Build #1637 > > >>>>>>>> [Marcin Sobczyk] ost-images: Drop rebasing of qcows > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> Changes for Build #1638 > > >>>>>>>> [Marcin Sobczyk] ost-images: Drop rebasing of qcows > > >>>>>>>> > > >>>>>>>> [Ehud Yonasi] stdci_runner: update templates node to ost-images. > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> Changes for Build #1639 > > >>>>>>>> [Marcin Sobczyk] ost-images: Drop rebasing of qcows > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> Changes for Build #1640 > > >>>>>>>> [Yedidyah Bar David] Allow engine 20 minutes to come up after > VM restart > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> Changes for Build #1641 > > >>>>>>>> [Michal Skrivanek] test live storage migration again > > >>>>>>>> > > >>>>>>>> [Ehud Yonasi] poll: add ost-images to nightly. > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> ----------------- > > >>>>>>>> Failed Tests: > > >>>>>>>> ----------------- > > >>>>>>>> No tests ran. > > >>>>>>> > > >>>>>>> > > >>>>>>> -- > > >>>>>>> Didi > > >>>>>>> _______________________________________________ > > >>>>>>> Devel mailing list -- devel@ovirt.org > > >>>>>>> To unsubscribe send an email to devel-le...@ovirt.org > > >>>>>>> Privacy Statement: https://www.ovirt.org/privacy-policy.html > > >>>>>>> oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > > >>>>>>> List Archives: > https://lists.ovirt.org/archives/list/devel@ovirt.org/message/AI6KENCA35EK5RDLKR5BWU7HC6H3FIJ7/ > > >>>>> > > >>>>> > > >>>>> -- > > >>>>> Didi > > >>>> > > >>>> > > >>>> -- > > >>>> Didi > > >>>> > > >>> > > >>> -- > > >>> Martin Perina > > >>> Manager, Software Engineering > > >>> Red Hat Czech s.r.o. > > >>> _______________________________________________ > > >>> Devel mailing list -- devel@ovirt.org > > >>> To unsubscribe send an email to devel-le...@ovirt.org > > >>> Privacy Statement: https://www.ovirt.org/privacy-policy.html > > >>> oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > > >>> List Archives: > https://lists.ovirt.org/archives/list/devel@ovirt.org/message/2JUND2RQV6O7FBK3YQOSFV4XTRJ6JXUT/ > > > > > > > > > > > > > -- > Didi > > -- Martin Perina Manager, Software Engineering Red Hat Czech s.r.o.
_______________________________________________ Devel mailing list -- devel@ovirt.org To unsubscribe send an email to devel-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/Z73JV6BFBKRSSLDVVP42GMHAOPO52HSF/
