[oVirt CI] standard-enqueue - Build #10694 - FAILURE!

[jenkins]

Build: http://jenkins.ovirt.org/job/standard-enqueue/10694/
Build Name: #10694
Build Description: Gerrit: 88275 - ovirt-log-collector (3.6)
Build Status: FAILURE
Gerrit change: https://gerrit.ovirt.org/88275
- title: collector: Remove unused code
- project: ovirt-log-collector
- branch: ovirt-log-collector-3.6
- author: Ala Hino ___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

[CQ]: 88250, 4 (ovirt-engine-metrics) failed "ovirt-master" system tests

[oVirt Jenkins]

Change 88250,4 (ovirt-engine-metrics) is probably the reason behind recent
system test failures in the "ovirt-master" change queue and needs to be fixed.

This change had been removed from the testing queue. Artifacts build from this
change will not be released until it is fixed.

For further details about the change see:
https://gerrit.ovirt.org/#/c/88250/4

For failed test results see:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5886/
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

[CQ]: 88250,4 (ovirt-engine-metrics) failed "ovirt-4.2" system tests

[oVirt Jenkins]

Change 88250,4 (ovirt-engine-metrics) is probably the reason behind recent
system test failures in the "ovirt-4.2" change queue and needs to be fixed.

This change had been removed from the testing queue. Artifacts build from this
change will not be released until it is fixed.

For further details about the change see:
https://gerrit.ovirt.org/#/c/88250/4

For failed test results see:
http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/944/
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

[JIRA] (OVIRT-1770) Build on fedora 26 fails, accessing console log extremely slow

[Nir Soffer (oVirt JIRA)]

[ 
https://ovirt-jira.atlassian.net/browse/OVIRT-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=35892#comment-35892
 ] 

Nir Soffer commented on OVIRT-1770:
---

I never see the slowdown again, but I does not mean the issue does not exists.

I think this should be confirmed by looking at vdsm builds times - if we don't 
have very slow builds (e..g more then 15 minutes), the issue is probably solved.

> Build on fedora 26 fails, accessing console log extremely slow
> --
>
> Key: OVIRT-1770
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1770
> Project: oVirt - virtualization made easy
>  Issue Type: Improvement
>  Components: Jenkins Master
>Reporter: Nir Soffer
>Assignee: Evgheni Dereveanchin
>  Labels: jenkins
>
> I wait forever for this url:
> http://jenkins.ovirt.org/job/ovirt-imageio_master_check-patch-fc26-x86_64/295/console
> here example:
> $ time curl
> http://jenkins.ovirt.org/job/ovirt-imageio_master_check-patch-fc26-x86_64/295/console
> > /dev/null
>   % Total% Received % Xferd  Average Speed   TimeTime Time
> Current
>  Dload  Upload   Total   SpentLeft
> Speed
> 100  103k0  103k0 0   4814  0 --:--:--  0:00:22 --:--:--
> 23562
> real 0m22.107s
> user 0m0.005s
> sys 0m0.009s
> Can we fix to be less then a second?



--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100081)
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

[JIRA] (OVIRT-1770) Build on fedora 26 fails, accessing console log extremely slow

[Evgheni Dereveanchin (oVirt JIRA)]

 [ 
https://ovirt-jira.atlassian.net/browse/OVIRT-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Evgheni Dereveanchin updated OVIRT-1770:

Status: Blocked  (was: To Do)

> Build on fedora 26 fails, accessing console log extremely slow
> --
>
> Key: OVIRT-1770
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1770
> Project: oVirt - virtualization made easy
>  Issue Type: Improvement
>  Components: Jenkins Master
>Reporter: Nir Soffer
>Assignee: Evgheni Dereveanchin
>  Labels: jenkins
>
> I wait forever for this url:
> http://jenkins.ovirt.org/job/ovirt-imageio_master_check-patch-fc26-x86_64/295/console
> here example:
> $ time curl
> http://jenkins.ovirt.org/job/ovirt-imageio_master_check-patch-fc26-x86_64/295/console
> > /dev/null
>   % Total% Received % Xferd  Average Speed   TimeTime Time
> Current
>  Dload  Upload   Total   SpentLeft
> Speed
> 100  103k0  103k0 0   4814  0 --:--:--  0:00:22 --:--:--
> 23562
> real 0m22.107s
> user 0m0.005s
> sys 0m0.009s
> Can we fix to be less then a second?



--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100081)
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

[JIRA] (OVIRT-1770) Build on fedora 26 fails, accessing console log extremely slow

[Evgheni Dereveanchin (oVirt JIRA)]

[ 
https://ovirt-jira.atlassian.net/browse/OVIRT-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=35889#comment-35889
 ] 

Evgheni Dereveanchin commented on OVIRT-1770:
-

The garbage collection improvement patch was merged, [~nsof...@redhat.com]  
could you confirm if you still see slowness regularly?

I've tested against 
[http://jenkins.ovirt.org/job/ovirt-imageio_master_check-patch-fc27-x86_64/367/console]
 and download times were within 3 seconds

> Build on fedora 26 fails, accessing console log extremely slow
> --
>
> Key: OVIRT-1770
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1770
> Project: oVirt - virtualization made easy
>  Issue Type: Improvement
>  Components: Jenkins Master
>Reporter: Nir Soffer
>Assignee: Evgheni Dereveanchin
>  Labels: jenkins
>
> I wait forever for this url:
> http://jenkins.ovirt.org/job/ovirt-imageio_master_check-patch-fc26-x86_64/295/console
> here example:
> $ time curl
> http://jenkins.ovirt.org/job/ovirt-imageio_master_check-patch-fc26-x86_64/295/console
> > /dev/null
>   % Total% Received % Xferd  Average Speed   TimeTime Time
> Current
>  Dload  Upload   Total   SpentLeft
> Speed
> 100  103k0  103k0 0   4814  0 --:--:--  0:00:22 --:--:--
> 23562
> real 0m22.107s
> user 0m0.005s
> sys 0m0.009s
> Can we fix to be less then a second?



--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100081)
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

Re: [CQ]: 88046, 11 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests

[Dafna Ron]

I left the test so that I can understand why this happens :) I suspected it
was latency but wanted to see if indeed it is.
the failure is a storage behaviour and they do not have a way to query
tasks statuses before re-trying the same action.
I can disable the test until the bug is fixed, however, I am not sure if
that would happen and the question is if the test provides more benefits
running and failing in case there is latency (which can actually help debug
other issues) or is the noise of this failing every month or so is worse?



On Tue, Feb 27, 2018 at 12:13 PM, Eyal Edri  wrote:

>
>
> On Tue, Feb 27, 2018 at 2:08 PM, Dafna Ron  wrote:
>
>> this happens randomly when there is a delay of some sorts in the OST run.
>>
>
> We have to understand why it happens and if we can't, the test should be
> disabled, we can't allow known issues to be failing every once in a while.
> If there is an effort to debug it and understand root cause then it might
> be worth to let it fail a few more times, otherwise I suggest to see how we
> can disable it until the bug will be fixed.
>
>
>> I did not skip since its not failing often.
>>
>>
>> On Tue, Feb 27, 2018 at 11:40 AM, Eyal Edri  wrote:
>>
>>>
>>>
>>> On Tue, Feb 27, 2018 at 1:32 PM, Dafna Ron  wrote:
>>>
 it is a bug in the test suite which is reported on OST bugzilla.

>>>
>>>
>>> Is it possible to disable the test until we get a fix for it?
>>>
>>>



 On Tue, Feb 27, 2018 at 10:52 AM, Sandro Bonazzola  wrote:

>
>
> 2018-02-26 13:39 GMT+01:00 oVirt Jenkins :
>
>> Change 88046,11 (ovirt-hosted-engine-setup) is probably the reason
>> behind
>> recent system test failures in the "ovirt-master" change queue and
>> needs to be
>> fixed.
>>
>
> I don't think so. Failure is:
>
> Error: Fault reason is "Operation Failed". Fault detail is "[Cannot 
> deactivate Storage while there are running tasks on this Storage.
> -Please wait until tasks will finish and try again.]". HTTP response code 
> is 409.
>
>
> in 007_sd_reattach.deactivate_storage_domain (from nosetests)
>
> and sounds like a bug in the test suite not waiting for running task
> completion before deactivating the storage.
>
>
>
>>
>> This change had been removed from the testing queue. Artifacts build
>> from this
>> change will not be released until it is fixed.
>>
>> For further details about the change see:
>> https://gerrit.ovirt.org/#/c/88046/11
>>
>> For failed test results see:
>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866/
>> ___
>> Infra mailing list
>> Infra@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/infra
>>
>
>
>
> --
>
> SANDRO BONAZZOLA
>
> ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R
>
> Red Hat EMEA 
> 
> TRIED. TESTED. TRUSTED. 
>
>
> ___
> Infra mailing list
> Infra@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>
>

 ___
 Infra mailing list
 Infra@ovirt.org
 http://lists.ovirt.org/mailman/listinfo/infra


>>>
>>>
>>> --
>>>
>>> Eyal edri
>>>
>>>
>>> MANAGER
>>>
>>> RHV DevOps
>>>
>>> EMEA VIRTUALIZATION R
>>>
>>>
>>> Red Hat EMEA 
>>>  TRIED. TESTED. TRUSTED.
>>> 
>>> phone: +972-9-7692018 <+972%209-769-2018>
>>> irc: eedri (on #tlv #rhev-dev #rhev-integ)
>>>
>>
>>
>
>
> --
>
> Eyal edri
>
>
> MANAGER
>
> RHV DevOps
>
> EMEA VIRTUALIZATION R
>
>
> Red Hat EMEA 
>  TRIED. TESTED. TRUSTED. 
> phone: +972-9-7692018 <+972%209-769-2018>
> irc: eedri (on #tlv #rhev-dev #rhev-integ)
>
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

Re: [CQ]: 87428, 2 (vdsm) failed "ovirt-master" system tests, but isn't the failure root cause

[Eyal Edri]

On Tue, Feb 27, 2018 at 2:15 PM, Sandro Bonazzola 
wrote:

>
>
> 2018-02-22 22:42 GMT+01:00 oVirt Jenkins :
>
>> A system test invoked by the "ovirt-master" change queue including change
>> 87428,2 (vdsm) failed. However, this change seems not to be the root
>> cause for
>> this failure. Change 87944,3 (vdsm) that this change depends on or is
>> based on,
>> was detected as the cause of the testing failures.
>>
>> This change had been removed from the testing queue. Artifacts built from
>> this
>> change will not be released until either change 87944,3 (vdsm) is fixed
>> and
>> this change is updated to refer to or rebased on the fixed version, or
>> this
>> change is modified to no longer depend on it.
>>
>> For further details about the change see:
>> https://gerrit.ovirt.org/#/c/87428/2
>>
>> For further details about the change that seems to be the root cause
>> behind the
>> testing failures see:
>> https://gerrit.ovirt.org/#/c/87944/3
>>
>> For failed test results see:
>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5841/
>
>
>
> This fails due to multiple reason.
> http://jenkins.ovirt.org/job/vdsm_master_check-merged-el7-x86_64/3224/
> failed on
>
> *22:23:15* E   OSError: [Errno 24] Too many open files
>
> which seems to be an infra issue on the slave / dirty slave
>


Just FYI, check-merged jobs has nothing to do with OST/CQ results, they are
running functional tests written by VDSM developers.


>
>
> http://jenkins.ovirt.org/job/ovirt-master_change-queue-
> tester/5841/testReport/junit/(root)/002_bootstrap/add_hosts/
>
> Host lago-upgrade-from-release-suite-master-host0 is in non responsive state
>
>
> The host has vdsm failures with:
>
> 2018-02-22 16:34:04,208-0500 ERROR (MainThread) [MOM] MOM's RPC interface is 
> disabled (momIF:50)
> 2018-02-22 16:34:04,208-0500 ERROR (MainThread) [vds] failed to init 
> clientIF, shutting down storage dispatcher (clientIF:148)
> 2018-02-22 16:34:04,208-0500 INFO  (MainThread) [vdsm.api] START 
> prepareForShutdown(options=None) from=internal, 
> task_id=f45a0864-9bd6-4116-add9-a55a05d72909 (api:46)
> 2018-02-22 16:34:04,220-0500 INFO  (MainThread) [storage.Monitor] Shutting 
> down domain monitors (monitor:222)
> 2018-02-22 16:34:04,220-0500 INFO  (MainThread) [storage.check] Stopping 
> check service (check:104)
> 2018-02-22 16:34:04,221-0500 INFO  (check/loop) [storage.asyncevent] Stopping 
>  (asyncevent:220)
> 2018-02-22 16:34:04,221-0500 INFO  (MainThread) [storage.udev] Stopping 
> multipath event listener (udev:149)
> 2018-02-22 16:34:04,221-0500 INFO  (MainThread) [vdsm.api] FINISH 
> prepareForShutdown return=None from=internal, 
> task_id=f45a0864-9bd6-4116-add9-a55a05d72909 (api:52)
> 2018-02-22 16:34:04,222-0500 ERROR (MainThread) [vds] Exception raised 
> (vdsmd:158)
> Traceback (most recent call last):
>   File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 156, in run
> serve_clients(log)
>   File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 103, in 
> serve_clients
> cif = clientIF.getInstance(irs, log, scheduler)
>   File "/usr/lib/python2.7/site-packages/vdsm/clientIF.py", line 251, in 
> getInstance
> cls._instance = clientIF(irs, log, scheduler)
>   File "/usr/lib/python2.7/site-packages/vdsm/clientIF.py", line 121, in 
> __init__
> self.mom = MomClient(config.get("mom", "socket_path"))
>   File "/usr/lib/python2.7/site-packages/vdsm/momIF.py", line 51, in __init__
> raise MomNotAvailableError()
> MomNotAvailableError
>
> and failure on mom side:
>
> 2018-02-22 16:34:00,168 - mom - INFO - MOM starting
> 2018-02-22 16:34:00,185 - mom.HostMonitor - INFO - Host Monitor starting
> 2018-02-22 16:34:00,186 - mom - INFO - hypervisor interface vdsmjsonrpcbulk
> 2018-02-22 16:34:00,280 - mom.VdsmRpcBase - ERROR - Cannot connect to VDSM! 
> [Errno 111] Connection refused
> 2018-02-22 16:34:00,280 - mom - ERROR - Failed to initialize MOM threads
> Traceback (most recent call last):
>   File "/usr/lib/python2.7/site-packages/mom/__init__.py", line 29, in run
> hypervisor_iface = self.get_hypervisor_interface()
>   File "/usr/lib/python2.7/site-packages/mom/__init__.py", line 217, in 
> get_hypervisor_interface
> return module.instance(self.config)
>   File 
> "/usr/lib/python2.7/site-packages/mom/HypervisorInterfaces/vdsmjsonrpcbulkInterface.py",
>  line 47, in instance
> return JsonRpcVdsmBulkInterface()
>   File 
> "/usr/lib/python2.7/site-packages/mom/HypervisorInterfaces/vdsmjsonrpcbulkInterface.py",
>  line 29, in __init__
> super(JsonRpcVdsmBulkInterface, self).__init__()
>   File 
> "/usr/lib/python2.7/site-packages/mom/HypervisorInterfaces/vdsmjsonrpcInterface.py",
>  line 41, in __init__
> .orRaise(RuntimeError, 'No connection to VDSM.')
>   File "/usr/lib/python2.7/site-packages/mom/optional.py", line 28, in orRaise
> raise exception(*args, **kwargs)
> RuntimeError: No connection to VDSM.
>
> vdsm upgrade log shows:

Re: [CQ]: 88165, 1 (ovirt-hosted-engine-setup) failed "ovirt-4.2" system tests

[Eyal Edri]

On Tue, Feb 27, 2018 at 2:06 PM, Dafna Ron  wrote:

> the upgade suite is using the 4.2 and the 4.1 reposync files and the
> centos repos are there.
> why do you think its not using the ovirt mirrors? am I missing something
> in the reposync?
>
> Please note that the error happens yesterday.
> From what I could see yesterday there was a momentary issue with the
> mirrors which failed this job and also caused the disable domain test to
> fail since I can see delays in lago runs for not being able to access one
> of the mirror servers.
>
> I thought it was a momentary issue with the network and since it was just
> two changes and the re-trigger did not fail I did not see a reason to
> report it.
>


I believe this failed because we didn't really block external repo access
yet, otherwise installing pkgs should never fail as it fetches it from the
internal repo.

At some point we need to get back to
https://ovirt-jira.atlassian.net/browse/OVIRT-1280, which should be easier
now with the new reposync tool


>
>
> On Tue, Feb 27, 2018 at 11:38 AM, Eyal Edri  wrote:
>
>>
>>
>> On Tue, Feb 27, 2018 at 1:34 PM, Dafna Ron  wrote:
>>
>>> yes, I noticed that myself which is why after checking that I can access
>>> the base rhel7 repo I re-triggered the change.
>>>
>>
>> Can you check why the upgrade suite isn't using the oVirt mirrors?
>>
>>
>>>
>>>
>>> On Tue, Feb 27, 2018 at 10:54 AM, Sandro Bonazzola 
>>> wrote:
>>>


 2018-02-26 13:10 GMT+01:00 oVirt Jenkins :

> Change 88165,1 (ovirt-hosted-engine-setup) is probably the reason
> behind recent
> system test failures in the "ovirt-4.2" change queue and needs to be
> fixed.
>

 No.
 The reason behind the failure is a network issue:

 *12:13:03* [upgrade-from-prevrelease-suit] Cannot find a valid baseurl for 
 repo: base/7/x86_64

 this seems to be an infrastructure network problem




>
> This change had been removed from the testing queue. Artifacts build
> from this
> change will not be released until it is fixed.
>
> For further details about the change see:
> https://gerrit.ovirt.org/#/c/88165/1
>
> For failed test results see:
> http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/926/
> ___
> Infra mailing list
> Infra@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>



 --

 SANDRO BONAZZOLA

 ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R

 Red Hat EMEA 
 
 TRIED. TESTED. TRUSTED. 


 ___
 Infra mailing list
 Infra@ovirt.org
 http://lists.ovirt.org/mailman/listinfo/infra


>>>
>>> ___
>>> Infra mailing list
>>> Infra@ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/infra
>>>
>>>
>>
>>
>> --
>>
>> Eyal edri
>>
>>
>> MANAGER
>>
>> RHV DevOps
>>
>> EMEA VIRTUALIZATION R
>>
>>
>> Red Hat EMEA 
>>  TRIED. TESTED. TRUSTED. 
>> phone: +972-9-7692018 <+972%209-769-2018>
>> irc: eedri (on #tlv #rhev-dev #rhev-integ)
>>
>
>


-- 

Eyal edri


MANAGER

RHV DevOps

EMEA VIRTUALIZATION R


Red Hat EMEA 
 TRIED. TESTED. TRUSTED. 
phone: +972-9-7692018
irc: eedri (on #tlv #rhev-dev #rhev-integ)
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

Re: [CQ]: 87428, 2 (vdsm) failed "ovirt-master" system tests, but isn't the failure root cause

[Sandro Bonazzola]

2018-02-22 22:42 GMT+01:00 oVirt Jenkins :

> A system test invoked by the "ovirt-master" change queue including change
> 87428,2 (vdsm) failed. However, this change seems not to be the root cause
> for
> this failure. Change 87944,3 (vdsm) that this change depends on or is
> based on,
> was detected as the cause of the testing failures.
>
> This change had been removed from the testing queue. Artifacts built from
> this
> change will not be released until either change 87944,3 (vdsm) is fixed and
> this change is updated to refer to or rebased on the fixed version, or this
> change is modified to no longer depend on it.
>
> For further details about the change see:
> https://gerrit.ovirt.org/#/c/87428/2
>
> For further details about the change that seems to be the root cause
> behind the
> testing failures see:
> https://gerrit.ovirt.org/#/c/87944/3
>
> For failed test results see:
> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5841/



This fails due to multiple reason.
http://jenkins.ovirt.org/job/vdsm_master_check-merged-el7-x86_64/3224/
failed on

*22:23:15* E   OSError: [Errno 24] Too many open files

which seems to be an infra issue on the slave / dirty slave


http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5841/testReport/junit/(root)/002_bootstrap/add_hosts/

Host lago-upgrade-from-release-suite-master-host0 is in non responsive state


The host has vdsm failures with:

2018-02-22 16:34:04,208-0500 ERROR (MainThread) [MOM] MOM's RPC
interface is disabled (momIF:50)
2018-02-22 16:34:04,208-0500 ERROR (MainThread) [vds] failed to init
clientIF, shutting down storage dispatcher (clientIF:148)
2018-02-22 16:34:04,208-0500 INFO  (MainThread) [vdsm.api] START
prepareForShutdown(options=None) from=internal,
task_id=f45a0864-9bd6-4116-add9-a55a05d72909 (api:46)
2018-02-22 16:34:04,220-0500 INFO  (MainThread) [storage.Monitor]
Shutting down domain monitors (monitor:222)
2018-02-22 16:34:04,220-0500 INFO  (MainThread) [storage.check]
Stopping check service (check:104)
2018-02-22 16:34:04,221-0500 INFO  (check/loop) [storage.asyncevent]
Stopping 
(asyncevent:220)
2018-02-22 16:34:04,221-0500 INFO  (MainThread) [storage.udev]
Stopping multipath event listener (udev:149)
2018-02-22 16:34:04,221-0500 INFO  (MainThread) [vdsm.api] FINISH
prepareForShutdown return=None from=internal,
task_id=f45a0864-9bd6-4116-add9-a55a05d72909 (api:52)
2018-02-22 16:34:04,222-0500 ERROR (MainThread) [vds] Exception raised
(vdsmd:158)
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 156, in run
serve_clients(log)
  File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 103, in
serve_clients
cif = clientIF.getInstance(irs, log, scheduler)
  File "/usr/lib/python2.7/site-packages/vdsm/clientIF.py", line 251,
in getInstance
cls._instance = clientIF(irs, log, scheduler)
  File "/usr/lib/python2.7/site-packages/vdsm/clientIF.py", line 121,
in __init__
self.mom = MomClient(config.get("mom", "socket_path"))
  File "/usr/lib/python2.7/site-packages/vdsm/momIF.py", line 51, in __init__
raise MomNotAvailableError()
MomNotAvailableError

and failure on mom side:

2018-02-22 16:34:00,168 - mom - INFO - MOM starting
2018-02-22 16:34:00,185 - mom.HostMonitor - INFO - Host Monitor starting
2018-02-22 16:34:00,186 - mom - INFO - hypervisor interface vdsmjsonrpcbulk
2018-02-22 16:34:00,280 - mom.VdsmRpcBase - ERROR - Cannot connect to
VDSM! [Errno 111] Connection refused
2018-02-22 16:34:00,280 - mom - ERROR - Failed to initialize MOM threads
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/mom/__init__.py", line 29, in run
hypervisor_iface = self.get_hypervisor_interface()
  File "/usr/lib/python2.7/site-packages/mom/__init__.py", line 217,
in get_hypervisor_interface
return module.instance(self.config)
  File 
"/usr/lib/python2.7/site-packages/mom/HypervisorInterfaces/vdsmjsonrpcbulkInterface.py",
line 47, in instance
return JsonRpcVdsmBulkInterface()
  File 
"/usr/lib/python2.7/site-packages/mom/HypervisorInterfaces/vdsmjsonrpcbulkInterface.py",
line 29, in __init__
super(JsonRpcVdsmBulkInterface, self).__init__()
  File 
"/usr/lib/python2.7/site-packages/mom/HypervisorInterfaces/vdsmjsonrpcInterface.py",
line 41, in __init__
.orRaise(RuntimeError, 'No connection to VDSM.')
  File "/usr/lib/python2.7/site-packages/mom/optional.py", line 28, in orRaise
raise exception(*args, **kwargs)
RuntimeError: No connection to VDSM.

vdsm upgrade log shows:

MainThread::DEBUG::2018-02-22
16:31:34,113::libvirtconnection::167::root::(get) trying to connect
libvirt
MainThread::DEBUG::2018-02-22
16:31:34,134::cmdutils::150::root::(exec_cmd) lshw -json -disable usb
-disable pcmcia -disable isapnp -disable ide -disable scsi -disable
dmi -disable memory -disable cpuinfo (cwd None)
MainThread::DEBUG::2018-02-22
16:31:34,242::cmdutils::158::root::(exec_cmd) SUCCESS:  = '';
 = 0

Re: [CQ]: 88046, 11 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests

[Eyal Edri]

On Tue, Feb 27, 2018 at 2:08 PM, Dafna Ron  wrote:

> this happens randomly when there is a delay of some sorts in the OST run.
>

We have to understand why it happens and if we can't, the test should be
disabled, we can't allow known issues to be failing every once in a while.
If there is an effort to debug it and understand root cause then it might
be worth to let it fail a few more times, otherwise I suggest to see how we
can disable it until the bug will be fixed.


> I did not skip since its not failing often.
>
>
> On Tue, Feb 27, 2018 at 11:40 AM, Eyal Edri  wrote:
>
>>
>>
>> On Tue, Feb 27, 2018 at 1:32 PM, Dafna Ron  wrote:
>>
>>> it is a bug in the test suite which is reported on OST bugzilla.
>>>
>>
>>
>> Is it possible to disable the test until we get a fix for it?
>>
>>
>>>
>>>
>>>
>>> On Tue, Feb 27, 2018 at 10:52 AM, Sandro Bonazzola 
>>> wrote:
>>>


 2018-02-26 13:39 GMT+01:00 oVirt Jenkins :

> Change 88046,11 (ovirt-hosted-engine-setup) is probably the reason
> behind
> recent system test failures in the "ovirt-master" change queue and
> needs to be
> fixed.
>

 I don't think so. Failure is:

 Error: Fault reason is "Operation Failed". Fault detail is "[Cannot 
 deactivate Storage while there are running tasks on this Storage.
 -Please wait until tasks will finish and try again.]". HTTP response code 
 is 409.


 in 007_sd_reattach.deactivate_storage_domain (from nosetests)

 and sounds like a bug in the test suite not waiting for running task
 completion before deactivating the storage.



>
> This change had been removed from the testing queue. Artifacts build
> from this
> change will not be released until it is fixed.
>
> For further details about the change see:
> https://gerrit.ovirt.org/#/c/88046/11
>
> For failed test results see:
> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866/
> ___
> Infra mailing list
> Infra@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>



 --

 SANDRO BONAZZOLA

 ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R

 Red Hat EMEA 
 
 TRIED. TESTED. TRUSTED. 


 ___
 Infra mailing list
 Infra@ovirt.org
 http://lists.ovirt.org/mailman/listinfo/infra


>>>
>>> ___
>>> Infra mailing list
>>> Infra@ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/infra
>>>
>>>
>>
>>
>> --
>>
>> Eyal edri
>>
>>
>> MANAGER
>>
>> RHV DevOps
>>
>> EMEA VIRTUALIZATION R
>>
>>
>> Red Hat EMEA 
>>  TRIED. TESTED. TRUSTED. 
>> phone: +972-9-7692018 <+972%209-769-2018>
>> irc: eedri (on #tlv #rhev-dev #rhev-integ)
>>
>
>


-- 

Eyal edri


MANAGER

RHV DevOps

EMEA VIRTUALIZATION R


Red Hat EMEA 
 TRIED. TESTED. TRUSTED. 
phone: +972-9-7692018
irc: eedri (on #tlv #rhev-dev #rhev-integ)
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

Re: [CQ]: 88046, 11 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests

[Dafna Ron]

this happens randomly when there is a delay of some sorts in the OST run.
I did not skip since its not failing often.


On Tue, Feb 27, 2018 at 11:40 AM, Eyal Edri  wrote:

>
>
> On Tue, Feb 27, 2018 at 1:32 PM, Dafna Ron  wrote:
>
>> it is a bug in the test suite which is reported on OST bugzilla.
>>
>
>
> Is it possible to disable the test until we get a fix for it?
>
>
>>
>>
>>
>> On Tue, Feb 27, 2018 at 10:52 AM, Sandro Bonazzola 
>> wrote:
>>
>>>
>>>
>>> 2018-02-26 13:39 GMT+01:00 oVirt Jenkins :
>>>
 Change 88046,11 (ovirt-hosted-engine-setup) is probably the reason
 behind
 recent system test failures in the "ovirt-master" change queue and
 needs to be
 fixed.

>>>
>>> I don't think so. Failure is:
>>>
>>> Error: Fault reason is "Operation Failed". Fault detail is "[Cannot 
>>> deactivate Storage while there are running tasks on this Storage.
>>> -Please wait until tasks will finish and try again.]". HTTP response code 
>>> is 409.
>>>
>>>
>>> in 007_sd_reattach.deactivate_storage_domain (from nosetests)
>>>
>>> and sounds like a bug in the test suite not waiting for running task
>>> completion before deactivating the storage.
>>>
>>>
>>>

 This change had been removed from the testing queue. Artifacts build
 from this
 change will not be released until it is fixed.

 For further details about the change see:
 https://gerrit.ovirt.org/#/c/88046/11

 For failed test results see:
 http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866/
 ___
 Infra mailing list
 Infra@ovirt.org
 http://lists.ovirt.org/mailman/listinfo/infra

>>>
>>>
>>>
>>> --
>>>
>>> SANDRO BONAZZOLA
>>>
>>> ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R
>>>
>>> Red Hat EMEA 
>>> 
>>> TRIED. TESTED. TRUSTED. 
>>>
>>>
>>> ___
>>> Infra mailing list
>>> Infra@ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/infra
>>>
>>>
>>
>> ___
>> Infra mailing list
>> Infra@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/infra
>>
>>
>
>
> --
>
> Eyal edri
>
>
> MANAGER
>
> RHV DevOps
>
> EMEA VIRTUALIZATION R
>
>
> Red Hat EMEA 
>  TRIED. TESTED. TRUSTED. 
> phone: +972-9-7692018 <+972%209-769-2018>
> irc: eedri (on #tlv #rhev-dev #rhev-integ)
>
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

Re: [CQ]: 88165, 1 (ovirt-hosted-engine-setup) failed "ovirt-4.2" system tests

[Dafna Ron]

the upgade suite is using the 4.2 and the 4.1 reposync files and the centos
repos are there.
why do you think its not using the ovirt mirrors? am I missing something in
the reposync?

Please note that the error happens yesterday.
>From what I could see yesterday there was a momentary issue with the
mirrors which failed this job and also caused the disable domain test to
fail since I can see delays in lago runs for not being able to access one
of the mirror servers.

I thought it was a momentary issue with the network and since it was just
two changes and the re-trigger did not fail I did not see a reason to
report it.


On Tue, Feb 27, 2018 at 11:38 AM, Eyal Edri  wrote:

>
>
> On Tue, Feb 27, 2018 at 1:34 PM, Dafna Ron  wrote:
>
>> yes, I noticed that myself which is why after checking that I can access
>> the base rhel7 repo I re-triggered the change.
>>
>
> Can you check why the upgrade suite isn't using the oVirt mirrors?
>
>
>>
>>
>> On Tue, Feb 27, 2018 at 10:54 AM, Sandro Bonazzola 
>> wrote:
>>
>>>
>>>
>>> 2018-02-26 13:10 GMT+01:00 oVirt Jenkins :
>>>
 Change 88165,1 (ovirt-hosted-engine-setup) is probably the reason
 behind recent
 system test failures in the "ovirt-4.2" change queue and needs to be
 fixed.

>>>
>>> No.
>>> The reason behind the failure is a network issue:
>>>
>>> *12:13:03* [upgrade-from-prevrelease-suit] Cannot find a valid baseurl for 
>>> repo: base/7/x86_64
>>>
>>> this seems to be an infrastructure network problem
>>>
>>>
>>>
>>>

 This change had been removed from the testing queue. Artifacts build
 from this
 change will not be released until it is fixed.

 For further details about the change see:
 https://gerrit.ovirt.org/#/c/88165/1

 For failed test results see:
 http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/926/
 ___
 Infra mailing list
 Infra@ovirt.org
 http://lists.ovirt.org/mailman/listinfo/infra

>>>
>>>
>>>
>>> --
>>>
>>> SANDRO BONAZZOLA
>>>
>>> ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R
>>>
>>> Red Hat EMEA 
>>> 
>>> TRIED. TESTED. TRUSTED. 
>>>
>>>
>>> ___
>>> Infra mailing list
>>> Infra@ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/infra
>>>
>>>
>>
>> ___
>> Infra mailing list
>> Infra@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/infra
>>
>>
>
>
> --
>
> Eyal edri
>
>
> MANAGER
>
> RHV DevOps
>
> EMEA VIRTUALIZATION R
>
>
> Red Hat EMEA 
>  TRIED. TESTED. TRUSTED. 
> phone: +972-9-7692018 <+972%209-769-2018>
> irc: eedri (on #tlv #rhev-dev #rhev-integ)
>
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

Re: [CQ]: 88094,2 (ovirt-engine) failed "ovirt-master" system tests

[Eyal Edri]

Evgheni,
Do we have a way to detect which slaves are out of space and reprovision
them or increase their size?

On Tue, Feb 27, 2018 at 12:59 PM, Sandro Bonazzola 
wrote:

>
>
> 2018-02-26 0:53 GMT+01:00 oVirt Jenkins :
>
>> Change 88094,2 (ovirt-engine) is probably the reason behind recent system
>> test
>> failures in the "ovirt-master" change queue and needs to be fixed.
>>
>>
> No, this is caused by multiple failure in jenkins jobs:
>
> http://jenkins.ovirt.org/job/ovirt-engine_master_build-
> artifacts-el7-x86_64/6699/
>
> *19:22:46* Failed to start postfix.service: Connection timed out*19:22:46* 
> See system logs and 'systemctl status postfix.service' for details.*19:22:46* 
> + failed=true
>
>
> looks like infrastructure issue, slave not starting postfix service.
>
>
>
> http://jenkins.ovirt.org/job/vdsm_master_check-merged-el7-x86_64/3231/
>
> *18:20:28* + chown -R jenkins:jenkins 
> /home/jenkins/workspace/vdsm_master_check-merged-el7-x86_64/exported-artifacts*18:20:28*
>  chown: changing ownership of 
> '/home/jenkins/workspace/vdsm_master_check-merged-el7-x86_64/exported-artifacts/functional_tests_stdout.el7.log':
>  Operation not permitted
>
>
> Looks like a dirty slave
>
> http://jenkins.ovirt.org/job/vdsm_master_build-artifacts-fc27-s390x/207
>
> *22:15:04* Error Summary*22:15:04* -*22:15:04* Disk 
> Requirements:*22:15:04*At least 163MB more space needed on the / 
> filesystem.
>
>
> Not enough space on the slave.
>
>
>
>
>> This change had been removed from the testing queue. Artifacts build from
>> this
>> change will not be released until it is fixed.
>>
>> For further details about the change see:
>> https://gerrit.ovirt.org/#/c/88094/2
>>
>> For failed test results see:
>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5860/
>> ___
>> Infra mailing list
>> Infra@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/infra
>>
>
>
>
> --
>
> SANDRO BONAZZOLA
>
> ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R
>
> Red Hat EMEA 
> 
> TRIED. TESTED. TRUSTED. 
>
>
> ___
> Infra mailing list
> Infra@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>
>


-- 

Eyal edri


MANAGER

RHV DevOps

EMEA VIRTUALIZATION R


Red Hat EMEA 
 TRIED. TESTED. TRUSTED. 
phone: +972-9-7692018
irc: eedri (on #tlv #rhev-dev #rhev-integ)
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

Re: [CQ]: 88046, 11 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests

[Eyal Edri]

On Tue, Feb 27, 2018 at 1:32 PM, Dafna Ron  wrote:

> it is a bug in the test suite which is reported on OST bugzilla.
>


Is it possible to disable the test until we get a fix for it?


>
>
>
> On Tue, Feb 27, 2018 at 10:52 AM, Sandro Bonazzola 
> wrote:
>
>>
>>
>> 2018-02-26 13:39 GMT+01:00 oVirt Jenkins :
>>
>>> Change 88046,11 (ovirt-hosted-engine-setup) is probably the reason behind
>>> recent system test failures in the "ovirt-master" change queue and needs
>>> to be
>>> fixed.
>>>
>>
>> I don't think so. Failure is:
>>
>> Error: Fault reason is "Operation Failed". Fault detail is "[Cannot 
>> deactivate Storage while there are running tasks on this Storage.
>> -Please wait until tasks will finish and try again.]". HTTP response code is 
>> 409.
>>
>>
>> in 007_sd_reattach.deactivate_storage_domain (from nosetests)
>>
>> and sounds like a bug in the test suite not waiting for running task
>> completion before deactivating the storage.
>>
>>
>>
>>>
>>> This change had been removed from the testing queue. Artifacts build
>>> from this
>>> change will not be released until it is fixed.
>>>
>>> For further details about the change see:
>>> https://gerrit.ovirt.org/#/c/88046/11
>>>
>>> For failed test results see:
>>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866/
>>> ___
>>> Infra mailing list
>>> Infra@ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/infra
>>>
>>
>>
>>
>> --
>>
>> SANDRO BONAZZOLA
>>
>> ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R
>>
>> Red Hat EMEA 
>> 
>> TRIED. TESTED. TRUSTED. 
>>
>>
>> ___
>> Infra mailing list
>> Infra@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/infra
>>
>>
>
> ___
> Infra mailing list
> Infra@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>
>


-- 

Eyal edri


MANAGER

RHV DevOps

EMEA VIRTUALIZATION R


Red Hat EMEA 
 TRIED. TESTED. TRUSTED. 
phone: +972-9-7692018
irc: eedri (on #tlv #rhev-dev #rhev-integ)
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

Re: [CQ]: 88165, 1 (ovirt-hosted-engine-setup) failed "ovirt-4.2" system tests

[Eyal Edri]

On Tue, Feb 27, 2018 at 1:34 PM, Dafna Ron  wrote:

> yes, I noticed that myself which is why after checking that I can access
> the base rhel7 repo I re-triggered the change.
>

Can you check why the upgrade suite isn't using the oVirt mirrors?


>
>
> On Tue, Feb 27, 2018 at 10:54 AM, Sandro Bonazzola 
> wrote:
>
>>
>>
>> 2018-02-26 13:10 GMT+01:00 oVirt Jenkins :
>>
>>> Change 88165,1 (ovirt-hosted-engine-setup) is probably the reason behind
>>> recent
>>> system test failures in the "ovirt-4.2" change queue and needs to be
>>> fixed.
>>>
>>
>> No.
>> The reason behind the failure is a network issue:
>>
>> *12:13:03* [upgrade-from-prevrelease-suit] Cannot find a valid baseurl for 
>> repo: base/7/x86_64
>>
>> this seems to be an infrastructure network problem
>>
>>
>>
>>
>>>
>>> This change had been removed from the testing queue. Artifacts build
>>> from this
>>> change will not be released until it is fixed.
>>>
>>> For further details about the change see:
>>> https://gerrit.ovirt.org/#/c/88165/1
>>>
>>> For failed test results see:
>>> http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/926/
>>> ___
>>> Infra mailing list
>>> Infra@ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/infra
>>>
>>
>>
>>
>> --
>>
>> SANDRO BONAZZOLA
>>
>> ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R
>>
>> Red Hat EMEA 
>> 
>> TRIED. TESTED. TRUSTED. 
>>
>>
>> ___
>> Infra mailing list
>> Infra@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/infra
>>
>>
>
> ___
> Infra mailing list
> Infra@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>
>


-- 

Eyal edri


MANAGER

RHV DevOps

EMEA VIRTUALIZATION R


Red Hat EMEA 
 TRIED. TESTED. TRUSTED. 
phone: +972-9-7692018
irc: eedri (on #tlv #rhev-dev #rhev-integ)
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

Re: [CQ]: 88165, 1 (ovirt-hosted-engine-setup) failed "ovirt-4.2" system tests

[Dafna Ron]

yes, I noticed that myself which is why after checking that I can access
the base rhel7 repo I re-triggered the change.


On Tue, Feb 27, 2018 at 10:54 AM, Sandro Bonazzola 
wrote:

>
>
> 2018-02-26 13:10 GMT+01:00 oVirt Jenkins :
>
>> Change 88165,1 (ovirt-hosted-engine-setup) is probably the reason behind
>> recent
>> system test failures in the "ovirt-4.2" change queue and needs to be
>> fixed.
>>
>
> No.
> The reason behind the failure is a network issue:
>
> *12:13:03* [upgrade-from-prevrelease-suit] Cannot find a valid baseurl for 
> repo: base/7/x86_64
>
> this seems to be an infrastructure network problem
>
>
>
>
>>
>> This change had been removed from the testing queue. Artifacts build from
>> this
>> change will not be released until it is fixed.
>>
>> For further details about the change see:
>> https://gerrit.ovirt.org/#/c/88165/1
>>
>> For failed test results see:
>> http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/926/
>> ___
>> Infra mailing list
>> Infra@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/infra
>>
>
>
>
> --
>
> SANDRO BONAZZOLA
>
> ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R
>
> Red Hat EMEA 
> 
> TRIED. TESTED. TRUSTED. 
>
>
> ___
> Infra mailing list
> Infra@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>
>
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

Re: [CQ]: 88046, 11 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests

[Dafna Ron]

it is a bug in the test suite which is reported on OST bugzilla.



On Tue, Feb 27, 2018 at 10:52 AM, Sandro Bonazzola 
wrote:

>
>
> 2018-02-26 13:39 GMT+01:00 oVirt Jenkins :
>
>> Change 88046,11 (ovirt-hosted-engine-setup) is probably the reason behind
>> recent system test failures in the "ovirt-master" change queue and needs
>> to be
>> fixed.
>>
>
> I don't think so. Failure is:
>
> Error: Fault reason is "Operation Failed". Fault detail is "[Cannot 
> deactivate Storage while there are running tasks on this Storage.
> -Please wait until tasks will finish and try again.]". HTTP response code is 
> 409.
>
>
> in 007_sd_reattach.deactivate_storage_domain (from nosetests)
>
> and sounds like a bug in the test suite not waiting for running task
> completion before deactivating the storage.
>
>
>
>>
>> This change had been removed from the testing queue. Artifacts build from
>> this
>> change will not be released until it is fixed.
>>
>> For further details about the change see:
>> https://gerrit.ovirt.org/#/c/88046/11
>>
>> For failed test results see:
>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866/
>> ___
>> Infra mailing list
>> Infra@ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/infra
>>
>
>
>
> --
>
> SANDRO BONAZZOLA
>
> ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R
>
> Red Hat EMEA 
> 
> TRIED. TESTED. TRUSTED. 
>
>
> ___
> Infra mailing list
> Infra@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>
>
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

Re: [CQ]: 88094,2 (ovirt-engine) failed "ovirt-master" system tests

[Sandro Bonazzola]

2018-02-26 0:53 GMT+01:00 oVirt Jenkins :

> Change 88094,2 (ovirt-engine) is probably the reason behind recent system
> test
> failures in the "ovirt-master" change queue and needs to be fixed.
>
>
No, this is caused by multiple failure in jenkins jobs:

http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-el7-x86_64/6699/

*19:22:46* Failed to start postfix.service: Connection timed
out*19:22:46* See system logs and 'systemctl status postfix.service'
for details.*19:22:46* + failed=true


looks like infrastructure issue, slave not starting postfix service.



http://jenkins.ovirt.org/job/vdsm_master_check-merged-el7-x86_64/3231/

*18:20:28* + chown -R jenkins:jenkins
/home/jenkins/workspace/vdsm_master_check-merged-el7-x86_64/exported-artifacts*18:20:28*
chown: changing ownership of
'/home/jenkins/workspace/vdsm_master_check-merged-el7-x86_64/exported-artifacts/functional_tests_stdout.el7.log':
Operation not permitted


Looks like a dirty slave

http://jenkins.ovirt.org/job/vdsm_master_build-artifacts-fc27-s390x/207

*22:15:04* Error Summary*22:15:04* -*22:15:04* Disk
Requirements:*22:15:04*At least 163MB more space needed on the /
filesystem.


Not enough space on the slave.




> This change had been removed from the testing queue. Artifacts build from
> this
> change will not be released until it is fixed.
>
> For further details about the change see:
> https://gerrit.ovirt.org/#/c/88094/2
>
> For failed test results see:
> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5860/
> ___
> Infra mailing list
> Infra@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>



-- 

SANDRO BONAZZOLA

ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R

Red Hat EMEA 

TRIED. TESTED. TRUSTED. 
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

Re: [CQ]: 88165, 1 (ovirt-hosted-engine-setup) failed "ovirt-4.2" system tests

[Sandro Bonazzola]

2018-02-26 13:10 GMT+01:00 oVirt Jenkins :

> Change 88165,1 (ovirt-hosted-engine-setup) is probably the reason behind
> recent
> system test failures in the "ovirt-4.2" change queue and needs to be fixed.
>

No.
The reason behind the failure is a network issue:

*12:13:03* [upgrade-from-prevrelease-suit] Cannot find a valid baseurl
for repo: base/7/x86_64

this seems to be an infrastructure network problem




>
> This change had been removed from the testing queue. Artifacts build from
> this
> change will not be released until it is fixed.
>
> For further details about the change see:
> https://gerrit.ovirt.org/#/c/88165/1
>
> For failed test results see:
> http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/926/
> ___
> Infra mailing list
> Infra@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>



-- 

SANDRO BONAZZOLA

ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R

Red Hat EMEA 

TRIED. TESTED. TRUSTED. 
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra

Re: [CQ]: 88046, 11 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests

[Sandro Bonazzola]

2018-02-26 13:39 GMT+01:00 oVirt Jenkins :

> Change 88046,11 (ovirt-hosted-engine-setup) is probably the reason behind
> recent system test failures in the "ovirt-master" change queue and needs
> to be
> fixed.
>

I don't think so. Failure is:

Error: Fault reason is "Operation Failed". Fault detail is "[Cannot
deactivate Storage while there are running tasks on this Storage.
-Please wait until tasks will finish and try again.]". HTTP response
code is 409.


in 007_sd_reattach.deactivate_storage_domain (from nosetests)

and sounds like a bug in the test suite not waiting for running task
completion before deactivating the storage.



>
> This change had been removed from the testing queue. Artifacts build from
> this
> change will not be released until it is fixed.
>
> For further details about the change see:
> https://gerrit.ovirt.org/#/c/88046/11
>
> For failed test results see:
> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866/
> ___
> Infra mailing list
> Infra@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/infra
>



-- 

SANDRO BONAZZOLA

ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R

Red Hat EMEA 

TRIED. TESTED. TRUSTED. 
___
Infra mailing list
Infra@ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra