Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Dafna Ron]

thanks Martin!
we have a passing build on 4.3 as well
thanks for all the help :)
Dafna


On Thu, Jun 13, 2019 at 2:34 PM Martin Perina  wrote:

>
>
> On Thu, Jun 13, 2019 at 2:32 PM Dafna Ron  wrote:
>
>> will monitor new change once merged :)
>>
>
>> On Thu, Jun 13, 2019 at 1:23 PM Martin Perina  wrote:
>>
>>>
>>>
>>> On Thu, Jun 13, 2019 at 2:02 PM Dafna Ron  wrote:
>>>
 4.3 is still failing.

 https://jenkins.ovirt.org/view/Change%20queue%20jobs/job/ovirt-4.3_change-queue-tester/1172/
 Martin, can you apply the change to 4.3 tests as well?

>>>
>>> Arghhh.
>>>
>>> I looked if master and 4.3 shares the same file when I started to work
>>> on the fix and they were the same.
>>> But at the same day I posted orignal patch, master and 4.3 were split :-(
>>>
>>> So hopefully here's the final fix: https://gerrit.ovirt.org/100809
>>>
>>
> Just merged the patch, manual OST verification was successful
>
>>
>>>
 On Thu, Jun 13, 2019 at 10:33 AM Dafna Ron  wrote:

> We have a passing build on master
> waiting for 4.3
>
> On Thu, Jun 13, 2019 at 9:01 AM Dafna Ron  wrote:
>
>> Thanks Shirly and Martin.
>> I see the patch was merged so monitoring and will update
>>
>> On Wed, Jun 12, 2019 at 4:09 PM Martin Perina 
>> wrote:
>>
>>>
>>>
>>> On Wed, Jun 12, 2019 at 11:53 AM Dafna Ron  wrote:
>>>
 latest tests are still failing on log collector

>>>
>>> I had a typo in my patch, here is the fix:
>>> https://gerrit.ovirt.org/#/c/100784/
>>> Currently trying to verify using manual OST to make sure latest VDSM
>>> is used (and not latest tested as in check-patch executed from the fix) 
>>> ...
>>>
>>>
 On Wed, Jun 12, 2019 at 10:18 AM Dafna Ron  wrote:

> thanks Martin.
> we are failing on missing packages so I have a patch to fix it.
> I will update once we have a vdsm build
>
> On Tue, Jun 11, 2019 at 10:08 PM Martin Perina 
> wrote:
>
>>
>>
>> On Tue, Jun 11, 2019 at 7:41 PM Martin Perina 
>> wrote:
>>
>>>
>>>
>>> On Tue, Jun 11, 2019 at 6:53 PM Dafna Ron 
>>> wrote:
>>>
 Galit's patch should have solved it.
 Marcin, are you still failing?

>>>
>>> I've just rebased https://gerrit.ovirt.org/100716 on top of
>>> Galit's change so we should know within an hour or so ...
>>>
>>
>> CI finished successfully, please review so we can merge ...
>>
>>
>>>

 On Tue, Jun 11, 2019 at 2:40 PM Eyal Edri 
 wrote:

>
>
> On Tue, Jun 11, 2019 at 4:35 PM Marcin Sobczyk <
> msobc...@redhat.com> wrote:
>
>> Hi,
>>
>> basic suite fails for the patch with the following log:
>>
>>  
>> [2019-06-11T11:34:26.175Z]
>>- STDERR
>>  
>> [2019-06-11T11:34:26.175Z]
>>  + yum -y install ovirt-host
>>  
>> [2019-06-11T11:34:26.175Z]
>>  Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 
>> (alocalsync)
>>  
>> [2019-06-11T11:34:26.175Z]
>> Requires: bind-license = 32:9.9.4-74.el7_6.1
>>  
>> [2019-06-11T11:34:26.175Z]
>> Installed: 32:bind-license-9.9.4-73.el7_6.noarch 
>> (installed)
>>  
>> [2019-06-11T11:34:26.175Z]
>> bind-license = 32:9.9.4-73.el7_6
>>
>>
> I think https://gerrit.ovirt.org/#/c/100691/ which was merged
> 2 hours ago should a

Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Martin Perina]

On Thu, Jun 13, 2019 at 2:32 PM Dafna Ron  wrote:

> will monitor new change once merged :)
>

> On Thu, Jun 13, 2019 at 1:23 PM Martin Perina  wrote:
>
>>
>>
>> On Thu, Jun 13, 2019 at 2:02 PM Dafna Ron  wrote:
>>
>>> 4.3 is still failing.
>>>
>>> https://jenkins.ovirt.org/view/Change%20queue%20jobs/job/ovirt-4.3_change-queue-tester/1172/
>>> Martin, can you apply the change to 4.3 tests as well?
>>>
>>
>> Arghhh.
>>
>> I looked if master and 4.3 shares the same file when I started to work on
>> the fix and they were the same.
>> But at the same day I posted orignal patch, master and 4.3 were split :-(
>>
>> So hopefully here's the final fix: https://gerrit.ovirt.org/100809
>>
>
Just merged the patch, manual OST verification was successful

>
>>
>>> On Thu, Jun 13, 2019 at 10:33 AM Dafna Ron  wrote:
>>>
 We have a passing build on master
 waiting for 4.3

 On Thu, Jun 13, 2019 at 9:01 AM Dafna Ron  wrote:

> Thanks Shirly and Martin.
> I see the patch was merged so monitoring and will update
>
> On Wed, Jun 12, 2019 at 4:09 PM Martin Perina 
> wrote:
>
>>
>>
>> On Wed, Jun 12, 2019 at 11:53 AM Dafna Ron  wrote:
>>
>>> latest tests are still failing on log collector
>>>
>>
>> I had a typo in my patch, here is the fix:
>> https://gerrit.ovirt.org/#/c/100784/
>> Currently trying to verify using manual OST to make sure latest VDSM
>> is used (and not latest tested as in check-patch executed from the fix) 
>> ...
>>
>>
>>> On Wed, Jun 12, 2019 at 10:18 AM Dafna Ron  wrote:
>>>
 thanks Martin.
 we are failing on missing packages so I have a patch to fix it.
 I will update once we have a vdsm build

 On Tue, Jun 11, 2019 at 10:08 PM Martin Perina 
 wrote:

>
>
> On Tue, Jun 11, 2019 at 7:41 PM Martin Perina 
> wrote:
>
>>
>>
>> On Tue, Jun 11, 2019 at 6:53 PM Dafna Ron 
>> wrote:
>>
>>> Galit's patch should have solved it.
>>> Marcin, are you still failing?
>>>
>>
>> I've just rebased https://gerrit.ovirt.org/100716 on top of
>> Galit's change so we should know within an hour or so ...
>>
>
> CI finished successfully, please review so we can merge ...
>
>
>>
>>>
>>> On Tue, Jun 11, 2019 at 2:40 PM Eyal Edri 
>>> wrote:
>>>


 On Tue, Jun 11, 2019 at 4:35 PM Marcin Sobczyk <
 msobc...@redhat.com> wrote:

> Hi,
>
> basic suite fails for the patch with the following log:
>
>  
> [2019-06-11T11:34:26.175Z]
>- STDERR
>  
> [2019-06-11T11:34:26.175Z]
>  + yum -y install ovirt-host
>  
> [2019-06-11T11:34:26.175Z]
>  Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 (alocalsync)
>  
> [2019-06-11T11:34:26.175Z]
> Requires: bind-license = 32:9.9.4-74.el7_6.1
>  
> [2019-06-11T11:34:26.175Z]
> Installed: 32:bind-license-9.9.4-73.el7_6.noarch 
> (installed)
>  
> [2019-06-11T11:34:26.175Z]
> bind-license = 32:9.9.4-73.el7_6
>
>
 I think https://gerrit.ovirt.org/#/c/100691/ which was merged
 2 hours ago should address this issue.
 Maybe other reposync files should be updated as well?


>  Seems unrelated and I'm having the same issue locally on my
> server.
> Dafna, do you have some insight regarding this dependency
>

Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Dafna Ron]

will monitor new change once merged :)

On Thu, Jun 13, 2019 at 1:23 PM Martin Perina  wrote:

>
>
> On Thu, Jun 13, 2019 at 2:02 PM Dafna Ron  wrote:
>
>> 4.3 is still failing.
>>
>> https://jenkins.ovirt.org/view/Change%20queue%20jobs/job/ovirt-4.3_change-queue-tester/1172/
>> Martin, can you apply the change to 4.3 tests as well?
>>
>
> Arghhh.
>
> I looked if master and 4.3 shares the same file when I started to work on
> the fix and they were the same.
> But at the same day I posted orignal patch, master and 4.3 were split :-(
>
> So hopefully here's the final fix: https://gerrit.ovirt.org/100809
>
>
>> On Thu, Jun 13, 2019 at 10:33 AM Dafna Ron  wrote:
>>
>>> We have a passing build on master
>>> waiting for 4.3
>>>
>>> On Thu, Jun 13, 2019 at 9:01 AM Dafna Ron  wrote:
>>>
 Thanks Shirly and Martin.
 I see the patch was merged so monitoring and will update

 On Wed, Jun 12, 2019 at 4:09 PM Martin Perina 
 wrote:

>
>
> On Wed, Jun 12, 2019 at 11:53 AM Dafna Ron  wrote:
>
>> latest tests are still failing on log collector
>>
>
> I had a typo in my patch, here is the fix:
> https://gerrit.ovirt.org/#/c/100784/
> Currently trying to verify using manual OST to make sure latest VDSM
> is used (and not latest tested as in check-patch executed from the fix) 
> ...
>
>
>> On Wed, Jun 12, 2019 at 10:18 AM Dafna Ron  wrote:
>>
>>> thanks Martin.
>>> we are failing on missing packages so I have a patch to fix it.
>>> I will update once we have a vdsm build
>>>
>>> On Tue, Jun 11, 2019 at 10:08 PM Martin Perina 
>>> wrote:
>>>


 On Tue, Jun 11, 2019 at 7:41 PM Martin Perina 
 wrote:

>
>
> On Tue, Jun 11, 2019 at 6:53 PM Dafna Ron  wrote:
>
>> Galit's patch should have solved it.
>> Marcin, are you still failing?
>>
>
> I've just rebased https://gerrit.ovirt.org/100716 on top of
> Galit's change so we should know within an hour or so ...
>

 CI finished successfully, please review so we can merge ...


>
>>
>> On Tue, Jun 11, 2019 at 2:40 PM Eyal Edri 
>> wrote:
>>
>>>
>>>
>>> On Tue, Jun 11, 2019 at 4:35 PM Marcin Sobczyk <
>>> msobc...@redhat.com> wrote:
>>>
 Hi,

 basic suite fails for the patch with the following log:

  
 [2019-06-11T11:34:26.175Z]
- STDERR
  
 [2019-06-11T11:34:26.175Z]
  + yum -y install ovirt-host
  
 [2019-06-11T11:34:26.175Z]
  Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 (alocalsync)
  
 [2019-06-11T11:34:26.175Z]
 Requires: bind-license = 32:9.9.4-74.el7_6.1
  
 [2019-06-11T11:34:26.175Z]
 Installed: 32:bind-license-9.9.4-73.el7_6.noarch 
 (installed)
  
 [2019-06-11T11:34:26.175Z]
 bind-license = 32:9.9.4-73.el7_6


>>> I think https://gerrit.ovirt.org/#/c/100691/ which was merged 2
>>> hours ago should address this issue.
>>> Maybe other reposync files should be updated as well?
>>>
>>>
  Seems unrelated and I'm having the same issue locally on my
 server.
 Dafna, do you have some insight regarding this dependency error?

 Thanks, Marcin
 On 6/11/19 1:15 PM, Martin Perina wrote:



 On Tue, Jun 11, 2019 at 11:58 AM Milan Zamazal <
 mzama...@redhat.com> wrote:

>>

Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Martin Perina]

On Thu, Jun 13, 2019 at 2:02 PM Dafna Ron  wrote:

> 4.3 is still failing.
>
> https://jenkins.ovirt.org/view/Change%20queue%20jobs/job/ovirt-4.3_change-queue-tester/1172/
> Martin, can you apply the change to 4.3 tests as well?
>

Arghhh.

I looked if master and 4.3 shares the same file when I started to work on
the fix and they were the same.
But at the same day I posted orignal patch, master and 4.3 were split :-(

So hopefully here's the final fix: https://gerrit.ovirt.org/100809


> On Thu, Jun 13, 2019 at 10:33 AM Dafna Ron  wrote:
>
>> We have a passing build on master
>> waiting for 4.3
>>
>> On Thu, Jun 13, 2019 at 9:01 AM Dafna Ron  wrote:
>>
>>> Thanks Shirly and Martin.
>>> I see the patch was merged so monitoring and will update
>>>
>>> On Wed, Jun 12, 2019 at 4:09 PM Martin Perina 
>>> wrote:
>>>


 On Wed, Jun 12, 2019 at 11:53 AM Dafna Ron  wrote:

> latest tests are still failing on log collector
>

 I had a typo in my patch, here is the fix:
 https://gerrit.ovirt.org/#/c/100784/
 Currently trying to verify using manual OST to make sure latest VDSM is
 used (and not latest tested as in check-patch executed from the fix) ...


> On Wed, Jun 12, 2019 at 10:18 AM Dafna Ron  wrote:
>
>> thanks Martin.
>> we are failing on missing packages so I have a patch to fix it.
>> I will update once we have a vdsm build
>>
>> On Tue, Jun 11, 2019 at 10:08 PM Martin Perina 
>> wrote:
>>
>>>
>>>
>>> On Tue, Jun 11, 2019 at 7:41 PM Martin Perina 
>>> wrote:
>>>


 On Tue, Jun 11, 2019 at 6:53 PM Dafna Ron  wrote:

> Galit's patch should have solved it.
> Marcin, are you still failing?
>

 I've just rebased https://gerrit.ovirt.org/100716 on top of
 Galit's change so we should know within an hour or so ...

>>>
>>> CI finished successfully, please review so we can merge ...
>>>
>>>

>
> On Tue, Jun 11, 2019 at 2:40 PM Eyal Edri 
> wrote:
>
>>
>>
>> On Tue, Jun 11, 2019 at 4:35 PM Marcin Sobczyk <
>> msobc...@redhat.com> wrote:
>>
>>> Hi,
>>>
>>> basic suite fails for the patch with the following log:
>>>
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>>- STDERR
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>>  + yum -y install ovirt-host
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>>  Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 (alocalsync)
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>> Requires: bind-license = 32:9.9.4-74.el7_6.1
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>> Installed: 32:bind-license-9.9.4-73.el7_6.noarch 
>>> (installed)
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>> bind-license = 32:9.9.4-73.el7_6
>>>
>>>
>> I think https://gerrit.ovirt.org/#/c/100691/ which was merged 2
>> hours ago should address this issue.
>> Maybe other reposync files should be updated as well?
>>
>>
>>>  Seems unrelated and I'm having the same issue locally on my
>>> server.
>>> Dafna, do you have some insight regarding this dependency error?
>>>
>>> Thanks, Marcin
>>> On 6/11/19 1:15 PM, Martin Perina wrote:
>>>
>>>
>>>
>>> On Tue, Jun 11, 2019 at 11:58 AM Milan Zamazal <
>>> mzama...@redhat.com> wrote:
>>>
 Dafna Ron  writes:

 > Hi,
 >
 > Please note vdsm has been broken since Fri the 7th
 >
 > to summarize again,  vdsm has a patch to remove sos plugin

Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Dafna Ron]

4.3 is still failing.
https://jenkins.ovirt.org/view/Change%20queue%20jobs/job/ovirt-4.3_change-queue-tester/1172/
Martin, can you apply the change to 4.3 tests as well?

On Thu, Jun 13, 2019 at 10:33 AM Dafna Ron  wrote:

> We have a passing build on master
> waiting for 4.3
>
> On Thu, Jun 13, 2019 at 9:01 AM Dafna Ron  wrote:
>
>> Thanks Shirly and Martin.
>> I see the patch was merged so monitoring and will update
>>
>> On Wed, Jun 12, 2019 at 4:09 PM Martin Perina  wrote:
>>
>>>
>>>
>>> On Wed, Jun 12, 2019 at 11:53 AM Dafna Ron  wrote:
>>>
 latest tests are still failing on log collector

>>>
>>> I had a typo in my patch, here is the fix:
>>> https://gerrit.ovirt.org/#/c/100784/
>>> Currently trying to verify using manual OST to make sure latest VDSM is
>>> used (and not latest tested as in check-patch executed from the fix) ...
>>>
>>>
 On Wed, Jun 12, 2019 at 10:18 AM Dafna Ron  wrote:

> thanks Martin.
> we are failing on missing packages so I have a patch to fix it.
> I will update once we have a vdsm build
>
> On Tue, Jun 11, 2019 at 10:08 PM Martin Perina 
> wrote:
>
>>
>>
>> On Tue, Jun 11, 2019 at 7:41 PM Martin Perina 
>> wrote:
>>
>>>
>>>
>>> On Tue, Jun 11, 2019 at 6:53 PM Dafna Ron  wrote:
>>>
 Galit's patch should have solved it.
 Marcin, are you still failing?

>>>
>>> I've just rebased https://gerrit.ovirt.org/100716 on top of Galit's
>>> change so we should know within an hour or so ...
>>>
>>
>> CI finished successfully, please review so we can merge ...
>>
>>
>>>

 On Tue, Jun 11, 2019 at 2:40 PM Eyal Edri  wrote:

>
>
> On Tue, Jun 11, 2019 at 4:35 PM Marcin Sobczyk <
> msobc...@redhat.com> wrote:
>
>> Hi,
>>
>> basic suite fails for the patch with the following log:
>>
>>  
>> [2019-06-11T11:34:26.175Z]
>>- STDERR
>>  
>> [2019-06-11T11:34:26.175Z]
>>  + yum -y install ovirt-host
>>  
>> [2019-06-11T11:34:26.175Z]
>>  Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 (alocalsync)
>>  
>> [2019-06-11T11:34:26.175Z]
>> Requires: bind-license = 32:9.9.4-74.el7_6.1
>>  
>> [2019-06-11T11:34:26.175Z]
>> Installed: 32:bind-license-9.9.4-73.el7_6.noarch 
>> (installed)
>>  
>> [2019-06-11T11:34:26.175Z]
>> bind-license = 32:9.9.4-73.el7_6
>>
>>
> I think https://gerrit.ovirt.org/#/c/100691/ which was merged 2
> hours ago should address this issue.
> Maybe other reposync files should be updated as well?
>
>
>>  Seems unrelated and I'm having the same issue locally on my
>> server.
>> Dafna, do you have some insight regarding this dependency error?
>>
>> Thanks, Marcin
>> On 6/11/19 1:15 PM, Martin Perina wrote:
>>
>>
>>
>> On Tue, Jun 11, 2019 at 11:58 AM Milan Zamazal <
>> mzama...@redhat.com> wrote:
>>
>>> Dafna Ron  writes:
>>>
>>> > Hi,
>>> >
>>> > Please note vdsm has been broken since Fri the 7th
>>> >
>>> > to summarize again,  vdsm has a patch to remove sos plugin
>>> which is what
>>> > metrics is using in its ost tests
>>> > due to that, vdsm is failing the metrics tests and in order to
>>> solve it we
>>> > need to make a choice:
>>> > 1. fix the metrics tests to not use sos
>>> > 2. disable the metrics tests
>>> > 3. revert the sos patch until a decision is made on ^^
>>>
>>> #3 is not an option, it would make Vdsm uninstallable

Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Dafna Ron]

We have a passing build on master
waiting for 4.3

On Thu, Jun 13, 2019 at 9:01 AM Dafna Ron  wrote:

> Thanks Shirly and Martin.
> I see the patch was merged so monitoring and will update
>
> On Wed, Jun 12, 2019 at 4:09 PM Martin Perina  wrote:
>
>>
>>
>> On Wed, Jun 12, 2019 at 11:53 AM Dafna Ron  wrote:
>>
>>> latest tests are still failing on log collector
>>>
>>
>> I had a typo in my patch, here is the fix:
>> https://gerrit.ovirt.org/#/c/100784/
>> Currently trying to verify using manual OST to make sure latest VDSM is
>> used (and not latest tested as in check-patch executed from the fix) ...
>>
>>
>>> On Wed, Jun 12, 2019 at 10:18 AM Dafna Ron  wrote:
>>>
 thanks Martin.
 we are failing on missing packages so I have a patch to fix it.
 I will update once we have a vdsm build

 On Tue, Jun 11, 2019 at 10:08 PM Martin Perina 
 wrote:

>
>
> On Tue, Jun 11, 2019 at 7:41 PM Martin Perina 
> wrote:
>
>>
>>
>> On Tue, Jun 11, 2019 at 6:53 PM Dafna Ron  wrote:
>>
>>> Galit's patch should have solved it.
>>> Marcin, are you still failing?
>>>
>>
>> I've just rebased https://gerrit.ovirt.org/100716 on top of Galit's
>> change so we should know within an hour or so ...
>>
>
> CI finished successfully, please review so we can merge ...
>
>
>>
>>>
>>> On Tue, Jun 11, 2019 at 2:40 PM Eyal Edri  wrote:
>>>


 On Tue, Jun 11, 2019 at 4:35 PM Marcin Sobczyk 
 wrote:

> Hi,
>
> basic suite fails for the patch with the following log:
>
>  
> [2019-06-11T11:34:26.175Z]
>- STDERR
>  
> [2019-06-11T11:34:26.175Z]
>  + yum -y install ovirt-host
>  
> [2019-06-11T11:34:26.175Z]
>  Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 (alocalsync)
>  
> [2019-06-11T11:34:26.175Z]
> Requires: bind-license = 32:9.9.4-74.el7_6.1
>  
> [2019-06-11T11:34:26.175Z]
> Installed: 32:bind-license-9.9.4-73.el7_6.noarch 
> (installed)
>  
> [2019-06-11T11:34:26.175Z]
> bind-license = 32:9.9.4-73.el7_6
>
>
 I think https://gerrit.ovirt.org/#/c/100691/ which was merged 2
 hours ago should address this issue.
 Maybe other reposync files should be updated as well?


>  Seems unrelated and I'm having the same issue locally on my
> server.
> Dafna, do you have some insight regarding this dependency error?
>
> Thanks, Marcin
> On 6/11/19 1:15 PM, Martin Perina wrote:
>
>
>
> On Tue, Jun 11, 2019 at 11:58 AM Milan Zamazal <
> mzama...@redhat.com> wrote:
>
>> Dafna Ron  writes:
>>
>> > Hi,
>> >
>> > Please note vdsm has been broken since Fri the 7th
>> >
>> > to summarize again,  vdsm has a patch to remove sos plugin
>> which is what
>> > metrics is using in its ost tests
>> > due to that, vdsm is failing the metrics tests and in order to
>> solve it we
>> > need to make a choice:
>> > 1. fix the metrics tests to not use sos
>> > 2. disable the metrics tests
>> > 3. revert the sos patch until a decision is made on ^^
>>
>> #3 is not an option, it would make Vdsm uninstallable on newer
>> RHEL
>> versions.
>>
>
> I've posted a patch https://gerrit.ovirt.org/100716 which is
> trying to install vdsm sos plugin if it's not installed either by 
> vdsm nor
> sos.
> Currenlty waiting for CI, if run is successfull, I will extend the
> patch also for 4.3 basic suite.

Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Dafna Ron]

Thanks Shirly and Martin.
I see the patch was merged so monitoring and will update

On Wed, Jun 12, 2019 at 4:09 PM Martin Perina  wrote:

>
>
> On Wed, Jun 12, 2019 at 11:53 AM Dafna Ron  wrote:
>
>> latest tests are still failing on log collector
>>
>
> I had a typo in my patch, here is the fix:
> https://gerrit.ovirt.org/#/c/100784/
> Currently trying to verify using manual OST to make sure latest VDSM is
> used (and not latest tested as in check-patch executed from the fix) ...
>
>
>> On Wed, Jun 12, 2019 at 10:18 AM Dafna Ron  wrote:
>>
>>> thanks Martin.
>>> we are failing on missing packages so I have a patch to fix it.
>>> I will update once we have a vdsm build
>>>
>>> On Tue, Jun 11, 2019 at 10:08 PM Martin Perina 
>>> wrote:
>>>


 On Tue, Jun 11, 2019 at 7:41 PM Martin Perina 
 wrote:

>
>
> On Tue, Jun 11, 2019 at 6:53 PM Dafna Ron  wrote:
>
>> Galit's patch should have solved it.
>> Marcin, are you still failing?
>>
>
> I've just rebased https://gerrit.ovirt.org/100716 on top of Galit's
> change so we should know within an hour or so ...
>

 CI finished successfully, please review so we can merge ...


>
>>
>> On Tue, Jun 11, 2019 at 2:40 PM Eyal Edri  wrote:
>>
>>>
>>>
>>> On Tue, Jun 11, 2019 at 4:35 PM Marcin Sobczyk 
>>> wrote:
>>>
 Hi,

 basic suite fails for the patch with the following log:

  
 [2019-06-11T11:34:26.175Z]
- STDERR
  
 [2019-06-11T11:34:26.175Z]
  + yum -y install ovirt-host
  
 [2019-06-11T11:34:26.175Z]
  Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 (alocalsync)
  
 [2019-06-11T11:34:26.175Z]
 Requires: bind-license = 32:9.9.4-74.el7_6.1
  
 [2019-06-11T11:34:26.175Z]
 Installed: 32:bind-license-9.9.4-73.el7_6.noarch 
 (installed)
  
 [2019-06-11T11:34:26.175Z]
 bind-license = 32:9.9.4-73.el7_6


>>> I think https://gerrit.ovirt.org/#/c/100691/ which was merged 2
>>> hours ago should address this issue.
>>> Maybe other reposync files should be updated as well?
>>>
>>>
  Seems unrelated and I'm having the same issue locally on my server.
 Dafna, do you have some insight regarding this dependency error?

 Thanks, Marcin
 On 6/11/19 1:15 PM, Martin Perina wrote:



 On Tue, Jun 11, 2019 at 11:58 AM Milan Zamazal 
 wrote:

> Dafna Ron  writes:
>
> > Hi,
> >
> > Please note vdsm has been broken since Fri the 7th
> >
> > to summarize again,  vdsm has a patch to remove sos plugin which
> is what
> > metrics is using in its ost tests
> > due to that, vdsm is failing the metrics tests and in order to
> solve it we
> > need to make a choice:
> > 1. fix the metrics tests to not use sos
> > 2. disable the metrics tests
> > 3. revert the sos patch until a decision is made on ^^
>
> #3 is not an option, it would make Vdsm uninstallable on newer RHEL
> versions.
>

 I've posted a patch https://gerrit.ovirt.org/100716 which is
 trying to install vdsm sos plugin if it's not installed either by vdsm 
 nor
 sos.
 Currenlty waiting for CI, if run is successfull, I will extend the
 patch also for 4.3 basic suite.


> > Thanks,
> > Dafna
> >
> >
> > -- Forwarded message -
> > From: Dafna Ron 
> > Date: Mon, Jun 10, 2019 at 1:30 PM
> > Subject: Re: [ OST Failure Report ] [ oVirt Master 

Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Martin Perina]

On Wed, Jun 12, 2019 at 11:53 AM Dafna Ron  wrote:

> latest tests are still failing on log collector
>

I had a typo in my patch, here is the fix:
https://gerrit.ovirt.org/#/c/100784/
Currently trying to verify using manual OST to make sure latest VDSM is
used (and not latest tested as in check-patch executed from the fix) ...


> On Wed, Jun 12, 2019 at 10:18 AM Dafna Ron  wrote:
>
>> thanks Martin.
>> we are failing on missing packages so I have a patch to fix it.
>> I will update once we have a vdsm build
>>
>> On Tue, Jun 11, 2019 at 10:08 PM Martin Perina 
>> wrote:
>>
>>>
>>>
>>> On Tue, Jun 11, 2019 at 7:41 PM Martin Perina 
>>> wrote:
>>>


 On Tue, Jun 11, 2019 at 6:53 PM Dafna Ron  wrote:

> Galit's patch should have solved it.
> Marcin, are you still failing?
>

 I've just rebased https://gerrit.ovirt.org/100716 on top of Galit's
 change so we should know within an hour or so ...

>>>
>>> CI finished successfully, please review so we can merge ...
>>>
>>>

>
> On Tue, Jun 11, 2019 at 2:40 PM Eyal Edri  wrote:
>
>>
>>
>> On Tue, Jun 11, 2019 at 4:35 PM Marcin Sobczyk 
>> wrote:
>>
>>> Hi,
>>>
>>> basic suite fails for the patch with the following log:
>>>
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>>- STDERR
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>>  + yum -y install ovirt-host
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>>  Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 (alocalsync)
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>> Requires: bind-license = 32:9.9.4-74.el7_6.1
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>> Installed: 32:bind-license-9.9.4-73.el7_6.noarch (installed)
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>> bind-license = 32:9.9.4-73.el7_6
>>>
>>>
>> I think https://gerrit.ovirt.org/#/c/100691/ which was merged 2
>> hours ago should address this issue.
>> Maybe other reposync files should be updated as well?
>>
>>
>>>  Seems unrelated and I'm having the same issue locally on my server.
>>> Dafna, do you have some insight regarding this dependency error?
>>>
>>> Thanks, Marcin
>>> On 6/11/19 1:15 PM, Martin Perina wrote:
>>>
>>>
>>>
>>> On Tue, Jun 11, 2019 at 11:58 AM Milan Zamazal 
>>> wrote:
>>>
 Dafna Ron  writes:

 > Hi,
 >
 > Please note vdsm has been broken since Fri the 7th
 >
 > to summarize again,  vdsm has a patch to remove sos plugin which
 is what
 > metrics is using in its ost tests
 > due to that, vdsm is failing the metrics tests and in order to
 solve it we
 > need to make a choice:
 > 1. fix the metrics tests to not use sos
 > 2. disable the metrics tests
 > 3. revert the sos patch until a decision is made on ^^

 #3 is not an option, it would make Vdsm uninstallable on newer RHEL
 versions.

>>>
>>> I've posted a patch https://gerrit.ovirt.org/100716 which is trying
>>> to install vdsm sos plugin if it's not installed either by vdsm nor sos.
>>> Currenlty waiting for CI, if run is successfull, I will extend the
>>> patch also for 4.3 basic suite.
>>>
>>>
 > Thanks,
 > Dafna
 >
 >
 > -- Forwarded message -
 > From: Dafna Ron 
 > Date: Mon, Jun 10, 2019 at 1:30 PM
 > Subject: Re: [ OST Failure Report ] [ oVirt Master (vdsm) ] [
 07-06-2019 ]
 > [ 003_00_metrics_bootstrap.metrics_and_log_collector ]
 > To: Martin Perina , Milan Zamazal <
 mzama...@redhat.com>,
 > Shirly Radco 
 > Cc: devel , infra 
 >
 >
 > Shirly? any update on this?
>>>

Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Shirly Radco]

Hi Dafna,

Apologise for not communicating on this earlier.

I set with Galit yesterday on this issue and when I saw that Martin sent a
patch and that this issue is related to the latest vdsm and sos report
changes, I left it to him.

I asked Sandro to help with metrics issues that are integration related.

Please consider that since our 4.2 release was broken, and we promised that
in 4.3 it is now safe to install, we now have many customers trying out
metrics along with users from the community that request my help.
A lot of the issues we find are more related to integration of RHV and
OpenShift.
Im sure that with Sandro's help we will be able to address the issues
faster.

Best regards,

Shirly

On Wed, Jun 12, 2019, 15:30 Dafna Ron  wrote:

> latest tests are still failing on log collector
>
> On Wed, Jun 12, 2019 at 10:18 AM Dafna Ron  wrote:
>
>> thanks Martin.
>> we are failing on missing packages so I have a patch to fix it.
>> I will update once we have a vdsm build
>>
>> On Tue, Jun 11, 2019 at 10:08 PM Martin Perina 
>> wrote:
>>
>>>
>>>
>>> On Tue, Jun 11, 2019 at 7:41 PM Martin Perina 
>>> wrote:
>>>


 On Tue, Jun 11, 2019 at 6:53 PM Dafna Ron  wrote:

> Galit's patch should have solved it.
> Marcin, are you still failing?
>

 I've just rebased https://gerrit.ovirt.org/100716 on top of Galit's
 change so we should know within an hour or so ...

>>>
>>> CI finished successfully, please review so we can merge ...
>>>
>>>

>
> On Tue, Jun 11, 2019 at 2:40 PM Eyal Edri  wrote:
>
>>
>>
>> On Tue, Jun 11, 2019 at 4:35 PM Marcin Sobczyk 
>> wrote:
>>
>>> Hi,
>>>
>>> basic suite fails for the patch with the following log:
>>>
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>>- STDERR
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>>  + yum -y install ovirt-host
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>>  Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 (alocalsync)
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>> Requires: bind-license = 32:9.9.4-74.el7_6.1
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>> Installed: 32:bind-license-9.9.4-73.el7_6.noarch (installed)
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>> bind-license = 32:9.9.4-73.el7_6
>>>
>>>
>> I think https://gerrit.ovirt.org/#/c/100691/ which was merged 2
>> hours ago should address this issue.
>> Maybe other reposync files should be updated as well?
>>
>>
>>>  Seems unrelated and I'm having the same issue locally on my server.
>>> Dafna, do you have some insight regarding this dependency error?
>>>
>>> Thanks, Marcin
>>> On 6/11/19 1:15 PM, Martin Perina wrote:
>>>
>>>
>>>
>>> On Tue, Jun 11, 2019 at 11:58 AM Milan Zamazal 
>>> wrote:
>>>
 Dafna Ron  writes:

 > Hi,
 >
 > Please note vdsm has been broken since Fri the 7th
 >
 > to summarize again,  vdsm has a patch to remove sos plugin which
 is what
 > metrics is using in its ost tests
 > due to that, vdsm is failing the metrics tests and in order to
 solve it we
 > need to make a choice:
 > 1. fix the metrics tests to not use sos
 > 2. disable the metrics tests
 > 3. revert the sos patch until a decision is made on ^^

 #3 is not an option, it would make Vdsm uninstallable on newer RHEL
 versions.

>>>
>>> I've posted a patch https://gerrit.ovirt.org/100716 which is trying
>>> to install vdsm sos plugin if it's not installed either by vdsm nor sos.
>>> Currenlty waiting for CI, if run is successfull, I will extend the
>>> patch also for 4.3 basic suite.
>>>
>>>
 > Thanks,
 > Dafna
 >
 >
 > -

Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Dafna Ron]

latest tests are still failing on log collector

On Wed, Jun 12, 2019 at 10:18 AM Dafna Ron  wrote:

> thanks Martin.
> we are failing on missing packages so I have a patch to fix it.
> I will update once we have a vdsm build
>
> On Tue, Jun 11, 2019 at 10:08 PM Martin Perina  wrote:
>
>>
>>
>> On Tue, Jun 11, 2019 at 7:41 PM Martin Perina  wrote:
>>
>>>
>>>
>>> On Tue, Jun 11, 2019 at 6:53 PM Dafna Ron  wrote:
>>>
 Galit's patch should have solved it.
 Marcin, are you still failing?

>>>
>>> I've just rebased https://gerrit.ovirt.org/100716 on top of Galit's
>>> change so we should know within an hour or so ...
>>>
>>
>> CI finished successfully, please review so we can merge ...
>>
>>
>>>

 On Tue, Jun 11, 2019 at 2:40 PM Eyal Edri  wrote:

>
>
> On Tue, Jun 11, 2019 at 4:35 PM Marcin Sobczyk 
> wrote:
>
>> Hi,
>>
>> basic suite fails for the patch with the following log:
>>
>>  
>> [2019-06-11T11:34:26.175Z]
>>- STDERR
>>  
>> [2019-06-11T11:34:26.175Z]
>>  + yum -y install ovirt-host
>>  
>> [2019-06-11T11:34:26.175Z]
>>  Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 (alocalsync)
>>  
>> [2019-06-11T11:34:26.175Z]
>> Requires: bind-license = 32:9.9.4-74.el7_6.1
>>  
>> [2019-06-11T11:34:26.175Z]
>> Installed: 32:bind-license-9.9.4-73.el7_6.noarch (installed)
>>  
>> [2019-06-11T11:34:26.175Z]
>> bind-license = 32:9.9.4-73.el7_6
>>
>>
> I think https://gerrit.ovirt.org/#/c/100691/ which was merged 2 hours
> ago should address this issue.
> Maybe other reposync files should be updated as well?
>
>
>>  Seems unrelated and I'm having the same issue locally on my server.
>> Dafna, do you have some insight regarding this dependency error?
>>
>> Thanks, Marcin
>> On 6/11/19 1:15 PM, Martin Perina wrote:
>>
>>
>>
>> On Tue, Jun 11, 2019 at 11:58 AM Milan Zamazal 
>> wrote:
>>
>>> Dafna Ron  writes:
>>>
>>> > Hi,
>>> >
>>> > Please note vdsm has been broken since Fri the 7th
>>> >
>>> > to summarize again,  vdsm has a patch to remove sos plugin which
>>> is what
>>> > metrics is using in its ost tests
>>> > due to that, vdsm is failing the metrics tests and in order to
>>> solve it we
>>> > need to make a choice:
>>> > 1. fix the metrics tests to not use sos
>>> > 2. disable the metrics tests
>>> > 3. revert the sos patch until a decision is made on ^^
>>>
>>> #3 is not an option, it would make Vdsm uninstallable on newer RHEL
>>> versions.
>>>
>>
>> I've posted a patch https://gerrit.ovirt.org/100716 which is trying
>> to install vdsm sos plugin if it's not installed either by vdsm nor sos.
>> Currenlty waiting for CI, if run is successfull, I will extend the
>> patch also for 4.3 basic suite.
>>
>>
>>> > Thanks,
>>> > Dafna
>>> >
>>> >
>>> > -- Forwarded message -
>>> > From: Dafna Ron 
>>> > Date: Mon, Jun 10, 2019 at 1:30 PM
>>> > Subject: Re: [ OST Failure Report ] [ oVirt Master (vdsm) ] [
>>> 07-06-2019 ]
>>> > [ 003_00_metrics_bootstrap.metrics_and_log_collector ]
>>> > To: Martin Perina , Milan Zamazal <
>>> mzama...@redhat.com>,
>>> > Shirly Radco 
>>> > Cc: devel , infra 
>>> >
>>> >
>>> > Shirly? any update on this?
>>> >
>>> > On Fri, Jun 7, 2019 at 11:54 AM Dafna Ron  wrote:
>>> >
>>> >> Hi,
>>> >>
>>> >> We have a failure in vdsm project on master.
>>> >>
>>> >> The issue is change:
>>> >> https://gerrit.ovirt.org/#/c/100576/ - Remove SOS VDSM plugin
>>> >>
>>> >> which is failing on metrics as metrics is calling
>>> sos-logcollector.
>>> >>
>>> >> The patch cannot be

Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Dafna Ron]

thanks Martin.
we are failing on missing packages so I have a patch to fix it.
I will update once we have a vdsm build

On Tue, Jun 11, 2019 at 10:08 PM Martin Perina  wrote:

>
>
> On Tue, Jun 11, 2019 at 7:41 PM Martin Perina  wrote:
>
>>
>>
>> On Tue, Jun 11, 2019 at 6:53 PM Dafna Ron  wrote:
>>
>>> Galit's patch should have solved it.
>>> Marcin, are you still failing?
>>>
>>
>> I've just rebased https://gerrit.ovirt.org/100716 on top of Galit's
>> change so we should know within an hour or so ...
>>
>
> CI finished successfully, please review so we can merge ...
>
>
>>
>>>
>>> On Tue, Jun 11, 2019 at 2:40 PM Eyal Edri  wrote:
>>>


 On Tue, Jun 11, 2019 at 4:35 PM Marcin Sobczyk 
 wrote:

> Hi,
>
> basic suite fails for the patch with the following log:
>
>  
> [2019-06-11T11:34:26.175Z]
>- STDERR
>  
> [2019-06-11T11:34:26.175Z]
>  + yum -y install ovirt-host
>  
> [2019-06-11T11:34:26.175Z]
>  Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 (alocalsync)
>  
> [2019-06-11T11:34:26.175Z]
> Requires: bind-license = 32:9.9.4-74.el7_6.1
>  
> [2019-06-11T11:34:26.175Z]
> Installed: 32:bind-license-9.9.4-73.el7_6.noarch (installed)
>  
> [2019-06-11T11:34:26.175Z]
> bind-license = 32:9.9.4-73.el7_6
>
>
 I think https://gerrit.ovirt.org/#/c/100691/ which was merged 2 hours
 ago should address this issue.
 Maybe other reposync files should be updated as well?


>  Seems unrelated and I'm having the same issue locally on my server.
> Dafna, do you have some insight regarding this dependency error?
>
> Thanks, Marcin
> On 6/11/19 1:15 PM, Martin Perina wrote:
>
>
>
> On Tue, Jun 11, 2019 at 11:58 AM Milan Zamazal 
> wrote:
>
>> Dafna Ron  writes:
>>
>> > Hi,
>> >
>> > Please note vdsm has been broken since Fri the 7th
>> >
>> > to summarize again,  vdsm has a patch to remove sos plugin which is
>> what
>> > metrics is using in its ost tests
>> > due to that, vdsm is failing the metrics tests and in order to
>> solve it we
>> > need to make a choice:
>> > 1. fix the metrics tests to not use sos
>> > 2. disable the metrics tests
>> > 3. revert the sos patch until a decision is made on ^^
>>
>> #3 is not an option, it would make Vdsm uninstallable on newer RHEL
>> versions.
>>
>
> I've posted a patch https://gerrit.ovirt.org/100716 which is trying
> to install vdsm sos plugin if it's not installed either by vdsm nor sos.
> Currenlty waiting for CI, if run is successfull, I will extend the
> patch also for 4.3 basic suite.
>
>
>> > Thanks,
>> > Dafna
>> >
>> >
>> > -- Forwarded message -
>> > From: Dafna Ron 
>> > Date: Mon, Jun 10, 2019 at 1:30 PM
>> > Subject: Re: [ OST Failure Report ] [ oVirt Master (vdsm) ] [
>> 07-06-2019 ]
>> > [ 003_00_metrics_bootstrap.metrics_and_log_collector ]
>> > To: Martin Perina , Milan Zamazal <
>> mzama...@redhat.com>,
>> > Shirly Radco 
>> > Cc: devel , infra 
>> >
>> >
>> > Shirly? any update on this?
>> >
>> > On Fri, Jun 7, 2019 at 11:54 AM Dafna Ron  wrote:
>> >
>> >> Hi,
>> >>
>> >> We have a failure in vdsm project on master.
>> >>
>> >> The issue is change:
>> >> https://gerrit.ovirt.org/#/c/100576/ - Remove SOS VDSM plugin
>> >>
>> >> which is failing on metrics as metrics is calling sos-logcollector.
>> >>
>> >> The patch cannot be changed as until centos 7.7 when sos-3.7-3,
>> which
>> >> contains vdsm plugin will come out.
>> >> so until then, we are left with no sos plugin, which is causing the
>> >> metrics test to fail.
>> >>
>> >> Shirly, c

Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Martin Perina]

On Tue, Jun 11, 2019 at 7:41 PM Martin Perina  wrote:

>
>
> On Tue, Jun 11, 2019 at 6:53 PM Dafna Ron  wrote:
>
>> Galit's patch should have solved it.
>> Marcin, are you still failing?
>>
>
> I've just rebased https://gerrit.ovirt.org/100716 on top of Galit's
> change so we should know within an hour or so ...
>

CI finished successfully, please review so we can merge ...


>
>>
>> On Tue, Jun 11, 2019 at 2:40 PM Eyal Edri  wrote:
>>
>>>
>>>
>>> On Tue, Jun 11, 2019 at 4:35 PM Marcin Sobczyk 
>>> wrote:
>>>
 Hi,

 basic suite fails for the patch with the following log:

  
 [2019-06-11T11:34:26.175Z]
- STDERR
  
 [2019-06-11T11:34:26.175Z]
  + yum -y install ovirt-host
  
 [2019-06-11T11:34:26.175Z]
  Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 (alocalsync)
  
 [2019-06-11T11:34:26.175Z]
 Requires: bind-license = 32:9.9.4-74.el7_6.1
  
 [2019-06-11T11:34:26.175Z]
 Installed: 32:bind-license-9.9.4-73.el7_6.noarch (installed)
  
 [2019-06-11T11:34:26.175Z]
 bind-license = 32:9.9.4-73.el7_6


>>> I think https://gerrit.ovirt.org/#/c/100691/ which was merged 2 hours
>>> ago should address this issue.
>>> Maybe other reposync files should be updated as well?
>>>
>>>
  Seems unrelated and I'm having the same issue locally on my server.
 Dafna, do you have some insight regarding this dependency error?

 Thanks, Marcin
 On 6/11/19 1:15 PM, Martin Perina wrote:



 On Tue, Jun 11, 2019 at 11:58 AM Milan Zamazal 
 wrote:

> Dafna Ron  writes:
>
> > Hi,
> >
> > Please note vdsm has been broken since Fri the 7th
> >
> > to summarize again,  vdsm has a patch to remove sos plugin which is
> what
> > metrics is using in its ost tests
> > due to that, vdsm is failing the metrics tests and in order to solve
> it we
> > need to make a choice:
> > 1. fix the metrics tests to not use sos
> > 2. disable the metrics tests
> > 3. revert the sos patch until a decision is made on ^^
>
> #3 is not an option, it would make Vdsm uninstallable on newer RHEL
> versions.
>

 I've posted a patch https://gerrit.ovirt.org/100716 which is trying to
 install vdsm sos plugin if it's not installed either by vdsm nor sos.
 Currenlty waiting for CI, if run is successfull, I will extend the
 patch also for 4.3 basic suite.


> > Thanks,
> > Dafna
> >
> >
> > -- Forwarded message -
> > From: Dafna Ron 
> > Date: Mon, Jun 10, 2019 at 1:30 PM
> > Subject: Re: [ OST Failure Report ] [ oVirt Master (vdsm) ] [
> 07-06-2019 ]
> > [ 003_00_metrics_bootstrap.metrics_and_log_collector ]
> > To: Martin Perina , Milan Zamazal <
> mzama...@redhat.com>,
> > Shirly Radco 
> > Cc: devel , infra 
> >
> >
> > Shirly? any update on this?
> >
> > On Fri, Jun 7, 2019 at 11:54 AM Dafna Ron  wrote:
> >
> >> Hi,
> >>
> >> We have a failure in vdsm project on master.
> >>
> >> The issue is change:
> >> https://gerrit.ovirt.org/#/c/100576/ - Remove SOS VDSM plugin
> >>
> >> which is failing on metrics as metrics is calling sos-logcollector.
> >>
> >> The patch cannot be changed as until centos 7.7 when sos-3.7-3,
> which
> >> contains vdsm plugin will come out.
> >> so until then, we are left with no sos plugin, which is causing the
> >> metrics test to fail.
> >>
> >> Shirly, can you please take a look and see if we can change the
> test to
> >> not call sos-logcollector?
> >> Please note, that we are expecting 4.3 to fail on same issue very
> soon.
> >>
> >> failed job can be found here:
> >>
> >>
> https://jenkins.ovirt.org/job/ovirt-master_cha

Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Martin Perina]

On Tue, Jun 11, 2019 at 6:53 PM Dafna Ron  wrote:

> Galit's patch should have solved it.
> Marcin, are you still failing?
>

I've just rebased https://gerrit.ovirt.org/100716 on top of Galit's change
so we should know within an hour or so ...


>
> On Tue, Jun 11, 2019 at 2:40 PM Eyal Edri  wrote:
>
>>
>>
>> On Tue, Jun 11, 2019 at 4:35 PM Marcin Sobczyk 
>> wrote:
>>
>>> Hi,
>>>
>>> basic suite fails for the patch with the following log:
>>>
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>>- STDERR
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>>  + yum -y install ovirt-host
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>>  Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 (alocalsync)
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>> Requires: bind-license = 32:9.9.4-74.el7_6.1
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>> Installed: 32:bind-license-9.9.4-73.el7_6.noarch (installed)
>>>  
>>> [2019-06-11T11:34:26.175Z]
>>> bind-license = 32:9.9.4-73.el7_6
>>>
>>>
>> I think https://gerrit.ovirt.org/#/c/100691/ which was merged 2 hours
>> ago should address this issue.
>> Maybe other reposync files should be updated as well?
>>
>>
>>>  Seems unrelated and I'm having the same issue locally on my server.
>>> Dafna, do you have some insight regarding this dependency error?
>>>
>>> Thanks, Marcin
>>> On 6/11/19 1:15 PM, Martin Perina wrote:
>>>
>>>
>>>
>>> On Tue, Jun 11, 2019 at 11:58 AM Milan Zamazal 
>>> wrote:
>>>
 Dafna Ron  writes:

 > Hi,
 >
 > Please note vdsm has been broken since Fri the 7th
 >
 > to summarize again,  vdsm has a patch to remove sos plugin which is
 what
 > metrics is using in its ost tests
 > due to that, vdsm is failing the metrics tests and in order to solve
 it we
 > need to make a choice:
 > 1. fix the metrics tests to not use sos
 > 2. disable the metrics tests
 > 3. revert the sos patch until a decision is made on ^^

 #3 is not an option, it would make Vdsm uninstallable on newer RHEL
 versions.

>>>
>>> I've posted a patch https://gerrit.ovirt.org/100716 which is trying to
>>> install vdsm sos plugin if it's not installed either by vdsm nor sos.
>>> Currenlty waiting for CI, if run is successfull, I will extend the patch
>>> also for 4.3 basic suite.
>>>
>>>
 > Thanks,
 > Dafna
 >
 >
 > -- Forwarded message -
 > From: Dafna Ron 
 > Date: Mon, Jun 10, 2019 at 1:30 PM
 > Subject: Re: [ OST Failure Report ] [ oVirt Master (vdsm) ] [
 07-06-2019 ]
 > [ 003_00_metrics_bootstrap.metrics_and_log_collector ]
 > To: Martin Perina , Milan Zamazal <
 mzama...@redhat.com>,
 > Shirly Radco 
 > Cc: devel , infra 
 >
 >
 > Shirly? any update on this?
 >
 > On Fri, Jun 7, 2019 at 11:54 AM Dafna Ron  wrote:
 >
 >> Hi,
 >>
 >> We have a failure in vdsm project on master.
 >>
 >> The issue is change:
 >> https://gerrit.ovirt.org/#/c/100576/ - Remove SOS VDSM plugin
 >>
 >> which is failing on metrics as metrics is calling sos-logcollector.
 >>
 >> The patch cannot be changed as until centos 7.7 when sos-3.7-3, which
 >> contains vdsm plugin will come out.
 >> so until then, we are left with no sos plugin, which is causing the
 >> metrics test to fail.
 >>
 >> Shirly, can you please take a look and see if we can change the test
 to
 >> not call sos-logcollector?
 >> Please note, that we are expecting 4.3 to fail on same issue very
 soon.
 >>
 >> failed job can be found here:
 >>
 >>
 https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14452/
 >>
 >>
 >> ERROR from test:
 >>
 >> lago.ssh: DEBUG: Command 8626fe70 on lago-basic-suite-master-engine
 errors:
 >>  ERROR: Failed to get a sosreport from:
 lago-basic-suite-master-host-1; Could not pa

Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Dafna Ron]

Galit's patch should have solved it.
Marcin, are you still failing?


On Tue, Jun 11, 2019 at 2:40 PM Eyal Edri  wrote:

>
>
> On Tue, Jun 11, 2019 at 4:35 PM Marcin Sobczyk 
> wrote:
>
>> Hi,
>>
>> basic suite fails for the patch with the following log:
>>
>>  
>> [2019-06-11T11:34:26.175Z]
>>- STDERR
>>  
>> [2019-06-11T11:34:26.175Z]
>>  + yum -y install ovirt-host
>>  
>> [2019-06-11T11:34:26.175Z]
>>  Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 (alocalsync)
>>  
>> [2019-06-11T11:34:26.175Z]
>> Requires: bind-license = 32:9.9.4-74.el7_6.1
>>  
>> [2019-06-11T11:34:26.175Z]
>> Installed: 32:bind-license-9.9.4-73.el7_6.noarch (installed)
>>  
>> [2019-06-11T11:34:26.175Z]
>> bind-license = 32:9.9.4-73.el7_6
>>
>>
> I think https://gerrit.ovirt.org/#/c/100691/ which was merged 2 hours ago
> should address this issue.
> Maybe other reposync files should be updated as well?
>
>
>>  Seems unrelated and I'm having the same issue locally on my server.
>> Dafna, do you have some insight regarding this dependency error?
>>
>> Thanks, Marcin
>> On 6/11/19 1:15 PM, Martin Perina wrote:
>>
>>
>>
>> On Tue, Jun 11, 2019 at 11:58 AM Milan Zamazal 
>> wrote:
>>
>>> Dafna Ron  writes:
>>>
>>> > Hi,
>>> >
>>> > Please note vdsm has been broken since Fri the 7th
>>> >
>>> > to summarize again,  vdsm has a patch to remove sos plugin which is
>>> what
>>> > metrics is using in its ost tests
>>> > due to that, vdsm is failing the metrics tests and in order to solve
>>> it we
>>> > need to make a choice:
>>> > 1. fix the metrics tests to not use sos
>>> > 2. disable the metrics tests
>>> > 3. revert the sos patch until a decision is made on ^^
>>>
>>> #3 is not an option, it would make Vdsm uninstallable on newer RHEL
>>> versions.
>>>
>>
>> I've posted a patch https://gerrit.ovirt.org/100716 which is trying to
>> install vdsm sos plugin if it's not installed either by vdsm nor sos.
>> Currenlty waiting for CI, if run is successfull, I will extend the patch
>> also for 4.3 basic suite.
>>
>>
>>> > Thanks,
>>> > Dafna
>>> >
>>> >
>>> > -- Forwarded message -
>>> > From: Dafna Ron 
>>> > Date: Mon, Jun 10, 2019 at 1:30 PM
>>> > Subject: Re: [ OST Failure Report ] [ oVirt Master (vdsm) ] [
>>> 07-06-2019 ]
>>> > [ 003_00_metrics_bootstrap.metrics_and_log_collector ]
>>> > To: Martin Perina , Milan Zamazal <
>>> mzama...@redhat.com>,
>>> > Shirly Radco 
>>> > Cc: devel , infra 
>>> >
>>> >
>>> > Shirly? any update on this?
>>> >
>>> > On Fri, Jun 7, 2019 at 11:54 AM Dafna Ron  wrote:
>>> >
>>> >> Hi,
>>> >>
>>> >> We have a failure in vdsm project on master.
>>> >>
>>> >> The issue is change:
>>> >> https://gerrit.ovirt.org/#/c/100576/ - Remove SOS VDSM plugin
>>> >>
>>> >> which is failing on metrics as metrics is calling sos-logcollector.
>>> >>
>>> >> The patch cannot be changed as until centos 7.7 when sos-3.7-3, which
>>> >> contains vdsm plugin will come out.
>>> >> so until then, we are left with no sos plugin, which is causing the
>>> >> metrics test to fail.
>>> >>
>>> >> Shirly, can you please take a look and see if we can change the test
>>> to
>>> >> not call sos-logcollector?
>>> >> Please note, that we are expecting 4.3 to fail on same issue very
>>> soon.
>>> >>
>>> >> failed job can be found here:
>>> >>
>>> >> https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14452/
>>> >>
>>> >>
>>> >> ERROR from test:
>>> >>
>>> >> lago.ssh: DEBUG: Command 8626fe70 on lago-basic-suite-master-engine
>>> errors:
>>> >>  ERROR: Failed to get a sosreport from:
>>> lago-basic-suite-master-host-1; Could not parse sosreport output
>>> >> ERROR: Failed to get a sosreport from:
>>> lago-basic-suite-master-host-0; Could not parse sosreport output
>>> >>
>>> >> lago.utils: DEBUG: Error while running thread Thread-3
>>> >> Traceback (most recent call last):
>>> >>   File "/usr/lib/python2.7/site-packages/lago/utils.py

Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Eyal Edri]

On Tue, Jun 11, 2019 at 4:35 PM Marcin Sobczyk  wrote:

> Hi,
>
> basic suite fails for the patch with the following log:
>
>  
> [2019-06-11T11:34:26.175Z]
>- STDERR
>  
> [2019-06-11T11:34:26.175Z]
>  + yum -y install ovirt-host
>  
> [2019-06-11T11:34:26.175Z]
>  Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 (alocalsync)
>  
> [2019-06-11T11:34:26.175Z]
> Requires: bind-license = 32:9.9.4-74.el7_6.1
>  
> [2019-06-11T11:34:26.175Z]
> Installed: 32:bind-license-9.9.4-73.el7_6.noarch (installed)
>  
> [2019-06-11T11:34:26.175Z]
> bind-license = 32:9.9.4-73.el7_6
>
>
I think https://gerrit.ovirt.org/#/c/100691/ which was merged 2 hours ago
should address this issue.
Maybe other reposync files should be updated as well?


>  Seems unrelated and I'm having the same issue locally on my server.
> Dafna, do you have some insight regarding this dependency error?
>
> Thanks, Marcin
> On 6/11/19 1:15 PM, Martin Perina wrote:
>
>
>
> On Tue, Jun 11, 2019 at 11:58 AM Milan Zamazal 
> wrote:
>
>> Dafna Ron  writes:
>>
>> > Hi,
>> >
>> > Please note vdsm has been broken since Fri the 7th
>> >
>> > to summarize again,  vdsm has a patch to remove sos plugin which is what
>> > metrics is using in its ost tests
>> > due to that, vdsm is failing the metrics tests and in order to solve it
>> we
>> > need to make a choice:
>> > 1. fix the metrics tests to not use sos
>> > 2. disable the metrics tests
>> > 3. revert the sos patch until a decision is made on ^^
>>
>> #3 is not an option, it would make Vdsm uninstallable on newer RHEL
>> versions.
>>
>
> I've posted a patch https://gerrit.ovirt.org/100716 which is trying to
> install vdsm sos plugin if it's not installed either by vdsm nor sos.
> Currenlty waiting for CI, if run is successfull, I will extend the patch
> also for 4.3 basic suite.
>
>
>> > Thanks,
>> > Dafna
>> >
>> >
>> > -- Forwarded message -
>> > From: Dafna Ron 
>> > Date: Mon, Jun 10, 2019 at 1:30 PM
>> > Subject: Re: [ OST Failure Report ] [ oVirt Master (vdsm) ] [
>> 07-06-2019 ]
>> > [ 003_00_metrics_bootstrap.metrics_and_log_collector ]
>> > To: Martin Perina , Milan Zamazal <
>> mzama...@redhat.com>,
>> > Shirly Radco 
>> > Cc: devel , infra 
>> >
>> >
>> > Shirly? any update on this?
>> >
>> > On Fri, Jun 7, 2019 at 11:54 AM Dafna Ron  wrote:
>> >
>> >> Hi,
>> >>
>> >> We have a failure in vdsm project on master.
>> >>
>> >> The issue is change:
>> >> https://gerrit.ovirt.org/#/c/100576/ - Remove SOS VDSM plugin
>> >>
>> >> which is failing on metrics as metrics is calling sos-logcollector.
>> >>
>> >> The patch cannot be changed as until centos 7.7 when sos-3.7-3, which
>> >> contains vdsm plugin will come out.
>> >> so until then, we are left with no sos plugin, which is causing the
>> >> metrics test to fail.
>> >>
>> >> Shirly, can you please take a look and see if we can change the test to
>> >> not call sos-logcollector?
>> >> Please note, that we are expecting 4.3 to fail on same issue very soon.
>> >>
>> >> failed job can be found here:
>> >>
>> >> https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14452/
>> >>
>> >>
>> >> ERROR from test:
>> >>
>> >> lago.ssh: DEBUG: Command 8626fe70 on lago-basic-suite-master-engine
>> errors:
>> >>  ERROR: Failed to get a sosreport from:
>> lago-basic-suite-master-host-1; Could not parse sosreport output
>> >> ERROR: Failed to get a sosreport from: lago-basic-suite-master-host-0;
>> Could not parse sosreport output
>> >>
>> >> lago.utils: DEBUG: Error while running thread Thread-3
>> >> Traceback (most recent call last):
>> >>   File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in
>> _ret_via_queue
>> >> queue.put({'return': func()})
>> >>   File
>> "/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tests/basic-suite-master/test-scenarios/003_00_metrics_bootstrap.py",
>> line 97, in run_log_collector
>>

Re: [ovirt-devel] Re: [urgent] vdsm broken since Friday (failing CQ)

[Marcin Sobczyk]

Hi,

basic suite fails for the patch with the following log:

[2019-06-11T11:34:26.175Z] 
- STDERR
[2019-06-11T11:34:26.175Z] 
+ yum -y install ovirt-host
[2019-06-11T11:34:26.175Z] 
Error: Package: 32:bind-libs-9.9.4-74.el7_6.1.x86_64 (alocalsync)
[2019-06-11T11:34:26.175Z] 
Requires: bind-license = 32:9.9.4-74.el7_6.1
[2019-06-11T11:34:26.175Z] 
Installed: 32:bind-license-9.9.4-73.el7_6.noarch (installed)
[2019-06-11T11:34:26.175Z] 
bind-license = 32:9.9.4-73.el7_6


Seems unrelated and I'm having the same issue locally on my server.
Dafna, do you have some insight regarding this dependency error?

Thanks, Marcin

On 6/11/19 1:15 PM, Martin Perina wrote:



On Tue, Jun 11, 2019 at 11:58 AM Milan Zamazal > wrote:


Dafna Ron mailto:d...@redhat.com>> writes:

> Hi,
>
> Please note vdsm has been broken since Fri the 7th
>
> to summarize again,  vdsm has a patch to remove sos plugin which
is what
> metrics is using in its ost tests
> due to that, vdsm is failing the metrics tests and in order to
solve it we
> need to make a choice:
> 1. fix the metrics tests to not use sos
> 2. disable the metrics tests
> 3. revert the sos patch until a decision is made on ^^

#3 is not an option, it would make Vdsm uninstallable on newer RHEL
versions.


I've posted a patch https://gerrit.ovirt.org/100716 which is trying to 
install vdsm sos plugin if it's not installed either by vdsm nor sos.
Currenlty waiting for CI, if run is successfull, I will extend the 
patch also for 4.3 basic suite.



> Thanks,
> Dafna
>
>
> -- Forwarded message -
> From: Dafna Ron mailto:d...@redhat.com>>
> Date: Mon, Jun 10, 2019 at 1:30 PM
> Subject: Re: [ OST Failure Report ] [ oVirt Master (vdsm) ] [
07-06-2019 ]
> [ 003_00_metrics_bootstrap.metrics_and_log_collector ]
> To: Martin Perina mailto:mper...@redhat.com>>, Milan Zamazal mailto:mzama...@redhat.com>>,
> Shirly Radco mailto:sra...@redhat.com>>
> Cc: devel mailto:de...@ovirt.org>>, infra
mailto:infra@ovirt.org>>
>
>
> Shirly? any update on this?
>
> On Fri, Jun 7, 2019 at 11:54 AM Dafna Ron mailto:d...@redhat.com>> wrote:
>
>> Hi,
>>
>> We have a failure in vdsm project on master.
>>
>> The issue is change:
>> https://gerrit.ovirt.org/#/c/100576/ - Remove SOS VDSM plugin
>>
>> which is failing on metrics as metrics is calling sos-logcollector.
>>
>> The patch cannot be changed as until centos 7.7 when sos-3.7-3,
which
>> contains vdsm plugin will come out.
>> so until then, we are left with no sos plugin, which is causing the
>> metrics test to fail.
>>
>> Shirly, can you please take a look and see if we can change the
test to
>> not call sos-logcollector?
>> Please note, that we are expecting 4.3 to fail on same issue
very soon.
>>
>> failed job can be found here:
>>
>>
https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/14452/
>>
>>
>> ERROR from test:
>>
>> lago.ssh: DEBUG: Command 8626fe70 on
lago-basic-suite-master-engine  errors:
>>  ERROR: Failed to get a sosreport from:
lago-basic-suite-master-host-1; Could not parse sosreport output
>> ERROR: Failed to get a sosreport from:
lago-basic-suite-master-host-0; Could not parse sosreport output
>>
>> lago.utils: DEBUG: Error while running thread Thread-3
>> Traceback (most recent call last):
>>   File "/usr/lib/python2.7/site-packages/lago/utils.py", line
58, in _ret_via_queue
>>     queue.put({'return': func()})
>>   File

"/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tests/basic-suite-master/test-scenarios/003_00_metrics_bootstrap.py",
line 97, in run_log_collector
>>     'log collector failed. Exit