Re: Automatic image testing

2015-05-07 Thread Elfy 

On 07/05/15 17:03, Nicholas Skaggs wrote:

On 05/06/2015 08:59 PM, Istimsak Abdulbasir wrote:

Is this were the iso builds are being tracked when they are produced for
testing?
https://jenkins.qa.ubuntu.com/view/vivid/view/Smoke%20Testing/

This is a better view, but yes: 
http://ci.ubuntu.com/smokeng/vivid/desktop/. That URL shows the 
jenkins jobs that run the smoketests, which help gate the images.


Nicholas


How does that equate to what I was looking at though?

https://jenkins.qa.ubuntu.com/view/Ubiquity/view/All/

if it does ...

PS RSS feed I was talking about - 
https://jenkins.qa.ubuntu.com/view/Ubiquity/view/Xubuntu/ - RSS for 
different scenarios at the bottom.


--
Community and Forum Council's Member
Xubuntu QA Lead


--
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality

Re: Automatic image testing

2015-05-07 Thread Nicholas Skaggs 

On 05/06/2015 08:59 PM, Istimsak Abdulbasir wrote:

Is this were the iso builds are being tracked when they are produced for
testing?
https://jenkins.qa.ubuntu.com/view/vivid/view/Smoke%20Testing/

This is a better view, but yes: 
http://ci.ubuntu.com/smokeng/vivid/desktop/. That URL shows the jenkins 
jobs that run the smoketests, which help gate the images.


Nicholas

--
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality

Re: Automatic image testing

2015-05-06 Thread Istimsak Abdulbasir 
On Sun, May 3, 2015 at 6:53 PM, Elfy  wrote:

> Prior to the vivid cycle I used to often check on jenkins daily, indeed
> had RSS feed for fails set up, just to check that things were at least
> working basically.
>
> Sometime around December these stopped working, and still show the last
> result as about 5 months ago as FAIL for everyone.
>
> Is there any likelihood that this will work for us during the Wibbly
> Wobbly Whinocewos cycle?
>
> Is there somewhere else that reports on both Ubuntu and flavour image auto
> tests?
>
> I know this would make my life just that bit easier, I assume other
> flavours would like to at least have the assurance a basic test is done.
>
>
Is this were the iso builds are being tracked when they are produced for
testing?
https://jenkins.qa.ubuntu.com/view/vivid/view/Smoke%20Testing/

>
> --
> Community and Forum Council's Member
> Xubuntu QA Lead
>
>
> --
> Ubuntu-quality mailing list
> Ubuntu-quality@lists.ubuntu.com
> Modify settings or unsubscribe at:
> https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
>



-- 
"Collaboration is the new innovation" (Istimsak Abdulbasir, 2013)
-- 
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality

Re: Automatic image testing

2015-05-06 Thread Istimsak Abdulbasir 
I am sorry. Disregard this email.

On Wed, May 6, 2015 at 8:30 PM, Istimsak Abdulbasir 
wrote:

>
>
> On Mon, May 4, 2015 at 11:24 AM, Alberto Salvia Novella <
> es204904...@gmail.com> wrote:
>
>> Elfy:
>>
>>> Sometime around December these stopped working, and still show the last
>>> result as about 5 months ago as FAIL for everyone.
>>>
>>
>> I wonder if  isn't working too.
>>
>>
>> Wow, did not notice there was a report like this. Very useful. I can view
> it but it does not show any of the error found in earlier releases.
>
>>
>>
>> --
>> Ubuntu-quality mailing list
>> Ubuntu-quality@lists.ubuntu.com
>> Modify settings or unsubscribe at:
>> https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
>>
>>
>
>
> --
> "Collaboration is the new innovation" (Istimsak Abdulbasir, 2013)
>



-- 
"Collaboration is the new innovation" (Istimsak Abdulbasir, 2013)
-- 
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality

Re: Automatic image testing

2015-05-06 Thread Istimsak Abdulbasir 
On Mon, May 4, 2015 at 11:24 AM, Alberto Salvia Novella <
es204904...@gmail.com> wrote:

> Elfy:
>
>> Sometime around December these stopped working, and still show the last
>> result as about 5 months ago as FAIL for everyone.
>>
>
> I wonder if  isn't working too.
>
>
> Wow, did not notice there was a report like this. Very useful. I can view
it but it does not show any of the error found in earlier releases.

>
>
> --
> Ubuntu-quality mailing list
> Ubuntu-quality@lists.ubuntu.com
> Modify settings or unsubscribe at:
> https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
>
>


-- 
"Collaboration is the new innovation" (Istimsak Abdulbasir, 2013)
-- 
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality

Re: Automatic image testing

2015-05-06 Thread Alberto Salvia Novella 

Brian Murray:

This is again another example of your lack of precision, not telling us
the bug number you reported, such that no one reading this list can go
confirm that bug and I wasted time looking for it.


This is what I meant: to confirm what I said just didn't matter. It 
doesn't work towards any goal, but it's just faith in precision itself.


The opposite is asking how much impact would bring an extra part.

And if there proves to be something missing, better server when 
required: 




-- 
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality

Re: Automatic image testing

2015-05-06 Thread Brian Murray 
On Tue, May 05, 2015 at 01:31:48PM +0200, Alberto Salvia Novella wrote:
> Alberto Salvia Novella:
> > I wonder if  isn't working too.
> 
> Brian Murray:
> >The graph being broken doesn't mean the whole website "isn't working"
> >which is what your first email indicated.
> 
> Precision isn't one of my values, because that's the automatic
> consequence of simplicity.

I think it is really unfortunate that you don't value precision, as
being precise promotes clarity which allows people reading your work to
better understand why you made an action or statement. This particularly
important in the distributed and collaborative work environment that is
Ubuntu development.

Were you just to have said exactly what you thought was wrong it would
have saved both of us time.

> Brian Murray:
> > Additionally, a bug report would have been useful.
> 
> I opened a bug report about a different flaw in the Error Tracker,
> and never got attended. So I figured out that the best use of my
> time wasn't reporting errors, but helping with them.

This is again another example of your lack of precision, not telling us
the bug number you reported, such that no one reading this list can go
confirm that bug and I wasted time looking for it.

I hope you'll take some time to reconsider the value of precision and
how a lack of it negatively effects the rest of the Ubuntu community.

--
Brian Murray


signature.asc
Description: Digital signature
-- 
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality

Re: Automatic image testing

2015-05-05 Thread Nicholas Skaggs 

On 05/03/2015 06:53 PM, Elfy wrote:
Prior to the vivid cycle I used to often check on jenkins daily, 
indeed had RSS feed for fails set up, just to check that things were 
at least working basically.


Sometime around December these stopped working, and still show the 
last result as about 5 months ago as FAIL for everyone.


Is there any likelihood that this will work for us during the Wibbly 
Wobbly Whinocewos cycle?


Is there somewhere else that reports on both Ubuntu and flavour image 
auto tests?


I know this would make my life just that bit easier, I assume other 
flavours would like to at least have the assurance a basic test is done.



Elfy, we spoke before about checking the RSS feed and posting it to the 
isotracker. I still owe you an attempt at that. Can you link what you 
are looking at?


This should work and show things properly; it's the smoke tests: 
https://jenkins.qa.ubuntu.com/view/vivid/view/Smoke%20Testing/


On the AP test side, CI took down the machine on accident and stopped 
the builds. They've since restored them, but only for ubuntu: 
https://jenkins.qa.ubuntu.com/view/Ubiquity/view/All/


There's an open work item from me to restore them for other flavors, but 
we would be better served thinking of an alternative place to run them I 
think and pursuing your idea of publishing failures on the tracker 
itself as a warning. Ideas anyone?


Nicholas

--
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality

Re: Automatic image testing

2015-05-05 Thread Nicholas Skaggs 

On 05/04/2015 11:37 AM, Alberto Salvia Novella wrote:

Alberto Salvia Novella:

I wonder if  isn't working too.


Brian Murray:
> You are likely wrong, but its hard to tell given the limited
> information you've provided.

Look that the last listed moth is October 2014. And the graph is 
mostly continuous, when after release it usually tends to go up 
dramatically.






As Brian mentioned, the dashed lines seem to represent releases 
(14.04.2), Utopic, etc. There should be a new line for Vivid I would 
guess that would land on April. It does make the graph a little 
confusing from that aspect. However, indeed you can see 15.04 reports 
are coming in and showing up in the detailed list below.


Nicholas

--
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality

Re: Automatic image testing

2015-05-05 Thread Alberto Salvia Novella 

Alberto Salvia Novella:
> I wonder if  isn't working too.

Brian Murray:

The graph being broken doesn't mean the whole website "isn't working"
which is what your first email indicated.


Precision isn't one of my values, because that's the automatic 
consequence of simplicity.


And I say this because I have been in the other side, where everything 
is perfectly correct but nobody knows why the thing isn't moving.



Brian Murray:
> Additionally, a bug report would have been useful.

I opened a bug report about a different flaw in the Error Tracker, and 
never got attended. So I figured out that the best use of my time wasn't 
reporting errors, but helping with them.



Brian Murray:
> Regardless, the line for Ubuntu 15.04 has been and added a forthcoming
> code update will add in new milestones (the dates on the X axis)
> although the data was all there. You can tell what date the data is
> for when you hover on a point in a line.

Many thanks. It seems that the line hasn't going as up as in previous 
releases, has it?




-- 
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality

Re: Automatic image testing

2015-05-04 Thread Brian Murray 
On Mon, May 04, 2015 at 05:37:50PM +0200, Alberto Salvia Novella wrote:
> Alberto Salvia Novella:
> >I wonder if  isn't working too.
> 
> Brian Murray:
> > You are likely wrong, but its hard to tell given the limited
> > information you've provided.
> 
> Look that the last listed moth is October 2014. And the graph is
> mostly continuous, when after release it usually tends to go up
> dramatically.

The graph being broken doesn't mean the whole website "isn't working"
which is what your first email indicated. Additionally, a bug report
would have been useful.

Regardless, the line for Ubuntu 15.04 has been and added a forthcoming
code update will add in new milestones (the dates on the X axis)
although the data was all there. You can tell what date the data is for
when you hover on a point in a line.

--
Brian Murray


signature.asc
Description: Digital signature
-- 
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality

Re: Automatic image testing

2015-05-04 Thread Alberto Salvia Novella 

Alberto Salvia Novella:

I wonder if  isn't working too.


Brian Murray:
> You are likely wrong, but its hard to tell given the limited
> information you've provided.

Look that the last listed moth is October 2014. And the graph is mostly 
continuous, when after release it usually tends to go up dramatically.




-- 
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality

Re: Automatic image testing

2015-05-04 Thread Brian Murray 
On Mon, May 04, 2015 at 05:24:49PM +0200, Alberto Salvia Novella wrote:
> Elfy:
> >Sometime around December these stopped working, and still show the last
> >result as about 5 months ago as FAIL for everyone.
> 
> I wonder if  isn't working too.

You are likely wrong, but its hard to tell given the limited information
you've provided.

--
Brian Murray


signature.asc
Description: Digital signature
-- 
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality

Re: Automatic image testing

2015-05-04 Thread Alberto Salvia Novella 

Elfy:

Sometime around December these stopped working, and still show the last
result as about 5 months ago as FAIL for everyone.


I wonder if  isn't working too.



-- 
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality

Re: Automatic image testing

2015-05-03 Thread Dan Chapman 



On 03/05/15 23:53, Elfy wrote:
Prior to the vivid cycle I used to often check on jenkins daily, 
indeed had RSS feed for fails set up, just to check that things were 
at least working basically.


Sometime around December these stopped working, and still show the 
last result as about 5 months ago as FAIL for everyone.


Is there any likelihood that this will work for us during the Wibbly 
Wobbly Whinocewos cycle?


Is there somewhere else that reports on both Ubuntu and flavour image 
auto tests?


I know this would make my life just that bit easier, I assume other 
flavours would like to at least have the assurance a basic test is done.



Oh dear those tests are a bit out of shape now. Looks like the 
workarounds of walking the ATK object tree doesn't seem to work anymore.


I'll take a look at fixing those tests up tomorrow and get them back 
into decent shape.


Regards

Dan



--
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality

Automatic image testing

2015-05-03 Thread Elfy 
Prior to the vivid cycle I used to often check on jenkins daily, indeed 
had RSS feed for fails set up, just to check that things were at least 
working basically.


Sometime around December these stopped working, and still show the last 
result as about 5 months ago as FAIL for everyone.


Is there any likelihood that this will work for us during the Wibbly 
Wobbly Whinocewos cycle?


Is there somewhere else that reports on both Ubuntu and flavour image 
auto tests?


I know this would make my life just that bit easier, I assume other 
flavours would like to at least have the assurance a basic test is done.



--
Community and Forum Council's Member
Xubuntu QA Lead


--
Ubuntu-quality mailing list
Ubuntu-quality@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality