Re: ISO Testing Tracker and Artful
Whoops, didn't reply to the list. On Tue, Jul 25, 2017 at 4:02 PM, Nicholas Skaggs < nicholas.ska...@canonical.com> wrote: > On 07/24/2017 08:51 PM, Brian Murray wrote: > >> On Fri, Jul 21, 2017 at 02:37:38PM -0700, Brian Murray wrote: >> >>> On Thu, Jul 20, 2017 at 05:21:34PM -0500, Simon Quigley wrote: >>> Whoops, I didn't reply to the mailing list as well when I sent my message. Artful is there, it's just at the bottom. >>> Does that bother anyone else or is it just me? >>> >>> Additionally, does anybody know where to fix "LTS Desktop Upgrade >>> (Trusty)" on this page? >>> >>> http://iso.qa.ubuntu.com/qatracker/milestones/376/builds/ >>> 152257/testcases >>> >>> Upgrading from Trusty to Artful is not supported but from Xenial to >>> Artful is. >>> >> I ended up fixing this particular issue through the administrative >> interface of the ISO tracker. However, while doing that I noticed that >> the test case changes I made in ubuntu-manual-tests did not exist in the >> ISO tracker. I then discovered a script called qa_tracker_update.pl >> which looks like it'll update the ISO tracker with information from the >> ubuntu-manual-tests branch. Is anybody familiar with this script? I ask >> as it appears to be broken. >> >> "There is no form named "decideform" at >> /usr/share/perl5/WWW/Mechanize.pm line 1011." >> >> Cheers, >> -- >> Brian Murray > > > > This should really be updated to python and to use the tracker API, instead of scrapping webforms :-) I think it's been attempted a few times, but I can't imagine it's a large effort if someone is keen to play with python and the tracker. The API is all there letting you make all sorts of interesting tools if you wish (cli, gui, etc). That said, I appreciate continuing the use of ubuntu-manual-tests; as flocculant mentioned it's the only way to propose and track changes, so even though updates are manual, we have a record. Nicholas -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
Re: ISO Testing Tracker and Artful
On 25/07/17 19:56, Brian Murray wrote: On Tue, Jul 25, 2017 at 07:08:32AM +0100, flocculant wrote: On 25/07/17 01:51, Brian Murray wrote: [...] [...] However, while doing that I noticed that the test case changes I made in ubuntu-manual-tests did not exist in the ISO tracker. I then discovered a script called qa_tracker_update.pl which looks like it'll update the ISO tracker with information from the ubuntu-manual-tests branch. Is anybody familiar with this script? I ask as it appears to be broken. "There is no form named "decideform" at /usr/share/perl5/WWW/Mechanize.pm line 1011." Cheers, -- Brian Murray I tend to update the tracker manually. I know that script is there - never used it. As far as the changes you made a while back not existing - pretty sure I did those when I saw your mp at the end of June. I now see you've manually changed something else on the tracker. To which change are you referring and is there something incorrect? Up to now it's been better if there has been a bug linked to changes made on the tracker for looking backwards at changes. Mostly because it has been me single handedly keeping the branch and the tracker synced. Is this process documented? About what project should the bug be reported? https://bugs.launchpad.net/ubuntu-manual-tests I also note that someone else has been approving mp's - and not checking the whole thing - last time something was approved, it still needed fixing. Could you provide some more details? It might help if we document the process and talk about issues like this so we can avoid them in the future. -- Brian Murray -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
Re: ISO Testing Tracker and Artful
On 25/07/17 19:56, Brian Murray wrote: On Tue, Jul 25, 2017 at 07:08:32AM +0100, flocculant wrote: On 25/07/17 01:51, Brian Murray wrote: [...] [...] However, while doing that I noticed that the test case changes I made in ubuntu-manual-tests did not exist in the ISO tracker. I then discovered a script called qa_tracker_update.pl which looks like it'll update the ISO tracker with information from the ubuntu-manual-tests branch. Is anybody familiar with this script? I ask as it appears to be broken. "There is no form named "decideform" at /usr/share/perl5/WWW/Mechanize.pm line 1011." Cheers, -- Brian Murray I tend to update the tracker manually. I know that script is there - never used it. As far as the changes you made a while back not existing - pretty sure I did those when I saw your mp at the end of June. I now see you've manually changed something else on the tracker. To which change are you referring and is there something incorrect? mp from 21st - changes to 1310 and 1635. Not made it to the tracker yet - I wasn't quite awake at 7 this morning ... Up to now it's been better if there has been a bug linked to changes made on the tracker for looking backwards at changes. Mostly because it has been me single handedly keeping the branch and the tracker synced. Is this process documented? About what project should the bug be reported? Not sure it's documented. But back when I first started getting involved Nick Skaggs was still QA guy and not what he is now. Having a bug number and linking that to the mp is the only way we have to keep track of where changes come from. At the moment (as you've now discovered) we have to manually edit the testcases once mp is approved. I also note that someone else has been approving mp's - and not checking the whole thing - last time something was approved, it still needed fixing. https://code.launchpad.net/~tsimonq2/ubuntu-manual-tests/make-1305-generic/+merge/326660 Basically 'we' try and check a testcase when something else comes up in order to keep them up to date. Could you provide some more details? It might help if we document the process and talk about issues like this so we can avoid them in the future. -- Brian Murray regards -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
Re: ISO Testing Tracker and Artful
On Tue, Jul 25, 2017 at 07:08:32AM +0100, flocculant wrote: > On 25/07/17 01:51, Brian Murray wrote: > >[...] > >[...] However, while doing that I noticed that > >the test case changes I made in ubuntu-manual-tests did not exist in the > >ISO tracker. I then discovered a script called qa_tracker_update.pl > >which looks like it'll update the ISO tracker with information from the > >ubuntu-manual-tests branch. Is anybody familiar with this script? I ask > >as it appears to be broken. > > > >"There is no form named "decideform" at > >/usr/share/perl5/WWW/Mechanize.pm line 1011." > > > >Cheers, > >-- > >Brian Murray > > > I tend to update the tracker manually. > > I know that script is there - never used it. > > As far as the changes you made a while back not existing - pretty sure I did > those when I saw your mp at the end of June. > > I now see you've manually changed something else on the tracker. To which change are you referring and is there something incorrect? > Up to now it's been better if there has been a bug linked to changes made on > the tracker for looking backwards at changes. Mostly because it has been me > single handedly keeping the branch and the tracker synced. Is this process documented? About what project should the bug be reported? > I also note that someone else has been approving mp's - and not checking the > whole thing - last time something was approved, it still needed fixing. Could you provide some more details? It might help if we document the process and talk about issues like this so we can avoid them in the future. -- Brian Murray -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
Re: ISO Testing Tracker and Artful
On 25/07/17 01:51, Brian Murray wrote: [...] [...] However, while doing that I noticed that the test case changes I made in ubuntu-manual-tests did not exist in the ISO tracker. I then discovered a script called qa_tracker_update.pl which looks like it'll update the ISO tracker with information from the ubuntu-manual-tests branch. Is anybody familiar with this script? I ask as it appears to be broken. "There is no form named "decideform" at /usr/share/perl5/WWW/Mechanize.pm line 1011." Cheers, -- Brian Murray I tend to update the tracker manually. I know that script is there - never used it. As far as the changes you made a while back not existing - pretty sure I did those when I saw your mp at the end of June. I now see you've manually changed something else on the tracker. Up to now it's been better if there has been a bug linked to changes made on the tracker for looking backwards at changes. Mostly because it has been me single handedly keeping the branch and the tracker synced. I also note that someone else has been approving mp's - and not checking the whole thing - last time something was approved, it still needed fixing. -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
Re: ISO Testing Tracker and Artful
On Fri, Jul 21, 2017 at 02:37:38PM -0700, Brian Murray wrote: > On Thu, Jul 20, 2017 at 05:21:34PM -0500, Simon Quigley wrote: > > Whoops, I didn't reply to the mailing list as well when I sent my message. > > > > Artful is there, it's just at the bottom. > > Does that bother anyone else or is it just me? > > Additionally, does anybody know where to fix "LTS Desktop Upgrade > (Trusty)" on this page? > > http://iso.qa.ubuntu.com/qatracker/milestones/376/builds/152257/testcases > > Upgrading from Trusty to Artful is not supported but from Xenial to > Artful is. I ended up fixing this particular issue through the administrative interface of the ISO tracker. However, while doing that I noticed that the test case changes I made in ubuntu-manual-tests did not exist in the ISO tracker. I then discovered a script called qa_tracker_update.pl which looks like it'll update the ISO tracker with information from the ubuntu-manual-tests branch. Is anybody familiar with this script? I ask as it appears to be broken. "There is no form named "decideform" at /usr/share/perl5/WWW/Mechanize.pm line 1011." Cheers, -- Brian Murray -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
Re: ISO Testing Tracker and Artful
On 21/07/17 22:37, Brian Murray wrote: On Thu, Jul 20, 2017 at 05:21:34PM -0500, Simon Quigley wrote: Whoops, I didn't reply to the mailing list as well when I sent my message. Artful is there, it's just at the bottom. Does that bother anyone else or is it just me? I did see stgraber mention this fleetingly - not so easy to sort as it appears, or that was what I took from the small discussion Additionally, does anybody know where to fix "LTS Desktop Upgrade (Trusty)" on this page? http://iso.qa.ubuntu.com/qatracker/milestones/376/builds/152257/testcases Upgrading from Trusty to Artful is not supported but from Xenial to Artful is. Would guess there's some way to remove builds from http://iso.qa.ubuntu.com/admin/config/services/qatracker/builds Though I don't see a way to do that from the admin bits I can see. Might be to do with Trusty being on the tracker still but not sure Thanks! -- Brian Murray Cheers -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
Re: ISO Testing Tracker and Artful
Brian, Simon and list, On Jul 21, 2017 14:38, "Brian Murray" wrote: On Thu, Jul 20, 2017 at 05:21:34PM -0500, Simon Quigley wrote: > Whoops, I didn't reply to the mailing list as well when I sent my message. > > Artful is there, it's just at the bottom. Does that bother anyone else or is it just me? I am SO glad you asked. I wanted to say something but I was worried about coming across as too fussy... Is it possible to put the 16.04, 16.10, 17.04 and 17.10 in front of the cool name so that they sort more chronologically? Additionally, does anybody know where to fix "LTS Desktop Upgrade (Trusty)" on this page? http://iso.qa.ubuntu.com/qatracker/milestones/376/builds/152257/testcases Upgrading from Trusty to Artful is not supported but from Xenial to Artful is. Thanks! -- Brian Murray As the the rest I have no useful comment -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
Re: ISO Testing Tracker and Artful
On Thu, Jul 20, 2017 at 05:21:34PM -0500, Simon Quigley wrote: > Whoops, I didn't reply to the mailing list as well when I sent my message. > > Artful is there, it's just at the bottom. Does that bother anyone else or is it just me? Additionally, does anybody know where to fix "LTS Desktop Upgrade (Trusty)" on this page? http://iso.qa.ubuntu.com/qatracker/milestones/376/builds/152257/testcases Upgrading from Trusty to Artful is not supported but from Xenial to Artful is. Thanks! -- Brian Murray -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
Re: ISO Testing Tracker and Artful
Whoops, I didn't reply to the mailing list as well when I sent my message. Artful is there, it's just at the bottom. -- Simon Quigley tsimo...@ubuntu.com tsimonq2 on freenode and OFTC 5C7A BEA2 0F86 3045 9CC8 C8B5 E27F 2CF8 458C 2FA4 -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
ISO Testing Tracker and Artful
I was looking at and thinking about modifying the test cases for upgrade testing[1] used at iso.qa.ubuntu.com when I noticed that the site[2] doesn't seem to be configured for Artful. Is there something wrong with the site that I can help fix or has nobody added Artful? [1] See my blog post about changes for the reasoning - http://www.murraytwins.com/blog/?p=147 [2] http://iso.qa.ubuntu.com/qatracker Thanks! -- Brian Murray -- Ubuntu-quality mailing list Ubuntu-quality@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-quality
