Re: Application Testing - wiki pages and QA website
Ara Pulido wrote: > Hello again, > > On 12/14/2009 08:30 AM, Ara Pulido wrote: >> Hello Scott, >> >> Thanks for noticing this. >> >> On 12/13/2009 11:41 AM, Scott Ritchie wrote: >>> While editing the testing wiki pages I was creating a section for >>> Application Testing when I noticed that >>> https://wiki.ubuntu.com/Testing/Applications and >>> http://testcases.qa.ubuntu.com/Applications appear to be two different >>> things. >>> > > Reading your Activities page [1], I have seen that you use Application > Testing as Regression Testing. > > "Application Testing is the manual testing of specific things (test > cases) in particular applications that shouldn't break from one release > to the next." > > I think in activities this should be called Manual Regression Testing, > pointing to a page which explains what is regression testing and linking > testcases.qa.ubuntu.com as possible test cases. > > What do you think? > > You're quite right that this is usually described as regression testing. I do think most of our defined application test cases are essentially regression tests, so we can probably talk about both in the same place. We run into a similar issue with the test suite for Wine - "are they regression tests, or are they just tests?" The answer is usually "if they passed at least once, they're regression tests." Thanks, Scott Ritchie -- Ubuntu-qa mailing list Ubuntu-qa@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-qa
Re: Application Testing - wiki pages and QA website
Hello Brian, On 12/14/2009 05:59 PM, Brian Murray wrote: > > I noticed that the X team has some test cases[1] that don't appear at > testcases.qa.ubuntu.com. Should these be moved to that site so that > they are visible to more people? Yes, I am working with Bryce Harrington on it :-) Regards, Ara. -- Ubuntu-qa mailing list Ubuntu-qa@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-qa
Re: Application Testing - wiki pages and QA website
On Mon, Dec 14, 2009 at 08:30:23AM +0100, Ara Pulido wrote: > Hello Scott, > > Thanks for noticing this. > > On 12/13/2009 11:41 AM, Scott Ritchie wrote: > > While editing the testing wiki pages I was creating a section for > > Application Testing when I noticed that > > https://wiki.ubuntu.com/Testing/Applications and > > http://testcases.qa.ubuntu.com/Applications appear to be two different > > things. > > > > http://testcases.qa.ubuntu.com/Applications is a wiki and everyone can > edit it. > > In fact, it is supposed to be the place to hold any written test case > (Canonical or Community driven) and I think it should be a better place > to put them. I noticed that the X team has some test cases[1] that don't appear at testcases.qa.ubuntu.com. Should these be moved to that site so that they are visible to more people? [1] https://wiki.ubuntu.com/X/Testing -- Brian Murray @ubuntu.com signature.asc Description: Digital signature -- Ubuntu-qa mailing list Ubuntu-qa@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-qa
Re: Application Testing - wiki pages and QA website
Hello again, On 12/14/2009 08:30 AM, Ara Pulido wrote: > Hello Scott, > > Thanks for noticing this. > > On 12/13/2009 11:41 AM, Scott Ritchie wrote: >> While editing the testing wiki pages I was creating a section for >> Application Testing when I noticed that >> https://wiki.ubuntu.com/Testing/Applications and >> http://testcases.qa.ubuntu.com/Applications appear to be two different >> things. >> Reading your Activities page [1], I have seen that you use Application Testing as Regression Testing. "Application Testing is the manual testing of specific things (test cases) in particular applications that shouldn't break from one release to the next." I think in activities this should be called Manual Regression Testing, pointing to a page which explains what is regression testing and linking testcases.qa.ubuntu.com as possible test cases. What do you think? Regards, Ara. [1] https://wiki.ubuntu.com/Testing/Activities > > http://testcases.qa.ubuntu.com/Applications is a wiki and everyone can > edit it. > > In fact, it is supposed to be the place to hold any written test case > (Canonical or Community driven) and I think it should be a better place > to put them. > > The format to write testcases in testcases.qa.u.c is simple and it won't > be a problem for a nonprofessional to contribute. > > My vote would be to see what's missing in testcases.qa.u.c and copied it > from wiki.ubuntu.com/Testing/Applications (using the correct test cases > format) > > For results, in the testcases wiki we could add a /Results namespace to > add those kind of reports. > > What do you guys think? > > Regards, > Ara. > -- Ubuntu-qa mailing list Ubuntu-qa@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-qa
Re: Application Testing - wiki pages and QA website
Hello Scott, Thanks for noticing this. On 12/13/2009 11:41 AM, Scott Ritchie wrote: > While editing the testing wiki pages I was creating a section for > Application Testing when I noticed that > https://wiki.ubuntu.com/Testing/Applications and > http://testcases.qa.ubuntu.com/Applications appear to be two different > things. > http://testcases.qa.ubuntu.com/Applications is a wiki and everyone can edit it. In fact, it is supposed to be the place to hold any written test case (Canonical or Community driven) and I think it should be a better place to put them. The format to write testcases in testcases.qa.u.c is simple and it won't be a problem for a nonprofessional to contribute. My vote would be to see what's missing in testcases.qa.u.c and copied it from wiki.ubuntu.com/Testing/Applications (using the correct test cases format) For results, in the testcases wiki we could add a /Results namespace to add those kind of reports. What do you guys think? Regards, Ara. -- Ubuntu-qa mailing list Ubuntu-qa@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-qa
Application Testing - wiki pages and QA website
While editing the testing wiki pages I was creating a section for Application Testing when I noticed that https://wiki.ubuntu.com/Testing/Applications and http://testcases.qa.ubuntu.com/Applications appear to be two different things. What's the intended workflow here? Are the ones on qa.ubuntu.com run by the (Canonical) QA team and guaranteed not to break in a real release, while the ones on the wiki are for community members to run themselves? I have a feeling it be better to just have everything moved to the wiki so it would be both easier to add new ones and easier for a nonprofessional to contribute a result -- just edit a (standard) "date tested / tester / pass-fail / bug#" block. An alternative approach would be to allow anyone with a launchpad account to add test results on the QA website. Thanks, Scott Ritchie -- Ubuntu-qa mailing list Ubuntu-qa@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-qa
