Hi Steven Thank you for the comments.
Your suggestion does address both points, and yes, I believe that better integration would be beneficial. But I see the wiki as the resource and the tracker as its consumer, so I actually like the content separation. After all, the ISO tracker may be not the only "customer" of test descriptions. What I would like though is to have the option to update a result of each subtest I perform separately. Also, I believe it would be better to see the instructions directly on the test page in tracker, and not having to use the separate link. And the last thing: for example, on the page [1], there are two absolutely same links: one is called "Live session" and its icon is a page with a ranch key (what that should mean by the way?) and the second is "*Additional instructions are available for this testcase, click here to read them.<http://testcases.qa.ubuntu.com/Install/DesktopLiveSession>", *just below*. *What is the point to have them both? I think one of them definitely should be removed. [1] - http://iso.qa.ubuntu.com/qatracker/result/4330/3 On Wed, Aug 4, 2010 at 5:11 AM, Steven <sten...@gmail.com> wrote: > I second this, on both items. > > 1) There are multiple tests per test case, i.e. the Live Session test case > has three sub-tests, each of which can be passed or failed (Live Session > Start, Live Session Finish, and Live Session Persistence). These sub-tests > should be passable or failable, not the umbrella Live Session test, in case > one is passed and another is failed. > > 2) "Additional instructions are available for this testcase, click here to > read them." makes it sound like it's optional to read how to perform the > tests. "Additional" should be removed. How can we provide consistent result > reports if people might not be following the same procedures? > > Ideally iso.qa.ubuntu.com and testcases.qa.ubuntu.com should be > integrated, such that clicking "Live Session" on iso.qa.ubuntu.com opens > another list of testcases from testcases.qa.ubuntu.com, and clicking on > these gives the instructions from testcases.qa.ubuntu.com along with the > Reporter/Last Update/Bugs/Comments table from iso.qa.ubuntu.com below it, > and the user's report below that. > > Basically instead of just having "Ubuntu Desktop i386 -> Live Session", it > should be "Ubuntu Desktop i386 -> Live Session -> Live Session Start". > > This seems like an efficient solution to your points, Alex. What do you > think about it? Anyone else have any comments about this structure? > > -Steven > > > On Sun, Jul 25, 2010 at 5:22 AM, Alex Lourie <djay...@gmail.com> wrote: > >> Hello QA crowd >> >> I had a couple suggestions for ISO tracker: >> >> 1. I noticed there are few tests that include multiple different checks. >> For example, within one test in server ISO testing there are 2 KVM >> installations, 1 VMWare ESX installation and 1 VMWare server installation. >> While being similar they are different, and having run one check (VMWARE ESX >> - the only system I have) I still cannot provide my results as not all >> checks are finished, so the test is not completed. >> >> I suggest splitting such complex tests into smaller tests, so each of them >> could be tested on its own. >> >> 2. It is not really convenient to open the test, and see there nothing to >> do. As an experienced user I noticed the link to wiki pages, which, of >> course, have the test steps and the success criteria. But I believe it would >> be more obvious and convenient to have all steps directly available within >> the test page. >> >> This, of course, requires development, and that's why I asked if redesign >> is planned in a near future. >> >> I'll be happy for any comments. >> >> -- >> Alex Lourie >> >> -- >> Ubuntu-qa mailing list >> Ubuntu-qa@lists.ubuntu.com >> Modify settings or unsubscribe at: >> https://lists.ubuntu.com/mailman/listinfo/ubuntu-qa >> >> > -- Alex Lourie
-- Ubuntu-qa mailing list Ubuntu-qa@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-qa
