Re: F18 Criterions/Testcases interconnection

2012-10-26 Thread Josef Skladanka
Well I see your point, but it kind of cuts both ways - Josef clearly got confused by a few cases where we overload test cases to test several different things, so you can argue that it's actually more 'accessible' when we try to stick to 'one test case tests one thing'. But your approach

Re: F18 Criterions/Testcases interconnection

2012-10-26 Thread Josef Skladanka
- Original Message - From: Kamil Paral kpa...@redhat.com No, this is a game of spot five differences :-) At least one versus all virtual consoles. This can be part of the same test case, marked as Alpha/Beta OK, I'll update the summary page/matrix accordingly. Also I'll try to

F18 Criterions/Testcases interconnection

2012-10-25 Thread Josef Skladanka
Hi, I started to connect criterions to testcases for the F18 testing. So far, the Alpha is done (the messy page with criterions links to testcases can be found here https://fedoraproject.org/wiki/User:Jskladan/Sandbox:F18_Criteria_Testcases_Alpha), and it looks all right. Some problems I've

Re: F18 Criterions/Testcases interconnection

2012-10-25 Thread Kamil Paral
Hi, I started to connect criterions to testcases for the F18 testing. So far, the Alpha is done (the messy page with criterions links to testcases can be found here https://fedoraproject.org/wiki/User:Jskladan/Sandbox:F18_Criteria_Testcases_Alpha), and it looks all right. Some problems

Re: F18 Criterions/Testcases interconnection

2012-10-25 Thread Kamil Paral
Beta is done https://fedoraproject.org/wiki/User:Jskladan/Sandbox:F18_Criteria_Testcases_Beta, some issues I've come around: -- 5. The installer must be able to use the HTTP, FTP and either NFS or NFSISO remote package source options - The testcase

Re: F18 Criterions/Testcases interconnection

2012-10-25 Thread Adam Williamson
On Thu, 2012-10-25 at 06:51 -0400, Kamil Paral wrote: 10. The installer must be able to install each of the release blocking desktops, as well as the minimal package set, with each supported installation method - We have testcase for the minimal install

Re: F18 Criterions/Testcases interconnection

2012-10-25 Thread Kamil Paral
We have this: https://fedoraproject.org/wiki/QA:Testcase_Package_Sets_Default_Package_Install That covers GNOME. We could modify it and ask the tester to pick any one of the release blocking desktops to be installed. Do we want to make it fuzzy? (You won't know exactly what was

Re: F18 Criterions/Testcases interconnection

2012-10-25 Thread Adam Williamson
On Thu, 2012-10-25 at 18:47 -0400, Kamil Paral wrote: I think 'the default package set install works' is a Thing in itself, so I'd probably be more in favour of adding a separate test case which covers installing each of the release-blocking desktops and can be marked as 'pass' only if