Re: Let's stop using wiki for test results
Hi Rolf! I was not around teh internetz over the weekend, but I took the liberty of creating the page for your testday just now. I also put the the results already tracked in the wiki into the app, and added a reference to the tool to the wiki testday. Regards, Joza - Original Message - From: Rolf Fokkens r...@rolffokkens.nl To: For testing and quality assurance of Fedora releases test@lists.fedoraproject.org Sent: Saturday, October 12, 2013 3:56:31 PM Subject: Re: Let's stop using wiki for test results Hi, Tomorrow (sunday) there's an SSD cache Test day. I do like not using the wiki for testresults, but is this tool online available to be used for tomorrow's test day? Rolf On 10/11/2013 06:53 PM, Jóhann B. Guðmundsson wrote: On 10/11/2013 04:47 PM, Adam Williamson wrote: Well, 'we' didn't, really. Josef just thought it would be a useful thing to have, so he wrote it, and someone running a test day wound up using it. There was no strategic meeting or grand conspiracy or plan or something. This is how stuff happens in tech, usually: stuff gets done because people just...do it. Not really but OK Now we have seen test days where we used the wiki to track results and test days where we used josef's little tool to track results, and people seem to like the tool, so maybe now we'll make it more clear to people running test days that they have the option of using the tool to track the results. That's really the sum total of what's going on. Anything beats the wiki really so if it's in ready enough shape we should just move to that one instead. JBG -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
Hi, Tomorrow (sunday) there's an SSD cache Test day. I do like not using the wiki for testresults, but is this tool online available to be used for tomorrow's test day? Rolf On 10/11/2013 06:53 PM, Jóhann B. Guðmundsson wrote: On 10/11/2013 04:47 PM, Adam Williamson wrote: Well, 'we' didn't, really. Josef just thought it would be a useful thing to have, so he wrote it, and someone running a test day wound up using it. There was no strategic meeting or grand conspiracy or plan or something. This is how stuff happens in tech, usually: stuff gets done because people just...do it. Not really but OK Now we have seen test days where we used the wiki to track results and test days where we used josef's little tool to track results, and people seem to like the tool, so maybe now we'll make it more clear to people running test days that they have the option of using the tool to track the results. That's really the sum total of what's going on. Anything beats the wiki really so if it's in ready enough shape we should just move to that one instead. JBG -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Let's stop using wiki for test results
Folks, I've participated both in Virtualization and GNOME test days this week and there is one thing that felt very strange and not easy to use for me. GNOME test day results were recorded in the wiki, while Virtualization ones in a web app here: http://209.132.184.192/testdays/show_event?event_id=7 IMO this web app is much easier and faster to use instead of the wiki. And it is not a full blown TCMS like Nitrate, with features that most of the people will not need. I propose to make use of this web app for future test day results/bug tracking. And give it a name :). Regards, Alex -- http://atodorov.org -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
On 10/11/2013 07:55 AM, Alexander Todorov wrote: Folks, I've participated both in Virtualization and GNOME test days this week and there is one thing that felt very strange and not easy to use for me. GNOME test day results were recorded in the wiki, while Virtualization ones in a web app here: http://209.132.184.192/testdays/show_event?event_id=7 IMO this web app is much easier and faster to use instead of the wiki. And it is not a full blown TCMS like Nitrate, with features that most of the people will not need. I propose to make use of this web app for future test day results/bug tracking. And give it a name :). Yes please. This tool made my life much easier when managing F19 and F20 virt test days, as I'm sure it did for all the people who reported test results. There was some promo for it during F19 cycle but not much this time around. Maybe jskladan can enlighten us as to the tools future. - Cole -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
On Fri, 2013-10-11 at 08:21 -0400, Cole Robinson wrote: On 10/11/2013 07:55 AM, Alexander Todorov wrote: Folks, I've participated both in Virtualization and GNOME test days this week and there is one thing that felt very strange and not easy to use for me. GNOME test day results were recorded in the wiki, while Virtualization ones in a web app here: http://209.132.184.192/testdays/show_event?event_id=7 IMO this web app is much easier and faster to use instead of the wiki. And it is not a full blown TCMS like Nitrate, with features that most of the people will not need. I propose to make use of this web app for future test day results/bug tracking. And give it a name :). Yes please. This tool made my life much easier when managing F19 and F20 virt test days, as I'm sure it did for all the people who reported test results. There was some promo for it during F19 cycle but not much this time around. Maybe jskladan can enlighten us as to the tools future. Reporting results to the wiki sucks indeed, I'm in favour of anything that makes it better without any major compromises :) jskladan, what's the current status of the tool, is there any barrier to using it more systematically in future? -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin DOT net http://www.happyassassin.net -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
Hi, first of all - thanks for the kind words! I mailed the testday-owners during F19, I honestly forgot to promote it now (my bad, I guess we could add it to some 'HOW TO' for testdays, if it exists). The app still has it's limits (and I have not yet found the time to work on it since F19), but it can IMHO acomodate most of the tesdays'. The biggest meh issue there is right now is the inability to dynamically add more 'identifying columns' (now the combination of username+hardware says which 'result' comes to which line in the matrix), but I believe that being able to rename it via metadata (to e.g. 'KVM version') can be a simple solution to the problem, and it's weird that I have not thought of that sooner :) I'll ping the people responsible for the (at the moment) sheduled testdays, and do my best to work with them on using the app. BTW: I'm open to name suggestions, now it's just the Testday App :D and it lives here: http://testdays.qa.fedoraproject.org/testdays/ Regards, Joza - Original Message - From: Cole Robinson crobi...@redhat.com To: For testing and quality assurance of Fedora releases test@lists.fedoraproject.org Cc: Josef Skladanka jskla...@redhat.com Sent: Friday, October 11, 2013 2:21:23 PM Subject: Re: Let's stop using wiki for test results On 10/11/2013 07:55 AM, Alexander Todorov wrote: Folks, I've participated both in Virtualization and GNOME test days this week and there is one thing that felt very strange and not easy to use for me. GNOME test day results were recorded in the wiki, while Virtualization ones in a web app here: http://209.132.184.192/testdays/show_event?event_id=7 IMO this web app is much easier and faster to use instead of the wiki. And it is not a full blown TCMS like Nitrate, with features that most of the people will not need. I propose to make use of this web app for future test day results/bug tracking. And give it a name :). Yes please. This tool made my life much easier when managing F19 and F20 virt test days, as I'm sure it did for all the people who reported test results. There was some promo for it during F19 cycle but not much this time around. Maybe jskladan can enlighten us as to the tools future. - Cole -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
On 10/11/2013 01:05 PM, Josef Skladanka wrote: Hi, first of all - thanks for the kind words! I mailed the testday-owners during F19, I honestly forgot to promote it now (my bad, I guess we could add it to some 'HOW TO' for testdays, if it exists). The app still has it's limits (and I have not yet found the time to work on it since F19), but it can IMHO acomodate most of the tesdays'. The biggest meh issue there is right now is the inability to dynamically add more 'identifying columns' (now the combination of username+hardware says which 'result' comes to which line in the matrix), but I believe that being able to rename it via metadata (to e.g. 'KVM version') can be a simple solution to the problem, and it's weird that I have not thought of that sooner :) I'll ping the people responsible for the (at the moment) sheduled testdays, and do my best to work with them on using the app. BTW: I'm open to name suggestions, now it's just the Testday App :D and it lives here: http://testdays.qa.fedoraproject.org/testdays/ Hmm when was it decided that we should write our own app to replace the wiki instead of trying to (re)use something other distribution are using? JBG -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
On Fri, 2013-10-11 at 13:42 +, Jóhann B. Guðmundsson wrote: Hmm when was it decided that we should write our own app to replace the wiki instead of trying to (re)use something other distribution are using? Such as? -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin DOT net http://www.happyassassin.net -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
- Original Message - From: Jóhann B. Guðmundsson johan...@gmail.com To: test@lists.fedoraproject.org Sent: Friday, October 11, 2013 3:42:13 PM Subject: Re: Let's stop using wiki for test results Hmm when was it decided that we should write our own app to replace the wiki instead of trying to (re)use something other distribution are using? JBG Hi, Viking-Ice! this app is/was a resultsdb proof of concept that actually had a practical use. If you are willing to investigate other (existing) tools, I'll be glad to read your research. In the mean time, I think it's OK to offer this alternative (since it also has the wiki-syntax export, so we're not losing any results)... J. -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
На 11.10.2013 17:03, Adam Williamson написа: On Fri, 2013-10-11 at 13:42 +, Jóhann B. Guðmundsson wrote: Hmm when was it decided that we should write our own app to replace the wiki instead of trying to (re)use something other distribution are using? Such as? Just for the record: https://fedorahosted.org/nitrate/ Nitrate is a full blown test case management system, however for the test days I think it is a bit too much. -- Alex -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
On Fri, 2013-10-11 at 17:10 +0300, Alexander Todorov wrote: На 11.10.2013 17:03, Adam Williamson написа: On Fri, 2013-10-11 at 13:42 +, Jóhann B. Guðmundsson wrote: Hmm when was it decided that we should write our own app to replace the wiki instead of trying to (re)use something other distribution are using? Such as? Just for the record: https://fedorahosted.org/nitrate/ Nitrate is a full blown test case management system, however for the test days I think it is a bit too much. Yes, we are fully aware of nitrate, believe me. :P He Rui evaluated nitrate as a replacement for our current processes. It was a while ago, but AFAIK, the comparison broadly still holds true. It would not be a straightforward or universally beneficial switch. https://fedoraproject.org/wiki/Tcms_Comparison -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin DOT net http://www.happyassassin.net -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
On 10/11/2013 02:03 PM, Adam Williamson wrote: On Fri, 2013-10-11 at 13:42 +, Jóhann B. Guðmundsson wrote: Hmm when was it decided that we should write our own app to replace the wiki instead of trying to (re)use something other distribution are using? Such as? Exactly as I thought no research. It's much more practical for us to try to find something to re-use then to write something from scratch on our own and try to maintain it. ( unless we would get a buy in from other distro's ) JBG -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
On Fri, 11 Oct 2013 14:52:28 + Jóhann B. Guðmundsson johan...@gmail.com wrote: On 10/11/2013 02:03 PM, Adam Williamson wrote: On Fri, 2013-10-11 at 13:42 +, Jóhann B. Guðmundsson wrote: Hmm when was it decided that we should write our own app to replace the wiki instead of trying to (re)use something other distribution are using? Such as? Exactly as I thought no research. I have looked into this have turned up a grand total of 0 things which would work well for us. Did I write it up in a formal document? No, I didn't because I didn't find anything worth writing about. It's much more practical for us to try to find something to re-use then to write something from scratch on our own and try to maintain it. ( unless we would get a buy in from other distro's ) Nobody is disagreeing with you on that. If you can find something that we've missed, please let us know. Tim signature.asc Description: PGP signature -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
On Fri, 11 Oct 2013 09:24:06 -0600 Tim Flink tfl...@redhat.com wrote: On Fri, 11 Oct 2013 14:52:28 + Jóhann B. Guðmundsson johan...@gmail.com wrote: On 10/11/2013 02:03 PM, Adam Williamson wrote: On Fri, 2013-10-11 at 13:42 +, Jóhann B. Guðmundsson wrote: Hmm when was it decided that we should write our own app to replace the wiki instead of trying to (re)use something other distribution are using? Such as? Exactly as I thought no research. I have looked into this have turned up a grand total of 0 things which would work well for us. I suppose I wrote that a little too fast. There are 2 things I'm aware of that would satisfy our requirements on the surface. Nitrate has deployment issues on el6 and would require quite a bit of work to even get working for us ignoring the functional mismatch for Fedora. It's great when you have paid employees using it but I don't see it as a great solution for volunteers. Ubuntu's TCMS might work but that's a layer on top of Drupal and I'm not all that excited about learning drupal when that solution doesn't quite solve everything we're looking for. Tim Did I write it up in a formal document? No, I didn't because I didn't find anything worth writing about. It's much more practical for us to try to find something to re-use then to write something from scratch on our own and try to maintain it. ( unless we would get a buy in from other distro's ) Nobody is disagreeing with you on that. If you can find something that we've missed, please let us know. Tim signature.asc Description: PGP signature -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
On 10/11/2013 07:52 AM, Jóhann B. Guðmundsson wrote: On 10/11/2013 02:03 PM, Adam Williamson wrote: On Fri, 2013-10-11 at 13:42 +, Jóhann B. Guðmundsson wrote: Hmm when was it decided that we should write our own app to replace the wiki instead of trying to (re)use something other distribution are using? Such as? Exactly as I thought no research. Is it a language comprehension issue or do you just deliberately misrepresent what people say to match what you want to believe? That response was asking if you had any suggestions, not implying that no research was done. I know you were here for the last big discussion about finding a replacement and the results of that search. Please stop being so antagonistic. -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
On 10/11/2013 03:49 PM, Samuel Sieb wrote: Is it a language comprehension issue or do you just deliberately misrepresent what people say to match what you want to believe? That response was asking if you had any suggestions, not implying that no research was done. I know you were here for the last big discussion about finding a replacement and the results of that search. Please stop being so antagonistic. We for one first need to identify which our requirements are before we either use existing solution and or or write one on our own as well as gather compare and evaluate existing solution before we try to write and maintain an application to do this from scratch on our own. Which is why I was curious how we suddenly had come to the conclusion we should just go ahead and write one from scratch because afaik there exist no evaluation, no wiki page with comparison nor us actually defining what we need and want from such system but I might have missed that discussion. JBG -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
On Fri, 2013-10-11 at 09:28 -0600, Tim Flink wrote: On Fri, 11 Oct 2013 09:24:06 -0600 Tim Flink tfl...@redhat.com wrote: On Fri, 11 Oct 2013 14:52:28 + Jóhann B. Guðmundsson johan...@gmail.com wrote: On 10/11/2013 02:03 PM, Adam Williamson wrote: On Fri, 2013-10-11 at 13:42 +, Jóhann B. Guðmundsson wrote: Hmm when was it decided that we should write our own app to replace the wiki instead of trying to (re)use something other distribution are using? Such as? Exactly as I thought no research. I have looked into this have turned up a grand total of 0 things which would work well for us. I suppose I wrote that a little too fast. There are 2 things I'm aware of that would satisfy our requirements on the surface. Nitrate has deployment issues on el6 and would require quite a bit of work to even get working for us ignoring the functional mismatch for Fedora. It's great when you have paid employees using it but I don't see it as a great solution for volunteers. Ubuntu's TCMS might work but that's a layer on top of Drupal and I'm not all that excited about learning drupal when that solution doesn't quite solve everything we're looking for. Besides, one of the main nice things about josef's tool is that it is specifically *not* a T*C*MS (test CASE management system). It is a test RESULT tracker. Slots much more neatly into our process, with a minimum of disruption, and a clear net benefit, as the starters of the thread showed. -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin DOT net http://www.happyassassin.net -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
On Fri, 2013-10-11 at 16:07 +, Jóhann B. Guðmundsson wrote: On 10/11/2013 03:49 PM, Samuel Sieb wrote: Is it a language comprehension issue or do you just deliberately misrepresent what people say to match what you want to believe? That response was asking if you had any suggestions, not implying that no research was done. I know you were here for the last big discussion about finding a replacement and the results of that search. Please stop being so antagonistic. We for one first need to identify which our requirements are before we either use existing solution and or or write one on our own as well as gather compare and evaluate existing solution before we try to write and maintain an application to do this from scratch on our own. Which is why I was curious how we suddenly had come to the conclusion we should just go ahead and write one from scratch because afaik there exist no evaluation, no wiki page with comparison nor us actually defining what we need and want from such system but I might have missed that discussion. Well, 'we' didn't, really. Josef just thought it would be a useful thing to have, so he wrote it, and someone running a test day wound up using it. There was no strategic meeting or grand conspiracy or plan or something. This is how stuff happens in tech, usually: stuff gets done because people just...do it. Now we have seen test days where we used the wiki to track results and test days where we used josef's little tool to track results, and people seem to like the tool, so maybe now we'll make it more clear to people running test days that they have the option of using the tool to track the results. That's really the sum total of what's going on. -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin DOT net http://www.happyassassin.net -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
Re: Let's stop using wiki for test results
On 10/11/2013 04:47 PM, Adam Williamson wrote: Well, 'we' didn't, really. Josef just thought it would be a useful thing to have, so he wrote it, and someone running a test day wound up using it. There was no strategic meeting or grand conspiracy or plan or something. This is how stuff happens in tech, usually: stuff gets done because people just...do it. Not really but OK Now we have seen test days where we used the wiki to track results and test days where we used josef's little tool to track results, and people seem to like the tool, so maybe now we'll make it more clear to people running test days that they have the option of using the tool to track the results. That's really the sum total of what's going on. Anything beats the wiki really so if it's in ready enough shape we should just move to that one instead. JBG -- test mailing list test@lists.fedoraproject.org To unsubscribe: https://admin.fedoraproject.org/mailman/listinfo/test
