We will have a separate Gdoc to capture the platform test scenarios. See [1] (in progress version) The test artifacts produced by us in these scenarios will be merged into the system framework.
[1]https://docs.google.com/a/wso2.com/spreadsheet/ccc?key=0Arh4GwhkOX3ndEZnRll4eFhjRjhqVGlJUEd1b0FsZ0E&hl=en_US#gid=0 /Charitha On Fri, Jan 20, 2012 at 1:52 PM, Charitha Kankanamge <[email protected]> wrote: > > Hi Srinath, > > We already have TestPlan docs such as [1] which we maintain against each > release. However we categorized them according to products. What we can do > is, add an additional sheet with "platform test scenarios" and include the > cases which needs to be done, which has already been automated etc.. > > [1]https://docs.google.com/a/wso2.com/spreadsheet/ccc?key=0AvhVRxNoCg0KdDJPY2RMN0xncTFPM1h5Y3NOblVCOEE&hl=en_US&pli=1#gid=27 > > /Charitha > > > On Fri, Jan 20, 2012 at 1:28 PM, Srinath Perera <[email protected]> wrote: >> >> Shall we have a test metric defined in a google doc and keep track of >> what to be done etc through that test matrix? >> --Srinath >> >> On Fri, Jan 20, 2012 at 1:00 PM, Charitha Kankanamge <[email protected]> >> wrote: >> > >> > On Fri, Jan 20, 2012 at 11:44 AM, Krishantha Samaraweera >> > <[email protected]> wrote: >> >> >> >> Hi Srinath, >> >> >> >> On Fri, Jan 20, 2012 at 5:28 AM, Srinath Perera <[email protected]> >> >> wrote: >> >>> >> >>> Thanks Krishantha!! >> >>> >> >>> How good are we with test coverage (including introps and perf)? Can >> >>> you send the current status and plan to cover other products? >> >> >> >> >> >> As I mentioned in the earlier mail, there were few issue with Ravana, >> >> the >> >> perf test framework. Recent updates to the framework causing some >> >> troubles >> >> with integration. I will work with Damitha to find possible solution. >> >> >> >> Sorry I forgot to mention about the interops tests. We haven't >> >> integrate >> >> interop tests to framework trunk yet. Dharshana is working on it. Will >> >> update the status once it is done. >> >> >> >> We may need to have a distributed product setup if we are going to >> >> cover >> >> other products. Since running 13 products on the same machine will not >> >> be >> >> practical. Currently automation team is more focusing on our main >> >> products. >> >> And, the plan is to automate system/platform test plans that is going >> >> to >> >> prepared by QA team. >> > >> > >> > +1. Our plan is to come up with various test scenarios which involves >> > multiple product interactions. These test artifacts will be checked-in >> > to >> > test artifacts directory of svn and automation team and QA team will >> > integrate it with the system test framework. >> > >> > >> >> >> >> And, also includes automation fixes done for external issues. >> >> >> >>> >> >>> Did we start running Bamboo again since this is fixed? >> >> >> >> >> >> Bamboo scheduled builds are running now. >> >> >> >>> >> >>> Do we run introps and perf tests with this? >> >>> >> >>> >> >>> --Srinath >> >>> >> >>> On Fri, Jan 20, 2012 at 12:28 AM, Krishantha Samaraweera >> >>> <[email protected]> wrote: >> >>> > We need to monitor how this works for few days. >> >>> > If everything runs smoothly then we can enable test failure >> >>> > notifications. >> >>> > >> >>> > Thanks, >> >>> > Krishantha. >> >>> > >> >>> > >> >>> > On Fri, Jan 20, 2012 at 12:23 AM, Krishantha Samaraweera >> >>> > <[email protected]> wrote: >> >>> >> >> >>> >> Hi, >> >>> >> >> >>> >> We have done the $subject on Bamboo machine and it is working. You >> >>> >> can >> >>> >> find the last successful test build at [1]. >> >>> >> >> >>> >> Test framework has been configured to use packs generated by trunk >> >>> >> build. >> >>> >> The test setup consists of five products (ESB, G-Reg, AS, BPS and >> >>> >> DSS) with >> >>> >> registry mounts on top of Mysql. This include Selenium test for >> >>> >> G-Reg >> >>> >> as >> >>> >> well. I had to exclude Ravana tests due to few issues after >> >>> >> updating >> >>> >> the >> >>> >> Ravana framework. Will get them fix by tomorrow. >> >>> >> >> >>> >> Thanks, >> >>> >> Krishantha. >> >>> >> >> >>> >> [1] http://wso2.org/bamboo/browse/WSO2CARBONTUNK-AUTOMATIONTEST-13/ >> >>> > >> >>> > >> >>> >> >>> >> >>> >> >>> -- >> >>> ============================ >> >>> Srinath Perera, Ph.D. >> >>> Senior Software Architect, WSO2 Inc. >> >>> Visiting Faculty, University of Moratuwa >> >>> Member, Apache Software Foundation >> >>> Research Scientist, Lanka Software Foundation >> >>> Blog: http://srinathsview.blogspot.com/ >> >>> Photos: http://www.flickr.com/photos/hemapani/ >> >>> Phone: 0772360902 >> >> >> >> >> >> >> >> _______________________________________________ >> >> Carbon-dev mailing list >> >> [email protected] >> >> http://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> >> >> > >> >> >> >> -- >> ============================ >> Srinath Perera, Ph.D. >> Senior Software Architect, WSO2 Inc. >> Visiting Faculty, University of Moratuwa >> Member, Apache Software Foundation >> Research Scientist, Lanka Software Foundation >> Blog: http://srinathsview.blogspot.com/ >> Photos: http://www.flickr.com/photos/hemapani/ >> Phone: 0772360902 > > _______________________________________________ Carbon-dev mailing list [email protected] http://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
