Hi Srinath, We already have TestPlan docs such as [1] which we maintain against each release. However we categorized them according to products. What we can do is, add an additional sheet with "platform test scenarios" and include the cases which needs to be done, which has already been automated etc..
[1] https://docs.google.com/a/wso2.com/spreadsheet/ccc?key=0AvhVRxNoCg0KdDJPY2RMN0xncTFPM1h5Y3NOblVCOEE&hl=en_US&pli=1#gid=27 /Charitha On Fri, Jan 20, 2012 at 1:28 PM, Srinath Perera <srin...@wso2.com> wrote: > Shall we have a test metric defined in a google doc and keep track of > what to be done etc through that test matrix? > --Srinath > > On Fri, Jan 20, 2012 at 1:00 PM, Charitha Kankanamge <chari...@wso2.com> > wrote: > > > > On Fri, Jan 20, 2012 at 11:44 AM, Krishantha Samaraweera > > <krishan...@wso2.com> wrote: > >> > >> Hi Srinath, > >> > >> On Fri, Jan 20, 2012 at 5:28 AM, Srinath Perera <srin...@wso2.com> > wrote: > >>> > >>> Thanks Krishantha!! > >>> > >>> How good are we with test coverage (including introps and perf)? Can > >>> you send the current status and plan to cover other products? > >> > >> > >> As I mentioned in the earlier mail, there were few issue with Ravana, > the > >> perf test framework. Recent updates to the framework causing some > troubles > >> with integration. I will work with Damitha to find possible solution. > >> > >> Sorry I forgot to mention about the interops tests. We haven't integrate > >> interop tests to framework trunk yet. Dharshana is working on it. Will > >> update the status once it is done. > >> > >> We may need to have a distributed product setup if we are going to cover > >> other products. Since running 13 products on the same machine will not > be > >> practical. Currently automation team is more focusing on our main > products. > >> And, the plan is to automate system/platform test plans that is going to > >> prepared by QA team. > > > > > > +1. Our plan is to come up with various test scenarios which involves > > multiple product interactions. These test artifacts will be checked-in to > > test artifacts directory of svn and automation team and QA team will > > integrate it with the system test framework. > > > > > >> > >> And, also includes automation fixes done for external issues. > >> > >>> > >>> Did we start running Bamboo again since this is fixed? > >> > >> > >> Bamboo scheduled builds are running now. > >> > >>> > >>> Do we run introps and perf tests with this? > >>> > >>> > >>> --Srinath > >>> > >>> On Fri, Jan 20, 2012 at 12:28 AM, Krishantha Samaraweera > >>> <krishan...@wso2.com> wrote: > >>> > We need to monitor how this works for few days. > >>> > If everything runs smoothly then we can enable test failure > >>> > notifications. > >>> > > >>> > Thanks, > >>> > Krishantha. > >>> > > >>> > > >>> > On Fri, Jan 20, 2012 at 12:23 AM, Krishantha Samaraweera > >>> > <krishan...@wso2.com> wrote: > >>> >> > >>> >> Hi, > >>> >> > >>> >> We have done the $subject on Bamboo machine and it is working. You > can > >>> >> find the last successful test build at [1]. > >>> >> > >>> >> Test framework has been configured to use packs generated by trunk > >>> >> build. > >>> >> The test setup consists of five products (ESB, G-Reg, AS, BPS and > >>> >> DSS) with > >>> >> registry mounts on top of Mysql. This include Selenium test for > G-Reg > >>> >> as > >>> >> well. I had to exclude Ravana tests due to few issues after updating > >>> >> the > >>> >> Ravana framework. Will get them fix by tomorrow. > >>> >> > >>> >> Thanks, > >>> >> Krishantha. > >>> >> > >>> >> [1] http://wso2.org/bamboo/browse/WSO2CARBONTUNK-AUTOMATIONTEST-13/ > >>> > > >>> > > >>> > >>> > >>> > >>> -- > >>> ============================ > >>> Srinath Perera, Ph.D. > >>> Senior Software Architect, WSO2 Inc. > >>> Visiting Faculty, University of Moratuwa > >>> Member, Apache Software Foundation > >>> Research Scientist, Lanka Software Foundation > >>> Blog: http://srinathsview.blogspot.com/ > >>> Photos: http://www.flickr.com/photos/hemapani/ > >>> Phone: 0772360902 > >> > >> > >> > >> _______________________________________________ > >> Carbon-dev mailing list > >> Carbon-dev@wso2.org > >> http://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > >> > > > > > > -- > ============================ > Srinath Perera, Ph.D. > Senior Software Architect, WSO2 Inc. > Visiting Faculty, University of Moratuwa > Member, Apache Software Foundation > Research Scientist, Lanka Software Foundation > Blog: http://srinathsview.blogspot.com/ > Photos: http://www.flickr.com/photos/hemapani/ > Phone: 0772360902 >
_______________________________________________ Carbon-dev mailing list Carbon-dev@wso2.org http://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
