Re: [Carbon-dev] ESB Test automation status
On Thu, Sep 9, 2010 at 5:33 PM, Chamara Silva wrote: > Following are the admin services currently use in esb test automation > framework.i much appreciate anyone can review this and let us know > what are the remaining admin services need to cover in esb test > framework. > > 1. AuthenticationAdmin > 2. EndpointAdmin > 3. LocalEntryAdmin > 4. ProxyServiceAdmin > 5. ResourceAdminService > 6. SecurityAdminService > 7. SequenceAdminService > 8. ServiceAdmin > 9. ConfigServiceAdmin > 10. ThrottleAdminService > >From the ESB's perspective we need to cover Event Sources Priority Executors Scheduled Tasks Mediation Stats Transport Stats Thanks, Supun.. > Thank you, > Chamara > > On Thu, Sep 9, 2010 at 4:18 PM, Samisa Abeysinghe wrote: >> Sounds good! >> One more question. Did we use backed admin services' interfaces and wrote >> tests to cover all back-end services's operations? >> >> On Thu, Sep 9, 2010 at 3:36 PM, Thilini Ishaka wrote: >>> >>> On Thu, Sep 9, 2010 at 2:48 PM, Samisa Abeysinghe wrote: On Thu, Sep 9, 2010 at 2:42 PM, Charitha Kankanamge wrote: > > The scenarios given in this list are covered by both sample tests and > the others. Please treat samples separate and get all these scenarios covered separate, irrespective of the fact that those are already covered with samples or not. That why we have the assurance on complete coverage. >>> >>> Yes. The esb-sample is a separate category and there are other modules to >>> cover almost all the features irrespective of they are covering in the >>> sample module or not. >>> For a example there are samples to cover throttle mediation (Sample >>> 370-372), but we have a separate module called mediators-throttle to handle >>> its' functionality which is capable of handling wide range of functionality. >>> Using that module we are checking whether the required response are coming >>> out or not, entries goes to the esb log correctly, etc (depending on the >>> situation). >>> >>> Those separate categories/modules can be found at [1] with the automation >>> status. >>> [1] >>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>> [2] >>> https://svn.wso2.org/repos/wso2/trunk/commons/qa/component-test-framework/ >>> >>> Also please find [2] to get a brief idea of how the framework is >>> structured. >>> Further I will give the module structure of pom.xml to get a clear idea. >>> >>> authenticator >>> common >>> servicemanagement >>> >>> >>> resourceadmin >>> securitymanagement >>> throttleadmin >>> synapse-config-admin >>> >>> >>> proxyservices >>> sequences >>> endpoints >>> localentry >>> mediators-send >>> >>> >>> mediators-drop >>> mediators-sequence >>> mediators-inout >>> mediators-filter >>> >>> >>> mediators-clone >>> mediators-log >>> mediators-throttle >>> mediators-switch >>> >>> >>> mediators-property >>> esb-sample >>> >>> Here you will see that esb-sample is separated from all the other modules. >>> The above list goes bigger. >>> >>> regards >>> Thilini >>> >>> It would be fine to use bits and pieces of samples to cover each scenario. But covering individual scenarios on their own is a must. You can think of samples as system tests and the individual case covering like som`e unit cases. Samisa... > > Therefore, in order to identify the tests covered beyond the samples, > can you highlight those specific scenarios? > > Btw, the wiki url should be > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > > /Charitha > > > > On Thu, Sep 9, 2010 at 2:28 PM, Chamara Silva wrote: >> >> In addition to the esb sample automation,we are covering test >> scenarios mention in the ESB test case document in >> >> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios.specially >> mediator test scenarios. WYT ? >> >> thanks, >> chamara >> >> On Thu, Sep 9, 2010 at 2:10 PM, Samisa Abeysinghe >> wrote: >> > >> > >> > On Thu, Sep 9, 2010 at 9:59 AM, Chamara Silva >> > wrote: >> >> >> >> As thilini explained we are in the final stage of esb automation.we >> >> can start greg or other product automation from Monday. >> > >> > What are the scenarios covered beyond samples? >> > >> >> >> >> thanks, >> >> chamara >> >> >> >> On Thu, Sep 9, 2010 at 7:34 AM, Thilini Ishaka >> >> wrote: >> >> > >> >> > >> >> > Yes. We have started covering remaining test scenarios. >> >> > Also the remaining sample tests like JMS, VFS, Mail have been >> >> > automated. >> >> > Will have a small test run tomorrow. >> >> > >> >> > thanks >>
Re: [Carbon-dev] ESB Test automation status
On Wed, Sep 8, 2010 at 8:08 PM, Samisa Abeysinghe wrote: > Have we started covering the test scenarios that we discussed beyond > samples to cover the feature list? > > We need to turn to other product automation, like G-Reg soon! So I am keen > to close the chapter on ESB ASAP! > Can we start test automation for eclipse tools also please. Atleast in a POC level. It'll help to reduce alot of QA time since tools cover all products. Saminda > > On Fri, Sep 3, 2010 at 9:29 AM, Charitha Kankanamge wrote: > >> >> Ok then. Thilini, lets try to find possibilities of automating JMS >> scenarios first. You may write a script (shell/ruby/ant or python) to >> configure the pre-requisites such as copying activemq libs to ESB and >> starting ActiveMQ server. Then, the rest can be done by usual Junit test >> cases. >> >> Regards >> Charitha >> >> >> >> On Fri, Sep 3, 2010 at 5:38 AM, Samisa Abeysinghe wrote: >> >>> Folks, IMHO, it is too early to worry about exact coverage. A ball >>> park figure would be sufficient for the moment. >>> This is bevuase we have better things to do like adding other >>> transports and the like. I would rather spend our time and effort on >>> this as of now. >>> >>> I agree that we will need to have Emma in the picture at some point, >>> because some clients might ask for it etc. But later please... >>> >>> On Thursday, September 2, 2010, Charitha Kankanamge >>> wrote: >>> > >>> > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva >>> wrote: >>> > >>> > For Smoke test perspective, we believe that the framework covers 80% >>> > of the functionality. In order to get the exact test coverage figure, >>> > we may run Emma or clover in due course. >>> > >>> > Thilini, >>> > Can you please instrument ESB with Emma and try to find the % coverage? >>> > >>> > Regards >>> > Charitha >>> > >>> > >>> > >>> > Regards >>> > Chamara >>> > >>> > >>> > >>> > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe >>> wrote: >>> >> Good! How much in terms of % does this cover as of now? >>> >> >>> >> On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri < >>> evanth...@wso2.com> >>> >> wrote: >>> >>> >>> >>> Hi, >>> >>> >>> >>> We used the framework to smoke test the Alpha3 build and were able to >>> find >>> >>> a few issues of samples through this. The framework works well on >>> Windows as >>> >>> well. >>> >>> >>> >>> Regards, >>> >>> Evanthika >>> >>> >>> >>> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva >>> wrote: >>> >>> ESB test automation framework covered following test areas right >>> now. >>> >>> 1. ESB Samples >>> 2. Functional test - please find the automated test cases from [ >>> >>> >>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>> ] >>> >>> thanks, >>> Chamara >>> -- >>> Suminda Chamara Silva >>> Senior Software Engineer - QA >>> WSO2 Inc. >>> Mobile: +94 718 302858 >>> blog: http://chamaras.blogspot.com >>> >>> ___ >>> Carbon-dev mailing list >>> Carbon-dev@wso2.org >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >>> >>> >>> >>> >>> ___ >>> >>> Carbon-dev mailing list >>> >>> Carbon-dev@wso2.org >>> >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >>> >>> >> Thanks, >>> >> Samisa... >>> >> >>> >> Samisa Abeysinghe >>> >> VP Engineering >>> >> WSO2 Inc. >>> >> http://wso2.com >>> >> http://wso2.org >>> >> >>> >> >>> >> >>> >> ___ >>> >> Carbon-dev mailing list >>> >> Carbon-dev@wso2.org >>> >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >> >>> >> >>> > >>> > >>> > >>> > -- >>> > Suminda Chamara Silva >>> > Senior Software Engineer - QA >>> > WSO2 Inc. >>> > Mobile: +94 718 302858 >>> > blog: http://chamaras.blogspot.com >>> > >>> > ___ >>> > Carbon-dev mailing list >>> > Carbon-dev@wso2.org >>> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> > >>> > >>> >>> ___ >>> Carbon-dev mailing list >>> Carbon-dev@wso2.org >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >> >> >> ___ >> Carbon-dev mailing list >> Carbon-dev@wso2.org >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> >> Thanks, > Samisa... > > Samisa Abeysinghe > VP Engineering > WSO2 Inc. > http://wso2.com > http://wso2.org > > > > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
Re: [Carbon-dev] ESB Test automation status
Following are the admin services currently use in esb test automation framework.i much appreciate anyone can review this and let us know what are the remaining admin services need to cover in esb test framework. 1. AuthenticationAdmin 2. EndpointAdmin 3. LocalEntryAdmin 4. ProxyServiceAdmin 5. ResourceAdminService 6. SecurityAdminService 7. SequenceAdminService 8. ServiceAdmin 9. ConfigServiceAdmin 10. ThrottleAdminService Thank you, Chamara On Thu, Sep 9, 2010 at 4:18 PM, Samisa Abeysinghe wrote: > Sounds good! > One more question. Did we use backed admin services' interfaces and wrote > tests to cover all back-end services's operations? > > On Thu, Sep 9, 2010 at 3:36 PM, Thilini Ishaka wrote: >> >> On Thu, Sep 9, 2010 at 2:48 PM, Samisa Abeysinghe wrote: >>> >>> >>> On Thu, Sep 9, 2010 at 2:42 PM, Charitha Kankanamge >>> wrote: The scenarios given in this list are covered by both sample tests and the others. >>> >>> Please treat samples separate and get all >>> these scenarios covered separate, irrespective of the fact that those are >>> already covered with samples or not. That why we have the assurance on >>> complete coverage. >> >> Yes. The esb-sample is a separate category and there are other modules to >> cover almost all the features irrespective of they are covering in the >> sample module or not. >> For a example there are samples to cover throttle mediation (Sample >> 370-372), but we have a separate module called mediators-throttle to handle >> its' functionality which is capable of handling wide range of functionality. >> Using that module we are checking whether the required response are coming >> out or not, entries goes to the esb log correctly, etc (depending on the >> situation). >> >> Those separate categories/modules can be found at [1] with the automation >> status. >> [1] >> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >> [2] >> https://svn.wso2.org/repos/wso2/trunk/commons/qa/component-test-framework/ >> >> Also please find [2] to get a brief idea of how the framework is >> structured. >> Further I will give the module structure of pom.xml to get a clear idea. >> >>authenticator >> common >> servicemanagement >> >> >> resourceadmin >> securitymanagement >> throttleadmin >> synapse-config-admin >> >> >> proxyservices >> sequences >> endpoints >> localentry >> mediators-send >> >> >> mediators-drop >> mediators-sequence >> mediators-inout >> mediators-filter >> >> >>mediators-clone >> mediators-log >> mediators-throttle >> mediators-switch >> >> >> mediators-property >> esb-sample >> >> Here you will see that esb-sample is separated from all the other modules. >> The above list goes bigger. >> >> regards >> Thilini >> >> >>> >>> It would be fine to use bits and pieces of samples to cover each >>> scenario. But covering individual scenarios on their own is a must. >>> You can think of samples as system tests and the individual case covering >>> like som`e unit cases. >>> Samisa... Therefore, in order to identify the tests covered beyond the samples, can you highlight those specific scenarios? Btw, the wiki url should be https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios /Charitha On Thu, Sep 9, 2010 at 2:28 PM, Chamara Silva wrote: > > In addition to the esb sample automation,we are covering test > scenarios mention in the ESB test case document in > > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios.specially > mediator test scenarios. WYT ? > > thanks, > chamara > > On Thu, Sep 9, 2010 at 2:10 PM, Samisa Abeysinghe > wrote: > > > > > > On Thu, Sep 9, 2010 at 9:59 AM, Chamara Silva > > wrote: > >> > >> As thilini explained we are in the final stage of esb automation.we > >> can start greg or other product automation from Monday. > > > > What are the scenarios covered beyond samples? > > > >> > >> thanks, > >> chamara > >> > >> On Thu, Sep 9, 2010 at 7:34 AM, Thilini Ishaka > >> wrote: > >> > > >> > > >> > Yes. We have started covering remaining test scenarios. > >> > Also the remaining sample tests like JMS, VFS, Mail have been > >> > automated. > >> > Will have a small test run tomorrow. > >> > > >> > thanks > >> > > >> > regards > >> > Thilini > >> > > >> > > >> > On Wed, Sep 8, 2010 at 10:17 PM, Charitha Kankanamge > >> > > >> > wrote: > >> >> > >> >> > >> >> On Wed, Sep 8, 2010 at 8:08 PM, Samisa Abeysinghe > >> >> > >> >> wrote: > >> >>> > >> >>> Have we started covering the test scenarios that we discussed > >
Re: [Carbon-dev] ESB Test automation status
Sounds good! One more question. Did we use backed admin services' interfaces and wrote tests to cover all back-end services's operations? On Thu, Sep 9, 2010 at 3:36 PM, Thilini Ishaka wrote: > > On Thu, Sep 9, 2010 at 2:48 PM, Samisa Abeysinghe wrote: > >> >> >> On Thu, Sep 9, 2010 at 2:42 PM, Charitha Kankanamge wrote: >> >>> The scenarios given in this list are covered by both sample tests and the >>> others. >> >> >> Please treat samples separate and get all >> these scenarios covered separate, irrespective of the fact that those are >> already covered with samples or not. That why we have the assurance on >> complete coverage. >> > > Yes. The esb-sample is a separate category and there are other modules to > cover almost all the features irrespective of they are covering in the > sample module or not. > For a example there are samples to cover throttle mediation (Sample > 370-372), but we have a separate module called *mediators-throttle* to > handle its' functionality which is capable of handling wide range of > functionality. Using that module we are checking whether the required > response are coming out or not, entries goes to the esb log correctly, etc > (depending on the situation). > > Those separate categories/modules can be found at [1] with the automation > status. > [1] > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > [2] > https://svn.wso2.org/repos/wso2/trunk/commons/qa/component-test-framework/ > > Also please find [2] to get a brief idea of how the framework is > structured. > Further I will give the module structure of pom.xml to get a clear idea. > >authenticator > common > servicemanagement > > resourceadmin > securitymanagement > throttleadmin > synapse-config-admin > > proxyservices > sequences > endpoints > localentry > mediators-send > > mediators-drop > mediators-sequence > mediators-inout > mediators-filter > >mediators-clone > mediators-log > mediators-throttle > mediators-switch > > mediators-property > esb-sample > > Here you will see that esb-sample is separated from all the other modules. > The above list goes bigger. > > regards > Thilini > > > > >> It would be fine to use bits and pieces of samples to cover each scenario. >> But covering individual scenarios on their own is a must. >> >> You can think of samples as system tests and the individual case covering >> like som`e unit cases. >> >> Samisa... >> >> Therefore, in order to identify the tests covered beyond the samples, can >>> you highlight those specific scenarios? >>> >>> Btw, the wiki url should be >>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>> >>> /Charitha >>> >>> >>> >>> >>> On Thu, Sep 9, 2010 at 2:28 PM, Chamara Silva wrote: >>> In addition to the esb sample automation,we are covering test scenarios mention in the ESB test case document in https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios.specially mediator test scenarios. WYT ? thanks, chamara On Thu, Sep 9, 2010 at 2:10 PM, Samisa Abeysinghe wrote: > > > On Thu, Sep 9, 2010 at 9:59 AM, Chamara Silva wrote: >> >> As thilini explained we are in the final stage of esb automation.we >> can start greg or other product automation from Monday. > > What are the scenarios covered beyond samples? > >> >> thanks, >> chamara >> >> On Thu, Sep 9, 2010 at 7:34 AM, Thilini Ishaka wrote: >> > >> > >> > Yes. We have started covering remaining test scenarios. >> > Also the remaining sample tests like JMS, VFS, Mail have been automated. >> > Will have a small test run tomorrow. >> > >> > thanks >> > >> > regards >> > Thilini >> > >> > >> > On Wed, Sep 8, 2010 at 10:17 PM, Charitha Kankanamge < chari...@wso2.com> >> > wrote: >> >> >> >> >> >> On Wed, Sep 8, 2010 at 8:08 PM, Samisa Abeysinghe < sam...@wso2.com> >> >> wrote: >> >>> >> >>> Have we started covering the test scenarios that we discussed beyond >> >>> samples to cover the feature list? >> >> >> >> Yes. It has been started. Chamara, please chime in. >> >> >> >>> We need to turn to other product automation, like G-Reg soon! So I am >> >>> keen to close the chapter on ESB ASAP! >> >> >> >> Yes. We should. Chamara/Thilini, we need to accelerate this effort and >> >> complete the remaining scenarios listed in >> >> >> >> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >> >> >> >> >> >>> >> >>> On Fri, Sep 3, 2010 at 9:29 AM, Charitha Kankanamge >> >>> >> >>> wro
Re: [Carbon-dev] ESB Test automation status
On Thu, Sep 9, 2010 at 2:48 PM, Samisa Abeysinghe wrote: > > > On Thu, Sep 9, 2010 at 2:42 PM, Charitha Kankanamge wrote: > >> The scenarios given in this list are covered by both sample tests and the >> others. > > > Please treat samples separate and get all these scenarios covered separate, > irrespective of the fact that those are already covered with samples or not. > That why we have the assurance on complete coverage. > Yes. The esb-sample is a separate category and there are other modules to cover almost all the features irrespective of they are covering in the sample module or not. For a example there are samples to cover throttle mediation (Sample 370-372), but we have a separate module called *mediators-throttle* to handle its' functionality which is capable of handling wide range of functionality. Using that module we are checking whether the required response are coming out or not, entries goes to the esb log correctly, etc (depending on the situation). Those separate categories/modules can be found at [1] with the automation status. [1] https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios [2] https://svn.wso2.org/repos/wso2/trunk/commons/qa/component-test-framework/ Also please find [2] to get a brief idea of how the framework is structured. Further I will give the module structure of pom.xml to get a clear idea. authenticator common servicemanagement resourceadmin securitymanagement throttleadmin synapse-config-admin proxyservices sequences endpoints localentry mediators-send mediators-drop mediators-sequence mediators-inout mediators-filter mediators-clone mediators-log mediators-throttle mediators-switch mediators-property esb-sample Here you will see that esb-sample is separated from all the other modules. The above list goes bigger. regards Thilini > It would be fine to use bits and pieces of samples to cover each scenario. > But covering individual scenarios on their own is a must. > > You can think of samples as system tests and the individual case covering > like som`e unit cases. > > Samisa... > > Therefore, in order to identify the tests covered beyond the samples, can >> you highlight those specific scenarios? >> >> Btw, the wiki url should be >> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >> >> /Charitha >> >> >> >> >> On Thu, Sep 9, 2010 at 2:28 PM, Chamara Silva wrote: >> >>> In addition to the esb sample automation,we are covering test >>> scenarios mention in the ESB test case document in >>> >>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios.specially >>> mediator test scenarios. WYT ? >>> >>> thanks, >>> chamara >>> >>> On Thu, Sep 9, 2010 at 2:10 PM, Samisa Abeysinghe >>> wrote: >>> > >>> > >>> > On Thu, Sep 9, 2010 at 9:59 AM, Chamara Silva >>> wrote: >>> >> >>> >> As thilini explained we are in the final stage of esb automation.we >>> >> can start greg or other product automation from Monday. >>> > >>> > What are the scenarios covered beyond samples? >>> > >>> >> >>> >> thanks, >>> >> chamara >>> >> >>> >> On Thu, Sep 9, 2010 at 7:34 AM, Thilini Ishaka >>> wrote: >>> >> > >>> >> > >>> >> > Yes. We have started covering remaining test scenarios. >>> >> > Also the remaining sample tests like JMS, VFS, Mail have been >>> automated. >>> >> > Will have a small test run tomorrow. >>> >> > >>> >> > thanks >>> >> > >>> >> > regards >>> >> > Thilini >>> >> > >>> >> > >>> >> > On Wed, Sep 8, 2010 at 10:17 PM, Charitha Kankanamge < >>> chari...@wso2.com> >>> >> > wrote: >>> >> >> >>> >> >> >>> >> >> On Wed, Sep 8, 2010 at 8:08 PM, Samisa Abeysinghe >> > >>> >> >> wrote: >>> >> >>> >>> >> >>> Have we started covering the test scenarios that we discussed >>> beyond >>> >> >>> samples to cover the feature list? >>> >> >> >>> >> >> Yes. It has been started. Chamara, please chime in. >>> >> >> >>> >> >>> We need to turn to other product automation, like G-Reg soon! So I >>> am >>> >> >>> keen to close the chapter on ESB ASAP! >>> >> >> >>> >> >> Yes. We should. Chamara/Thilini, we need to accelerate this effort >>> and >>> >> >> complete the remaining scenarios listed in >>> >> >> >>> >> >> >>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>> >> >> >>> >> >> >>> >> >>> >>> >> >>> On Fri, Sep 3, 2010 at 9:29 AM, Charitha Kankanamge >>> >> >>> >>> >> >>> wrote: >>> >> >>> >> Ok then. Thilini, lets try to find possibilities of automating >>> JMS >>> >> scenarios first. You may write a script (shell/ruby/ant or >>> python) to >>> >> configure the pre-requisites such as copying activemq libs to ESB >>> and >>> >> starting ActiveMQ server. Then, the rest can be done by usual >>> Junit >>> >> test >>> >> cases. >>> >> >>> >> Regards >>> >>
Re: [Carbon-dev] ESB Test automation status
On Thu, Sep 9, 2010 at 2:42 PM, Charitha Kankanamge wrote: > The scenarios given in this list are covered by both sample tests and the > others. Please treat samples separate and get all these scenarios covered separate, irrespective of the fact that those are already covered with samples or not. That why we have the assurance on complete coverage. It would be fine to use bits and pieces of samples to cover each scenario. But covering individual scenarios on their own is a must. You can think of samples as system tests and the individual case covering like som`e unit cases. Samisa... Therefore, in order to identify the tests covered beyond the samples, can > you highlight those specific scenarios? > > Btw, the wiki url should be > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > > /Charitha > > > > > On Thu, Sep 9, 2010 at 2:28 PM, Chamara Silva wrote: > >> In addition to the esb sample automation,we are covering test >> scenarios mention in the ESB test case document in >> >> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios.specially >> mediator test scenarios. WYT ? >> >> thanks, >> chamara >> >> On Thu, Sep 9, 2010 at 2:10 PM, Samisa Abeysinghe >> wrote: >> > >> > >> > On Thu, Sep 9, 2010 at 9:59 AM, Chamara Silva wrote: >> >> >> >> As thilini explained we are in the final stage of esb automation.we >> >> can start greg or other product automation from Monday. >> > >> > What are the scenarios covered beyond samples? >> > >> >> >> >> thanks, >> >> chamara >> >> >> >> On Thu, Sep 9, 2010 at 7:34 AM, Thilini Ishaka >> wrote: >> >> > >> >> > >> >> > Yes. We have started covering remaining test scenarios. >> >> > Also the remaining sample tests like JMS, VFS, Mail have been >> automated. >> >> > Will have a small test run tomorrow. >> >> > >> >> > thanks >> >> > >> >> > regards >> >> > Thilini >> >> > >> >> > >> >> > On Wed, Sep 8, 2010 at 10:17 PM, Charitha Kankanamge < >> chari...@wso2.com> >> >> > wrote: >> >> >> >> >> >> >> >> >> On Wed, Sep 8, 2010 at 8:08 PM, Samisa Abeysinghe >> >> >> wrote: >> >> >>> >> >> >>> Have we started covering the test scenarios that we discussed >> beyond >> >> >>> samples to cover the feature list? >> >> >> >> >> >> Yes. It has been started. Chamara, please chime in. >> >> >> >> >> >>> We need to turn to other product automation, like G-Reg soon! So I >> am >> >> >>> keen to close the chapter on ESB ASAP! >> >> >> >> >> >> Yes. We should. Chamara/Thilini, we need to accelerate this effort >> and >> >> >> complete the remaining scenarios listed in >> >> >> >> >> >> >> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >> >> >> >> >> >> >> >> >>> >> >> >>> On Fri, Sep 3, 2010 at 9:29 AM, Charitha Kankanamge >> >> >>> >> >> >>> wrote: >> >> >> >> Ok then. Thilini, lets try to find possibilities of automating JMS >> >> scenarios first. You may write a script (shell/ruby/ant or python) >> to >> >> configure the pre-requisites such as copying activemq libs to ESB >> and >> >> starting ActiveMQ server. Then, the rest can be done by usual >> Junit >> >> test >> >> cases. >> >> >> >> Regards >> >> Charitha >> >> >> >> >> >> On Fri, Sep 3, 2010 at 5:38 AM, Samisa Abeysinghe < >> sam...@wso2.com> >> >> wrote: >> >> > >> >> > Folks, IMHO, it is too early to worry about exact coverage. A >> ball >> >> > park figure would be sufficient for the moment. >> >> > This is bevuase we have better things to do like adding other >> >> > transports and the like. I would rather spend our time and effort >> on >> >> > this as of now. >> >> > >> >> > I agree that we will need to have Emma in the picture at some >> point, >> >> > because some clients might ask for it etc. But later please... >> >> > >> >> > On Thursday, September 2, 2010, Charitha Kankanamge >> >> > >> >> > wrote: >> >> > > >> >> > > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva < >> cham...@wso2.com> >> >> > > wrote: >> >> > > >> >> > > For Smoke test perspective, we believe that the framework >> covers >> >> > > 80% >> >> > > of the functionality. In order to get the exact test coverage >> >> > > figure, >> >> > > we may run Emma or clover in due course. >> >> > > >> >> > > Thilini, >> >> > > Can you please instrument ESB with Emma and try to find the % >> >> > > coverage? >> >> > > >> >> > > Regards >> >> > > Charitha >> >> > > >> >> > > >> >> > > >> >> > > Regards >> >> > > Chamara >> >> > > >> >> > > >> >> > > >> >> > > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe >> >> > > >> >> > > wrote: >> >> > >> Good! How much in terms of % does this cover as of now? >> >> > >> >> >> > >> On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri >> >> > >> >> >> > >> wrote: >> >> > >>> >>
Re: [Carbon-dev] ESB Test automation status
The scenarios given in this list are covered by both sample tests and the others. Therefore, in order to identify the tests covered beyond the samples, can you highlight those specific scenarios? Btw, the wiki url should be https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios /Charitha On Thu, Sep 9, 2010 at 2:28 PM, Chamara Silva wrote: > In addition to the esb sample automation,we are covering test > scenarios mention in the ESB test case document in > > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios.specially > mediator test scenarios. WYT ? > > thanks, > chamara > > On Thu, Sep 9, 2010 at 2:10 PM, Samisa Abeysinghe wrote: > > > > > > On Thu, Sep 9, 2010 at 9:59 AM, Chamara Silva wrote: > >> > >> As thilini explained we are in the final stage of esb automation.we > >> can start greg or other product automation from Monday. > > > > What are the scenarios covered beyond samples? > > > >> > >> thanks, > >> chamara > >> > >> On Thu, Sep 9, 2010 at 7:34 AM, Thilini Ishaka > wrote: > >> > > >> > > >> > Yes. We have started covering remaining test scenarios. > >> > Also the remaining sample tests like JMS, VFS, Mail have been > automated. > >> > Will have a small test run tomorrow. > >> > > >> > thanks > >> > > >> > regards > >> > Thilini > >> > > >> > > >> > On Wed, Sep 8, 2010 at 10:17 PM, Charitha Kankanamge < > chari...@wso2.com> > >> > wrote: > >> >> > >> >> > >> >> On Wed, Sep 8, 2010 at 8:08 PM, Samisa Abeysinghe > >> >> wrote: > >> >>> > >> >>> Have we started covering the test scenarios that we discussed beyond > >> >>> samples to cover the feature list? > >> >> > >> >> Yes. It has been started. Chamara, please chime in. > >> >> > >> >>> We need to turn to other product automation, like G-Reg soon! So I > am > >> >>> keen to close the chapter on ESB ASAP! > >> >> > >> >> Yes. We should. Chamara/Thilini, we need to accelerate this effort > and > >> >> complete the remaining scenarios listed in > >> >> > >> >> > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > >> >> > >> >> > >> >>> > >> >>> On Fri, Sep 3, 2010 at 9:29 AM, Charitha Kankanamge > >> >>> > >> >>> wrote: > >> > >> Ok then. Thilini, lets try to find possibilities of automating JMS > >> scenarios first. You may write a script (shell/ruby/ant or python) > to > >> configure the pre-requisites such as copying activemq libs to ESB > and > >> starting ActiveMQ server. Then, the rest can be done by usual Junit > >> test > >> cases. > >> > >> Regards > >> Charitha > >> > >> > >> On Fri, Sep 3, 2010 at 5:38 AM, Samisa Abeysinghe > > >> wrote: > >> > > >> > Folks, IMHO, it is too early to worry about exact coverage. A ball > >> > park figure would be sufficient for the moment. > >> > This is bevuase we have better things to do like adding other > >> > transports and the like. I would rather spend our time and effort > on > >> > this as of now. > >> > > >> > I agree that we will need to have Emma in the picture at some > point, > >> > because some clients might ask for it etc. But later please... > >> > > >> > On Thursday, September 2, 2010, Charitha Kankanamge > >> > > >> > wrote: > >> > > > >> > > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva < > cham...@wso2.com> > >> > > wrote: > >> > > > >> > > For Smoke test perspective, we believe that the framework covers > >> > > 80% > >> > > of the functionality. In order to get the exact test coverage > >> > > figure, > >> > > we may run Emma or clover in due course. > >> > > > >> > > Thilini, > >> > > Can you please instrument ESB with Emma and try to find the % > >> > > coverage? > >> > > > >> > > Regards > >> > > Charitha > >> > > > >> > > > >> > > > >> > > Regards > >> > > Chamara > >> > > > >> > > > >> > > > >> > > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe > >> > > > >> > > wrote: > >> > >> Good! How much in terms of % does this cover as of now? > >> > >> > >> > >> On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri > >> > >> > >> > >> wrote: > >> > >>> > >> > >>> Hi, > >> > >>> > >> > >>> We used the framework to smoke test the Alpha3 build and were > >> > >>> able > >> > >>> to find > >> > >>> a few issues of samples through this. The framework works well > >> > >>> on > >> > >>> Windows as > >> > >>> well. > >> > >>> > >> > >>> Regards, > >> > >>> Evanthika > >> > >>> > >> > >>> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva > >> > >>> > >> > >>> wrote: > >> > > >> > ESB test automation framework covered following test areas > >> > right > >> > now. > >> > > >> > 1. ESB Samples > >> > 2. Functional test - please
Re: [Carbon-dev] ESB Test automation status
In addition to the esb sample automation,we are covering test scenarios mention in the ESB test case document in https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios.specially mediator test scenarios. WYT ? thanks, chamara On Thu, Sep 9, 2010 at 2:10 PM, Samisa Abeysinghe wrote: > > > On Thu, Sep 9, 2010 at 9:59 AM, Chamara Silva wrote: >> >> As thilini explained we are in the final stage of esb automation.we >> can start greg or other product automation from Monday. > > What are the scenarios covered beyond samples? > >> >> thanks, >> chamara >> >> On Thu, Sep 9, 2010 at 7:34 AM, Thilini Ishaka wrote: >> > >> > >> > Yes. We have started covering remaining test scenarios. >> > Also the remaining sample tests like JMS, VFS, Mail have been automated. >> > Will have a small test run tomorrow. >> > >> > thanks >> > >> > regards >> > Thilini >> > >> > >> > On Wed, Sep 8, 2010 at 10:17 PM, Charitha Kankanamge >> > wrote: >> >> >> >> >> >> On Wed, Sep 8, 2010 at 8:08 PM, Samisa Abeysinghe >> >> wrote: >> >>> >> >>> Have we started covering the test scenarios that we discussed beyond >> >>> samples to cover the feature list? >> >> >> >> Yes. It has been started. Chamara, please chime in. >> >> >> >>> We need to turn to other product automation, like G-Reg soon! So I am >> >>> keen to close the chapter on ESB ASAP! >> >> >> >> Yes. We should. Chamara/Thilini, we need to accelerate this effort and >> >> complete the remaining scenarios listed in >> >> >> >> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >> >> >> >> >> >>> >> >>> On Fri, Sep 3, 2010 at 9:29 AM, Charitha Kankanamge >> >>> >> >>> wrote: >> >> Ok then. Thilini, lets try to find possibilities of automating JMS >> scenarios first. You may write a script (shell/ruby/ant or python) to >> configure the pre-requisites such as copying activemq libs to ESB and >> starting ActiveMQ server. Then, the rest can be done by usual Junit >> test >> cases. >> >> Regards >> Charitha >> >> >> On Fri, Sep 3, 2010 at 5:38 AM, Samisa Abeysinghe >> wrote: >> > >> > Folks, IMHO, it is too early to worry about exact coverage. A ball >> > park figure would be sufficient for the moment. >> > This is bevuase we have better things to do like adding other >> > transports and the like. I would rather spend our time and effort on >> > this as of now. >> > >> > I agree that we will need to have Emma in the picture at some point, >> > because some clients might ask for it etc. But later please... >> > >> > On Thursday, September 2, 2010, Charitha Kankanamge >> > >> > wrote: >> > > >> > > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva >> > > wrote: >> > > >> > > For Smoke test perspective, we believe that the framework covers >> > > 80% >> > > of the functionality. In order to get the exact test coverage >> > > figure, >> > > we may run Emma or clover in due course. >> > > >> > > Thilini, >> > > Can you please instrument ESB with Emma and try to find the % >> > > coverage? >> > > >> > > Regards >> > > Charitha >> > > >> > > >> > > >> > > Regards >> > > Chamara >> > > >> > > >> > > >> > > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe >> > > >> > > wrote: >> > >> Good! How much in terms of % does this cover as of now? >> > >> >> > >> On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri >> > >> >> > >> wrote: >> > >>> >> > >>> Hi, >> > >>> >> > >>> We used the framework to smoke test the Alpha3 build and were >> > >>> able >> > >>> to find >> > >>> a few issues of samples through this. The framework works well >> > >>> on >> > >>> Windows as >> > >>> well. >> > >>> >> > >>> Regards, >> > >>> Evanthika >> > >>> >> > >>> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva >> > >>> >> > >>> wrote: >> > >> > ESB test automation framework covered following test areas >> > right >> > now. >> > >> > 1. ESB Samples >> > 2. Functional test - please find the automated test cases from >> > [ >> > >> > >> > >> > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >> > ] >> > >> > thanks, >> > Chamara >> > -- >> > Suminda Chamara Silva >> > Senior Software Engineer - QA >> > WSO2 Inc. >> > Mobile: +94 718 302858 >> > blog: http://chamaras.blogspot.com >> > >> > ___ >> > Carbon-dev mailing list >> > Carbon-dev@wso2.org >> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> > >>> >> > >>> >> >
Re: [Carbon-dev] ESB Test automation status
On Thu, Sep 9, 2010 at 9:59 AM, Chamara Silva wrote: > As thilini explained we are in the final stage of esb automation.we > can start greg or other product automation from Monday. > What are the scenarios covered beyond samples? > > thanks, > chamara > > On Thu, Sep 9, 2010 at 7:34 AM, Thilini Ishaka wrote: > > > > > > Yes. We have started covering remaining test scenarios. > > Also the remaining sample tests like JMS, VFS, Mail have been automated. > > Will have a small test run tomorrow. > > > > thanks > > > > regards > > Thilini > > > > > > On Wed, Sep 8, 2010 at 10:17 PM, Charitha Kankanamge > > wrote: > >> > >> > >> On Wed, Sep 8, 2010 at 8:08 PM, Samisa Abeysinghe > wrote: > >>> > >>> Have we started covering the test scenarios that we discussed beyond > >>> samples to cover the feature list? > >> > >> Yes. It has been started. Chamara, please chime in. > >> > >>> We need to turn to other product automation, like G-Reg soon! So I am > >>> keen to close the chapter on ESB ASAP! > >> > >> Yes. We should. Chamara/Thilini, we need to accelerate this effort and > >> complete the remaining scenarios listed in > >> > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > >> > >> > >>> > >>> On Fri, Sep 3, 2010 at 9:29 AM, Charitha Kankanamge > > >>> wrote: > > Ok then. Thilini, lets try to find possibilities of automating JMS > scenarios first. You may write a script (shell/ruby/ant or python) to > configure the pre-requisites such as copying activemq libs to ESB and > starting ActiveMQ server. Then, the rest can be done by usual Junit > test > cases. > > Regards > Charitha > > > On Fri, Sep 3, 2010 at 5:38 AM, Samisa Abeysinghe > wrote: > > > > Folks, IMHO, it is too early to worry about exact coverage. A ball > > park figure would be sufficient for the moment. > > This is bevuase we have better things to do like adding other > > transports and the like. I would rather spend our time and effort on > > this as of now. > > > > I agree that we will need to have Emma in the picture at some point, > > because some clients might ask for it etc. But later please... > > > > On Thursday, September 2, 2010, Charitha Kankanamge < > chari...@wso2.com> > > wrote: > > > > > > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva > > > wrote: > > > > > > For Smoke test perspective, we believe that the framework covers > 80% > > > of the functionality. In order to get the exact test coverage > figure, > > > we may run Emma or clover in due course. > > > > > > Thilini, > > > Can you please instrument ESB with Emma and try to find the % > > > coverage? > > > > > > Regards > > > Charitha > > > > > > > > > > > > Regards > > > Chamara > > > > > > > > > > > > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe < > sam...@wso2.com> > > > wrote: > > >> Good! How much in terms of % does this cover as of now? > > >> > > >> On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri > > >> > > >> wrote: > > >>> > > >>> Hi, > > >>> > > >>> We used the framework to smoke test the Alpha3 build and were > able > > >>> to find > > >>> a few issues of samples through this. The framework works well on > > >>> Windows as > > >>> well. > > >>> > > >>> Regards, > > >>> Evanthika > > >>> > > >>> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva < > cham...@wso2.com> > > >>> wrote: > > > > ESB test automation framework covered following test areas right > > now. > > > > 1. ESB Samples > > 2. Functional test - please find the automated test cases from [ > > > > > > > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > > ] > > > > thanks, > > Chamara > > -- > > Suminda Chamara Silva > > Senior Software Engineer - QA > > WSO2 Inc. > > Mobile: +94 718 302858 > > blog: http://chamaras.blogspot.com > > > > ___ > > Carbon-dev mailing list > > Carbon-dev@wso2.org > > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > >>> > > >>> > > >>> ___ > > >>> Carbon-dev mailing list > > >>> Carbon-dev@wso2.org > > >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > >>> > > >> Thanks, > > >> Samisa... > > >> > > >> Samisa Abeysinghe > > >> VP Engineering > > >> WSO2 Inc. > > >> http://wso2.com > > >> http://wso2.org > > >> > > >> > > >> > > >> ___ > > >> Carbon-dev mailing list > > >> Ca
Re: [Carbon-dev] ESB Test automation status
Currently we are covering missing but high priority scenarios. We can finish ESB automation by this week and start other product as Chamara mentioned. thanks Thilini On Thu, Sep 9, 2010 at 9:59 AM, Chamara Silva wrote: > As thilini explained we are in the final stage of esb automation.we > can start greg or other product automation from Monday. > > thanks, > chamara > > On Thu, Sep 9, 2010 at 7:34 AM, Thilini Ishaka wrote: > > > > > > Yes. We have started covering remaining test scenarios. > > Also the remaining sample tests like JMS, VFS, Mail have been automated. > > Will have a small test run tomorrow. > > > > thanks > > > > regards > > Thilini > > > > > > On Wed, Sep 8, 2010 at 10:17 PM, Charitha Kankanamge > > wrote: > >> > >> > >> On Wed, Sep 8, 2010 at 8:08 PM, Samisa Abeysinghe > wrote: > >>> > >>> Have we started covering the test scenarios that we discussed beyond > >>> samples to cover the feature list? > >> > >> Yes. It has been started. Chamara, please chime in. > >> > >>> We need to turn to other product automation, like G-Reg soon! So I am > >>> keen to close the chapter on ESB ASAP! > >> > >> Yes. We should. Chamara/Thilini, we need to accelerate this effort and > >> complete the remaining scenarios listed in > >> > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > >> > >> > >>> > >>> On Fri, Sep 3, 2010 at 9:29 AM, Charitha Kankanamge > > >>> wrote: > > Ok then. Thilini, lets try to find possibilities of automating JMS > scenarios first. You may write a script (shell/ruby/ant or python) to > configure the pre-requisites such as copying activemq libs to ESB and > starting ActiveMQ server. Then, the rest can be done by usual Junit > test > cases. > > Regards > Charitha > > > On Fri, Sep 3, 2010 at 5:38 AM, Samisa Abeysinghe > wrote: > > > > Folks, IMHO, it is too early to worry about exact coverage. A ball > > park figure would be sufficient for the moment. > > This is bevuase we have better things to do like adding other > > transports and the like. I would rather spend our time and effort on > > this as of now. > > > > I agree that we will need to have Emma in the picture at some point, > > because some clients might ask for it etc. But later please... > > > > On Thursday, September 2, 2010, Charitha Kankanamge < > chari...@wso2.com> > > wrote: > > > > > > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva > > > wrote: > > > > > > For Smoke test perspective, we believe that the framework covers > 80% > > > of the functionality. In order to get the exact test coverage > figure, > > > we may run Emma or clover in due course. > > > > > > Thilini, > > > Can you please instrument ESB with Emma and try to find the % > > > coverage? > > > > > > Regards > > > Charitha > > > > > > > > > > > > Regards > > > Chamara > > > > > > > > > > > > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe < > sam...@wso2.com> > > > wrote: > > >> Good! How much in terms of % does this cover as of now? > > >> > > >> On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri > > >> > > >> wrote: > > >>> > > >>> Hi, > > >>> > > >>> We used the framework to smoke test the Alpha3 build and were > able > > >>> to find > > >>> a few issues of samples through this. The framework works well on > > >>> Windows as > > >>> well. > > >>> > > >>> Regards, > > >>> Evanthika > > >>> > > >>> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva < > cham...@wso2.com> > > >>> wrote: > > > > ESB test automation framework covered following test areas right > > now. > > > > 1. ESB Samples > > 2. Functional test - please find the automated test cases from [ > > > > > > > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > > ] > > > > thanks, > > Chamara > > -- > > Suminda Chamara Silva > > Senior Software Engineer - QA > > WSO2 Inc. > > Mobile: +94 718 302858 > > blog: http://chamaras.blogspot.com > > > > ___ > > Carbon-dev mailing list > > Carbon-dev@wso2.org > > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > >>> > > >>> > > >>> ___ > > >>> Carbon-dev mailing list > > >>> Carbon-dev@wso2.org > > >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > >>> > > >> Thanks, > > >> Samisa... > > >> > > >> Samisa Abeysinghe > > >> VP Engineering > > >> WSO2 Inc. > > >> http://wso2.com > > >> http://wso2.org > > >> > > >>
Re: [Carbon-dev] ESB Test automation status
As thilini explained we are in the final stage of esb automation.we can start greg or other product automation from Monday. thanks, chamara On Thu, Sep 9, 2010 at 7:34 AM, Thilini Ishaka wrote: > > > Yes. We have started covering remaining test scenarios. > Also the remaining sample tests like JMS, VFS, Mail have been automated. > Will have a small test run tomorrow. > > thanks > > regards > Thilini > > > On Wed, Sep 8, 2010 at 10:17 PM, Charitha Kankanamge > wrote: >> >> >> On Wed, Sep 8, 2010 at 8:08 PM, Samisa Abeysinghe wrote: >>> >>> Have we started covering the test scenarios that we discussed beyond >>> samples to cover the feature list? >> >> Yes. It has been started. Chamara, please chime in. >> >>> We need to turn to other product automation, like G-Reg soon! So I am >>> keen to close the chapter on ESB ASAP! >> >> Yes. We should. Chamara/Thilini, we need to accelerate this effort and >> complete the remaining scenarios listed in >> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >> >> >>> >>> On Fri, Sep 3, 2010 at 9:29 AM, Charitha Kankanamge >>> wrote: Ok then. Thilini, lets try to find possibilities of automating JMS scenarios first. You may write a script (shell/ruby/ant or python) to configure the pre-requisites such as copying activemq libs to ESB and starting ActiveMQ server. Then, the rest can be done by usual Junit test cases. Regards Charitha On Fri, Sep 3, 2010 at 5:38 AM, Samisa Abeysinghe wrote: > > Folks, IMHO, it is too early to worry about exact coverage. A ball > park figure would be sufficient for the moment. > This is bevuase we have better things to do like adding other > transports and the like. I would rather spend our time and effort on > this as of now. > > I agree that we will need to have Emma in the picture at some point, > because some clients might ask for it etc. But later please... > > On Thursday, September 2, 2010, Charitha Kankanamge > wrote: > > > > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva > > wrote: > > > > For Smoke test perspective, we believe that the framework covers 80% > > of the functionality. In order to get the exact test coverage figure, > > we may run Emma or clover in due course. > > > > Thilini, > > Can you please instrument ESB with Emma and try to find the % > > coverage? > > > > Regards > > Charitha > > > > > > > > Regards > > Chamara > > > > > > > > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe > > wrote: > >> Good! How much in terms of % does this cover as of now? > >> > >> On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri > >> > >> wrote: > >>> > >>> Hi, > >>> > >>> We used the framework to smoke test the Alpha3 build and were able > >>> to find > >>> a few issues of samples through this. The framework works well on > >>> Windows as > >>> well. > >>> > >>> Regards, > >>> Evanthika > >>> > >>> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva > >>> wrote: > > ESB test automation framework covered following test areas right > now. > > 1. ESB Samples > 2. Functional test - please find the automated test cases from [ > > > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > ] > > thanks, > Chamara > -- > Suminda Chamara Silva > Senior Software Engineer - QA > WSO2 Inc. > Mobile: +94 718 302858 > blog: http://chamaras.blogspot.com > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > >>> > >>> > >>> ___ > >>> Carbon-dev mailing list > >>> Carbon-dev@wso2.org > >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > >>> > >> Thanks, > >> Samisa... > >> > >> Samisa Abeysinghe > >> VP Engineering > >> WSO2 Inc. > >> http://wso2.com > >> http://wso2.org > >> > >> > >> > >> ___ > >> Carbon-dev mailing list > >> Carbon-dev@wso2.org > >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > >> > >> > > > > > > > > -- > > Suminda Chamara Silva > > Senior Software Engineer - QA > > WSO2 Inc. > > Mobile: +94 718 302858 > > blog: http://chamaras.blogspot.com > > > > ___ > > Carbon-dev mailing list > > Carbon-dev@wso2.org > > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
Re: [Carbon-dev] ESB Test automation status
Yes. We have started covering remaining test scenarios. Also the remaining sample tests like JMS, VFS, Mail have been automated. Will have a small test run tomorrow. thanks regards Thilini On Wed, Sep 8, 2010 at 10:17 PM, Charitha Kankanamge wrote: > > > On Wed, Sep 8, 2010 at 8:08 PM, Samisa Abeysinghe wrote: > >> Have we started covering the test scenarios that we discussed beyond >> samples to cover the feature list? > > > Yes. It has been started. Chamara, please chime in. > > We need to turn to other product automation, like G-Reg soon! So I am keen >> to close the chapter on ESB ASAP! >> > > Yes. We should. Chamara/Thilini, we need to accelerate this effort and > complete the remaining scenarios listed in > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > > > >> On Fri, Sep 3, 2010 at 9:29 AM, Charitha Kankanamge wrote: >> >>> >>> Ok then. Thilini, lets try to find possibilities of automating JMS >>> scenarios first. You may write a script (shell/ruby/ant or python) to >>> configure the pre-requisites such as copying activemq libs to ESB and >>> starting ActiveMQ server. Then, the rest can be done by usual Junit test >>> cases. >>> >>> Regards >>> Charitha >>> >>> >>> >>> On Fri, Sep 3, 2010 at 5:38 AM, Samisa Abeysinghe wrote: >>> Folks, IMHO, it is too early to worry about exact coverage. A ball park figure would be sufficient for the moment. This is bevuase we have better things to do like adding other transports and the like. I would rather spend our time and effort on this as of now. I agree that we will need to have Emma in the picture at some point, because some clients might ask for it etc. But later please... On Thursday, September 2, 2010, Charitha Kankanamge wrote: > > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva wrote: > > For Smoke test perspective, we believe that the framework covers 80% > of the functionality. In order to get the exact test coverage figure, > we may run Emma or clover in due course. > > Thilini, > Can you please instrument ESB with Emma and try to find the % coverage? > > Regards > Charitha > > > > Regards > Chamara > > > > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe wrote: >> Good! How much in terms of % does this cover as of now? >> >> On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri < evanth...@wso2.com> >> wrote: >>> >>> Hi, >>> >>> We used the framework to smoke test the Alpha3 build and were able to find >>> a few issues of samples through this. The framework works well on Windows as >>> well. >>> >>> Regards, >>> Evanthika >>> >>> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva wrote: ESB test automation framework covered following test areas right now. 1. ESB Samples 2. Functional test - please find the automated test cases from [ https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios ] thanks, Chamara -- Suminda Chamara Silva Senior Software Engineer - QA WSO2 Inc. Mobile: +94 718 302858 blog: http://chamaras.blogspot.com ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >>> >>> ___ >>> Carbon-dev mailing list >>> Carbon-dev@wso2.org >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >> Thanks, >> Samisa... >> >> Samisa Abeysinghe >> VP Engineering >> WSO2 Inc. >> http://wso2.com >> http://wso2.org >> >> >> >> ___ >> Carbon-dev mailing list >> Carbon-dev@wso2.org >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> >> > > > > -- > Suminda Chamara Silva > Senior Software Engineer - QA > WSO2 Inc. > Mobile: +94 718 302858 > blog: http://chamaras.blogspot.com > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >>> >>> ___ >>> Carbon-dev mailing list >>> Carbon-dev@wso2.org >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >>> Thanks, >>
Re: [Carbon-dev] ESB Test automation status
On Wed, Sep 8, 2010 at 8:08 PM, Samisa Abeysinghe wrote: > Have we started covering the test scenarios that we discussed beyond > samples to cover the feature list? Yes. It has been started. Chamara, please chime in. We need to turn to other product automation, like G-Reg soon! So I am keen > to close the chapter on ESB ASAP! > Yes. We should. Chamara/Thilini, we need to accelerate this effort and complete the remaining scenarios listed in https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > On Fri, Sep 3, 2010 at 9:29 AM, Charitha Kankanamge wrote: > >> >> Ok then. Thilini, lets try to find possibilities of automating JMS >> scenarios first. You may write a script (shell/ruby/ant or python) to >> configure the pre-requisites such as copying activemq libs to ESB and >> starting ActiveMQ server. Then, the rest can be done by usual Junit test >> cases. >> >> Regards >> Charitha >> >> >> >> On Fri, Sep 3, 2010 at 5:38 AM, Samisa Abeysinghe wrote: >> >>> Folks, IMHO, it is too early to worry about exact coverage. A ball >>> park figure would be sufficient for the moment. >>> This is bevuase we have better things to do like adding other >>> transports and the like. I would rather spend our time and effort on >>> this as of now. >>> >>> I agree that we will need to have Emma in the picture at some point, >>> because some clients might ask for it etc. But later please... >>> >>> On Thursday, September 2, 2010, Charitha Kankanamge >>> wrote: >>> > >>> > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva >>> wrote: >>> > >>> > For Smoke test perspective, we believe that the framework covers 80% >>> > of the functionality. In order to get the exact test coverage figure, >>> > we may run Emma or clover in due course. >>> > >>> > Thilini, >>> > Can you please instrument ESB with Emma and try to find the % coverage? >>> > >>> > Regards >>> > Charitha >>> > >>> > >>> > >>> > Regards >>> > Chamara >>> > >>> > >>> > >>> > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe >>> wrote: >>> >> Good! How much in terms of % does this cover as of now? >>> >> >>> >> On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri < >>> evanth...@wso2.com> >>> >> wrote: >>> >>> >>> >>> Hi, >>> >>> >>> >>> We used the framework to smoke test the Alpha3 build and were able to >>> find >>> >>> a few issues of samples through this. The framework works well on >>> Windows as >>> >>> well. >>> >>> >>> >>> Regards, >>> >>> Evanthika >>> >>> >>> >>> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva >>> wrote: >>> >>> ESB test automation framework covered following test areas right >>> now. >>> >>> 1. ESB Samples >>> 2. Functional test - please find the automated test cases from [ >>> >>> >>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>> ] >>> >>> thanks, >>> Chamara >>> -- >>> Suminda Chamara Silva >>> Senior Software Engineer - QA >>> WSO2 Inc. >>> Mobile: +94 718 302858 >>> blog: http://chamaras.blogspot.com >>> >>> ___ >>> Carbon-dev mailing list >>> Carbon-dev@wso2.org >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >>> >>> >>> >>> >>> ___ >>> >>> Carbon-dev mailing list >>> >>> Carbon-dev@wso2.org >>> >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >>> >>> >> Thanks, >>> >> Samisa... >>> >> >>> >> Samisa Abeysinghe >>> >> VP Engineering >>> >> WSO2 Inc. >>> >> http://wso2.com >>> >> http://wso2.org >>> >> >>> >> >>> >> >>> >> ___ >>> >> Carbon-dev mailing list >>> >> Carbon-dev@wso2.org >>> >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >> >>> >> >>> > >>> > >>> > >>> > -- >>> > Suminda Chamara Silva >>> > Senior Software Engineer - QA >>> > WSO2 Inc. >>> > Mobile: +94 718 302858 >>> > blog: http://chamaras.blogspot.com >>> > >>> > ___ >>> > Carbon-dev mailing list >>> > Carbon-dev@wso2.org >>> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> > >>> > >>> >>> ___ >>> Carbon-dev mailing list >>> Carbon-dev@wso2.org >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >> >> >> ___ >> Carbon-dev mailing list >> Carbon-dev@wso2.org >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> >> Thanks, > Samisa... > > Samisa Abeysinghe > VP Engineering > WSO2 Inc. > http://wso2.com > http://wso2.org > > > > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
Re: [Carbon-dev] ESB Test automation status
Have we started covering the test scenarios that we discussed beyond samples to cover the feature list? We need to turn to other product automation, like G-Reg soon! So I am keen to close the chapter on ESB ASAP! On Fri, Sep 3, 2010 at 9:29 AM, Charitha Kankanamge wrote: > > Ok then. Thilini, lets try to find possibilities of automating JMS > scenarios first. You may write a script (shell/ruby/ant or python) to > configure the pre-requisites such as copying activemq libs to ESB and > starting ActiveMQ server. Then, the rest can be done by usual Junit test > cases. > > Regards > Charitha > > > > On Fri, Sep 3, 2010 at 5:38 AM, Samisa Abeysinghe wrote: > >> Folks, IMHO, it is too early to worry about exact coverage. A ball >> park figure would be sufficient for the moment. >> This is bevuase we have better things to do like adding other >> transports and the like. I would rather spend our time and effort on >> this as of now. >> >> I agree that we will need to have Emma in the picture at some point, >> because some clients might ask for it etc. But later please... >> >> On Thursday, September 2, 2010, Charitha Kankanamge >> wrote: >> > >> > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva >> wrote: >> > >> > For Smoke test perspective, we believe that the framework covers 80% >> > of the functionality. In order to get the exact test coverage figure, >> > we may run Emma or clover in due course. >> > >> > Thilini, >> > Can you please instrument ESB with Emma and try to find the % coverage? >> > >> > Regards >> > Charitha >> > >> > >> > >> > Regards >> > Chamara >> > >> > >> > >> > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe >> wrote: >> >> Good! How much in terms of % does this cover as of now? >> >> >> >> On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri < >> evanth...@wso2.com> >> >> wrote: >> >>> >> >>> Hi, >> >>> >> >>> We used the framework to smoke test the Alpha3 build and were able to >> find >> >>> a few issues of samples through this. The framework works well on >> Windows as >> >>> well. >> >>> >> >>> Regards, >> >>> Evanthika >> >>> >> >>> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva >> wrote: >> >> ESB test automation framework covered following test areas right now. >> >> 1. ESB Samples >> 2. Functional test - please find the automated test cases from [ >> >> >> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >> ] >> >> thanks, >> Chamara >> -- >> Suminda Chamara Silva >> Senior Software Engineer - QA >> WSO2 Inc. >> Mobile: +94 718 302858 >> blog: http://chamaras.blogspot.com >> >> ___ >> Carbon-dev mailing list >> Carbon-dev@wso2.org >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> >>> >> >>> >> >>> ___ >> >>> Carbon-dev mailing list >> >>> Carbon-dev@wso2.org >> >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> >>> >> >> Thanks, >> >> Samisa... >> >> >> >> Samisa Abeysinghe >> >> VP Engineering >> >> WSO2 Inc. >> >> http://wso2.com >> >> http://wso2.org >> >> >> >> >> >> >> >> ___ >> >> Carbon-dev mailing list >> >> Carbon-dev@wso2.org >> >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> >> >> >> >> > >> > >> > >> > -- >> > Suminda Chamara Silva >> > Senior Software Engineer - QA >> > WSO2 Inc. >> > Mobile: +94 718 302858 >> > blog: http://chamaras.blogspot.com >> > >> > ___ >> > Carbon-dev mailing list >> > Carbon-dev@wso2.org >> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> > >> > >> >> ___ >> Carbon-dev mailing list >> Carbon-dev@wso2.org >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> > > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > Thanks, Samisa... Samisa Abeysinghe VP Engineering WSO2 Inc. http://wso2.com http://wso2.org ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
Re: [Carbon-dev] ESB Test automation status
Ok then. Thilini, lets try to find possibilities of automating JMS scenarios first. You may write a script (shell/ruby/ant or python) to configure the pre-requisites such as copying activemq libs to ESB and starting ActiveMQ server. Then, the rest can be done by usual Junit test cases. Regards Charitha On Fri, Sep 3, 2010 at 5:38 AM, Samisa Abeysinghe wrote: > Folks, IMHO, it is too early to worry about exact coverage. A ball > park figure would be sufficient for the moment. > This is bevuase we have better things to do like adding other > transports and the like. I would rather spend our time and effort on > this as of now. > > I agree that we will need to have Emma in the picture at some point, > because some clients might ask for it etc. But later please... > > On Thursday, September 2, 2010, Charitha Kankanamge > wrote: > > > > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva > wrote: > > > > For Smoke test perspective, we believe that the framework covers 80% > > of the functionality. In order to get the exact test coverage figure, > > we may run Emma or clover in due course. > > > > Thilini, > > Can you please instrument ESB with Emma and try to find the % coverage? > > > > Regards > > Charitha > > > > > > > > Regards > > Chamara > > > > > > > > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe > wrote: > >> Good! How much in terms of % does this cover as of now? > >> > >> On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri < > evanth...@wso2.com> > >> wrote: > >>> > >>> Hi, > >>> > >>> We used the framework to smoke test the Alpha3 build and were able to > find > >>> a few issues of samples through this. The framework works well on > Windows as > >>> well. > >>> > >>> Regards, > >>> Evanthika > >>> > >>> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva > wrote: > > ESB test automation framework covered following test areas right now. > > 1. ESB Samples > 2. Functional test - please find the automated test cases from [ > > > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > ] > > thanks, > Chamara > -- > Suminda Chamara Silva > Senior Software Engineer - QA > WSO2 Inc. > Mobile: +94 718 302858 > blog: http://chamaras.blogspot.com > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > >>> > >>> > >>> ___ > >>> Carbon-dev mailing list > >>> Carbon-dev@wso2.org > >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > >>> > >> Thanks, > >> Samisa... > >> > >> Samisa Abeysinghe > >> VP Engineering > >> WSO2 Inc. > >> http://wso2.com > >> http://wso2.org > >> > >> > >> > >> ___ > >> Carbon-dev mailing list > >> Carbon-dev@wso2.org > >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > >> > >> > > > > > > > > -- > > Suminda Chamara Silva > > Senior Software Engineer - QA > > WSO2 Inc. > > Mobile: +94 718 302858 > > blog: http://chamaras.blogspot.com > > > > ___ > > Carbon-dev mailing list > > Carbon-dev@wso2.org > > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > > > > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
Re: [Carbon-dev] ESB Test automation status
Folks, IMHO, it is too early to worry about exact coverage. A ball park figure would be sufficient for the moment. This is bevuase we have better things to do like adding other transports and the like. I would rather spend our time and effort on this as of now. I agree that we will need to have Emma in the picture at some point, because some clients might ask for it etc. But later please... On Thursday, September 2, 2010, Charitha Kankanamge wrote: > > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva wrote: > > For Smoke test perspective, we believe that the framework covers 80% > of the functionality. In order to get the exact test coverage figure, > we may run Emma or clover in due course. > > Thilini, > Can you please instrument ESB with Emma and try to find the % coverage? > > Regards > Charitha > > > > Regards > Chamara > > > > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe wrote: >> Good! How much in terms of % does this cover as of now? >> >> On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri >> wrote: >>> >>> Hi, >>> >>> We used the framework to smoke test the Alpha3 build and were able to find >>> a few issues of samples through this. The framework works well on Windows as >>> well. >>> >>> Regards, >>> Evanthika >>> >>> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva wrote: ESB test automation framework covered following test areas right now. 1. ESB Samples 2. Functional test - please find the automated test cases from [ https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios ] thanks, Chamara -- Suminda Chamara Silva Senior Software Engineer - QA WSO2 Inc. Mobile: +94 718 302858 blog: http://chamaras.blogspot.com ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >>> >>> ___ >>> Carbon-dev mailing list >>> Carbon-dev@wso2.org >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >>> >> Thanks, >> Samisa... >> >> Samisa Abeysinghe >> VP Engineering >> WSO2 Inc. >> http://wso2.com >> http://wso2.org >> >> >> >> ___ >> Carbon-dev mailing list >> Carbon-dev@wso2.org >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> >> > > > > -- > Suminda Chamara Silva > Senior Software Engineer - QA > WSO2 Inc. > Mobile: +94 718 302858 > blog: http://chamaras.blogspot.com > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
Re: [Carbon-dev] ESB Test automation status
Ok Charitha. I will work on it. Thanks regards, -- Thilini Ishaka On Thu, Sep 2, 2010 at 5:41 PM, Charitha Kankanamge wrote: > > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva wrote: > >> For Smoke test perspective, we believe that the framework covers 80% >> of the functionality. In order to get the exact test coverage figure, >> we may run Emma or clover in due course. >> > > Thilini, > Can you please instrument ESB with Emma and try to find the % coverage? > > Regards > Charitha > > >> >> Regards >> Chamara >> >> >> >> On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe >> wrote: >> > Good! How much in terms of % does this cover as of now? >> > >> > On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri < >> evanth...@wso2.com> >> > wrote: >> >> >> >> Hi, >> >> >> >> We used the framework to smoke test the Alpha3 build and were able to >> find >> >> a few issues of samples through this. The framework works well on >> Windows as >> >> well. >> >> >> >> Regards, >> >> Evanthika >> >> >> >> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva >> wrote: >> >>> >> >>> ESB test automation framework covered following test areas right now. >> >>> >> >>> 1. ESB Samples >> >>> 2. Functional test - please find the automated test cases from [ >> >>> >> >>> >> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >> >>> ] >> >>> >> >>> thanks, >> >>> Chamara >> >>> -- >> >>> Suminda Chamara Silva >> >>> Senior Software Engineer - QA >> >>> WSO2 Inc. >> >>> Mobile: +94 718 302858 >> >>> blog: http://chamaras.blogspot.com >> >>> >> >>> ___ >> >>> Carbon-dev mailing list >> >>> Carbon-dev@wso2.org >> >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> >> >> >> >> >> ___ >> >> Carbon-dev mailing list >> >> Carbon-dev@wso2.org >> >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> >> >> > Thanks, >> > Samisa... >> > >> > Samisa Abeysinghe >> > VP Engineering >> > WSO2 Inc. >> > http://wso2.com >> > http://wso2.org >> > >> > >> > >> > ___ >> > Carbon-dev mailing list >> > Carbon-dev@wso2.org >> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> > >> > >> >> >> >> -- >> Suminda Chamara Silva >> Senior Software Engineer - QA >> WSO2 Inc. >> Mobile: +94 718 302858 >> blog: http://chamaras.blogspot.com >> >> ___ >> Carbon-dev mailing list >> Carbon-dev@wso2.org >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> > > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
Re: [Carbon-dev] ESB Test automation status
On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva wrote: > For Smoke test perspective, we believe that the framework covers 80% > of the functionality. In order to get the exact test coverage figure, > we may run Emma or clover in due course. > Thilini, Can you please instrument ESB with Emma and try to find the % coverage? Regards Charitha > > Regards > Chamara > > > > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe > wrote: > > Good! How much in terms of % does this cover as of now? > > > > On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri < > evanth...@wso2.com> > > wrote: > >> > >> Hi, > >> > >> We used the framework to smoke test the Alpha3 build and were able to > find > >> a few issues of samples through this. The framework works well on > Windows as > >> well. > >> > >> Regards, > >> Evanthika > >> > >> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva > wrote: > >>> > >>> ESB test automation framework covered following test areas right now. > >>> > >>> 1. ESB Samples > >>> 2. Functional test - please find the automated test cases from [ > >>> > >>> > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > >>> ] > >>> > >>> thanks, > >>> Chamara > >>> -- > >>> Suminda Chamara Silva > >>> Senior Software Engineer - QA > >>> WSO2 Inc. > >>> Mobile: +94 718 302858 > >>> blog: http://chamaras.blogspot.com > >>> > >>> ___ > >>> Carbon-dev mailing list > >>> Carbon-dev@wso2.org > >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > >> > >> > >> ___ > >> Carbon-dev mailing list > >> Carbon-dev@wso2.org > >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > >> > > Thanks, > > Samisa... > > > > Samisa Abeysinghe > > VP Engineering > > WSO2 Inc. > > http://wso2.com > > http://wso2.org > > > > > > > > ___ > > Carbon-dev mailing list > > Carbon-dev@wso2.org > > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > > > > > > > -- > Suminda Chamara Silva > Senior Software Engineer - QA > WSO2 Inc. > Mobile: +94 718 302858 > blog: http://chamaras.blogspot.com > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
Re: [Carbon-dev] ESB Test automation status
On Tue, Aug 31, 2010 at 2:04 PM, Chamara Silva wrote: > As we decided initially, we cover ESB scenarios based on HTTP and > HTTPS transport using this test framework. We cannot (or not at the > moment) automate JMS, VFS, FIX, MAIL, FTP transports. We need to start looking into these transports now. > Also, load > balancing and failover scenarios have not been automated through this > test framework since it involves configuration of multiple ESB > instances and axis2 servers. > > Apart from the above, we try to achieve ~90% with completing the > remaining mediators (script, class, enqueue, enrich etc.. ) > > Regards > Chamara > > On Tue, Aug 31, 2010 at 1:36 PM, Samisa Abeysinghe > wrote: > > What would it take to get this to 100% for smoke testing? > > > > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva > wrote: > >> > >> For Smoke test perspective, we believe that the framework covers 80% > >> of the functionality. In order to get the exact test coverage figure, > >> we may run Emma or clover in due course. > >> > >> Regards > >> Chamara > >> > >> > >> > >> On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe > >> wrote: > >> > Good! How much in terms of % does this cover as of now? > >> > > >> > On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri > >> > > >> > wrote: > >> >> > >> >> Hi, > >> >> > >> >> We used the framework to smoke test the Alpha3 build and were able to > >> >> find > >> >> a few issues of samples through this. The framework works well on > >> >> Windows as > >> >> well. > >> >> > >> >> Regards, > >> >> Evanthika > >> >> > >> >> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva > >> >> wrote: > >> >>> > >> >>> ESB test automation framework covered following test areas right > now. > >> >>> > >> >>> 1. ESB Samples > >> >>> 2. Functional test - please find the automated test cases from [ > >> >>> > >> >>> > >> >>> > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > >> >>> ] > >> >>> > >> >>> thanks, > >> >>> Chamara > >> >>> -- > >> >>> Suminda Chamara Silva > >> >>> Senior Software Engineer - QA > >> >>> WSO2 Inc. > >> >>> Mobile: +94 718 302858 > >> >>> blog: http://chamaras.blogspot.com > >> >>> > >> >>> ___ > >> >>> Carbon-dev mailing list > >> >>> Carbon-dev@wso2.org > >> >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > >> >> > >> >> > >> >> ___ > >> >> Carbon-dev mailing list > >> >> Carbon-dev@wso2.org > >> >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > >> >> > >> > Thanks, > >> > Samisa... > >> > > >> > Samisa Abeysinghe > >> > VP Engineering > >> > WSO2 Inc. > >> > http://wso2.com > >> > http://wso2.org > >> > > >> > > >> > > >> > ___ > >> > Carbon-dev mailing list > >> > Carbon-dev@wso2.org > >> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > >> > > >> > > >> > >> > >> > >> -- > >> Suminda Chamara Silva > >> Senior Software Engineer - QA > >> WSO2 Inc. > >> Mobile: +94 718 302858 > >> blog: http://chamaras.blogspot.com > >> > >> ___ > >> Carbon-dev mailing list > >> Carbon-dev@wso2.org > >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > > > Thanks, > > Samisa... > > > > Samisa Abeysinghe > > VP Engineering > > WSO2 Inc. > > http://wso2.com > > http://wso2.org > > > > > > > > ___ > > Carbon-dev mailing list > > Carbon-dev@wso2.org > > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > > > > > > > -- > Suminda Chamara Silva > Senior Software Engineer - QA > WSO2 Inc. > Mobile: +94 718 302858 > blog: http://chamaras.blogspot.com > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > Thanks, Samisa... Samisa Abeysinghe VP Engineering WSO2 Inc. http://wso2.com http://wso2.org ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
Re: [Carbon-dev] ESB Test automation status
As we decided initially, we cover ESB scenarios based on HTTP and HTTPS transport using this test framework. We cannot (or not at the moment) automate JMS, VFS, FIX, MAIL, FTP transports. Also, load balancing and failover scenarios have not been automated through this test framework since it involves configuration of multiple ESB instances and axis2 servers. Apart from the above, we try to achieve ~90% with completing the remaining mediators (script, class, enqueue, enrich etc.. ) Regards Chamara On Tue, Aug 31, 2010 at 1:36 PM, Samisa Abeysinghe wrote: > What would it take to get this to 100% for smoke testing? > > On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva wrote: >> >> For Smoke test perspective, we believe that the framework covers 80% >> of the functionality. In order to get the exact test coverage figure, >> we may run Emma or clover in due course. >> >> Regards >> Chamara >> >> >> >> On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe >> wrote: >> > Good! How much in terms of % does this cover as of now? >> > >> > On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri >> > >> > wrote: >> >> >> >> Hi, >> >> >> >> We used the framework to smoke test the Alpha3 build and were able to >> >> find >> >> a few issues of samples through this. The framework works well on >> >> Windows as >> >> well. >> >> >> >> Regards, >> >> Evanthika >> >> >> >> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva >> >> wrote: >> >>> >> >>> ESB test automation framework covered following test areas right now. >> >>> >> >>> 1. ESB Samples >> >>> 2. Functional test - please find the automated test cases from [ >> >>> >> >>> >> >>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >> >>> ] >> >>> >> >>> thanks, >> >>> Chamara >> >>> -- >> >>> Suminda Chamara Silva >> >>> Senior Software Engineer - QA >> >>> WSO2 Inc. >> >>> Mobile: +94 718 302858 >> >>> blog: http://chamaras.blogspot.com >> >>> >> >>> ___ >> >>> Carbon-dev mailing list >> >>> Carbon-dev@wso2.org >> >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> >> >> >> >> >> ___ >> >> Carbon-dev mailing list >> >> Carbon-dev@wso2.org >> >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> >> >> > Thanks, >> > Samisa... >> > >> > Samisa Abeysinghe >> > VP Engineering >> > WSO2 Inc. >> > http://wso2.com >> > http://wso2.org >> > >> > >> > >> > ___ >> > Carbon-dev mailing list >> > Carbon-dev@wso2.org >> > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> > >> > >> >> >> >> -- >> Suminda Chamara Silva >> Senior Software Engineer - QA >> WSO2 Inc. >> Mobile: +94 718 302858 >> blog: http://chamaras.blogspot.com >> >> ___ >> Carbon-dev mailing list >> Carbon-dev@wso2.org >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > Thanks, > Samisa... > > Samisa Abeysinghe > VP Engineering > WSO2 Inc. > http://wso2.com > http://wso2.org > > > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > -- Suminda Chamara Silva Senior Software Engineer - QA WSO2 Inc. Mobile: +94 718 302858 blog: http://chamaras.blogspot.com ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
Re: [Carbon-dev] ESB Test automation status
What would it take to get this to 100% for smoke testing? On Tue, Aug 31, 2010 at 12:29 PM, Chamara Silva wrote: > For Smoke test perspective, we believe that the framework covers 80% > of the functionality. In order to get the exact test coverage figure, > we may run Emma or clover in due course. > > Regards > Chamara > > > > On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe > wrote: > > Good! How much in terms of % does this cover as of now? > > > > On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri < > evanth...@wso2.com> > > wrote: > >> > >> Hi, > >> > >> We used the framework to smoke test the Alpha3 build and were able to > find > >> a few issues of samples through this. The framework works well on > Windows as > >> well. > >> > >> Regards, > >> Evanthika > >> > >> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva > wrote: > >>> > >>> ESB test automation framework covered following test areas right now. > >>> > >>> 1. ESB Samples > >>> 2. Functional test - please find the automated test cases from [ > >>> > >>> > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > >>> ] > >>> > >>> thanks, > >>> Chamara > >>> -- > >>> Suminda Chamara Silva > >>> Senior Software Engineer - QA > >>> WSO2 Inc. > >>> Mobile: +94 718 302858 > >>> blog: http://chamaras.blogspot.com > >>> > >>> ___ > >>> Carbon-dev mailing list > >>> Carbon-dev@wso2.org > >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > >> > >> > >> ___ > >> Carbon-dev mailing list > >> Carbon-dev@wso2.org > >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > >> > > Thanks, > > Samisa... > > > > Samisa Abeysinghe > > VP Engineering > > WSO2 Inc. > > http://wso2.com > > http://wso2.org > > > > > > > > ___ > > Carbon-dev mailing list > > Carbon-dev@wso2.org > > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > > > > > > > -- > Suminda Chamara Silva > Senior Software Engineer - QA > WSO2 Inc. > Mobile: +94 718 302858 > blog: http://chamaras.blogspot.com > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > Thanks, Samisa... Samisa Abeysinghe VP Engineering WSO2 Inc. http://wso2.com http://wso2.org ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
Re: [Carbon-dev] ESB Test automation status
For Smoke test perspective, we believe that the framework covers 80% of the functionality. In order to get the exact test coverage figure, we may run Emma or clover in due course. Regards Chamara On Tue, Aug 31, 2010 at 12:08 PM, Samisa Abeysinghe wrote: > Good! How much in terms of % does this cover as of now? > > On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri > wrote: >> >> Hi, >> >> We used the framework to smoke test the Alpha3 build and were able to find >> a few issues of samples through this. The framework works well on Windows as >> well. >> >> Regards, >> Evanthika >> >> On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva wrote: >>> >>> ESB test automation framework covered following test areas right now. >>> >>> 1. ESB Samples >>> 2. Functional test - please find the automated test cases from [ >>> >>> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >>> ] >>> >>> thanks, >>> Chamara >>> -- >>> Suminda Chamara Silva >>> Senior Software Engineer - QA >>> WSO2 Inc. >>> Mobile: +94 718 302858 >>> blog: http://chamaras.blogspot.com >>> >>> ___ >>> Carbon-dev mailing list >>> Carbon-dev@wso2.org >>> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> >> >> ___ >> Carbon-dev mailing list >> Carbon-dev@wso2.org >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> > Thanks, > Samisa... > > Samisa Abeysinghe > VP Engineering > WSO2 Inc. > http://wso2.com > http://wso2.org > > > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > -- Suminda Chamara Silva Senior Software Engineer - QA WSO2 Inc. Mobile: +94 718 302858 blog: http://chamaras.blogspot.com ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
Re: [Carbon-dev] ESB Test automation status
Good! How much in terms of % does this cover as of now? On Tue, Aug 31, 2010 at 11:26 AM, Evanthika Amarasiri wrote: > Hi, > > We used the framework to smoke test the Alpha3 build and were able to find > a few issues of samples through this. The framework works well on Windows as > well. > > Regards, > Evanthika > > > On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva wrote: > >> ESB test automation framework covered following test areas right now. >> >> 1. ESB Samples >> 2. Functional test - please find the automated test cases from [ >> >> https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios >> ] >> >> thanks, >> Chamara >> -- >> Suminda Chamara Silva >> Senior Software Engineer - QA >> WSO2 Inc. >> Mobile: +94 718 302858 >> blog: http://chamaras.blogspot.com >> >> ___ >> Carbon-dev mailing list >> Carbon-dev@wso2.org >> https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev >> > > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > > Thanks, Samisa... Samisa Abeysinghe VP Engineering WSO2 Inc. http://wso2.com http://wso2.org ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
Re: [Carbon-dev] ESB Test automation status
Hi, We used the framework to smoke test the Alpha3 build and were able to find a few issues of samples through this. The framework works well on Windows as well. Regards, Evanthika On Tue, Aug 31, 2010 at 11:22 AM, Chamara Silva wrote: > ESB test automation framework covered following test areas right now. > > 1. ESB Samples > 2. Functional test - please find the automated test cases from [ > > https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios > ] > > thanks, > Chamara > -- > Suminda Chamara Silva > Senior Software Engineer - QA > WSO2 Inc. > Mobile: +94 718 302858 > blog: http://chamaras.blogspot.com > > ___ > Carbon-dev mailing list > Carbon-dev@wso2.org > https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev > ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
[Carbon-dev] ESB Test automation status
ESB test automation framework covered following test areas right now. 1. ESB Samples 2. Functional test - please find the automated test cases from [ https://wso2.org/wiki/display/esbjava/WSO2+ESB-3.X+High+level+test+scenarios ] thanks, Chamara -- Suminda Chamara Silva Senior Software Engineer - QA WSO2 Inc. Mobile: +94 718 302858 blog: http://chamaras.blogspot.com ___ Carbon-dev mailing list Carbon-dev@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
