+1. System test framework will also include some integration tests because
we need to do regression testing on patches, multiple platforms using that.

/Charitha


On Wed, Jan 18, 2012 at 1:05 PM, Krishantha Samaraweera <krishan...@wso2.com
> wrote:

> Your are correct. We came across the same issue when designing the
> framework. Since system tests runs with different configurations (e.g with
> registry mounts and different DBs) we need to run all most all
> product integration tests on top of product platform as well. We can not
> directly have dependencies to product integration tests because of the way
> we have written those tests. And, The tests architecture is also differ. We
> have written the system-test-framework to address the distributed nature of
> a platform deployment. Currently as what we can do is to duplicate
> integration tests inside system tests. May be in future we can find a
> better way to do it.
>
> Thanks,
> Krishantha.
>
> On Wed, Jan 18, 2012 at 10:57 AM, KasunG Gajasinghe <kas...@wso2.com>wrote:
>
>>   I have a little question about System-Test-Framework. Does the
>>>>> objective of it is to complement the integration tests of products,
>>>>> or will it be integrated in to the product integration tests in
>>>>> future?
>>>>>
>>>>
>>>> What current integration test does is test the individual components
>>>> combined and grouped into a so called product. It doesn't have platform
>>>> wide tests cases. For an example, It doesn't test a scenario run on ESB,
>>>> BPS and G-Reg with registry mounts and clustering. What we does in
>>>> system-test-framework is test the platform as a whole.
>>>>
>>>
>>>> Nope system-test-framework will not be integrated in to integration
>>>> tests.
>>>>
>>>
>>> Understood. But, talking from viewpoint of AS, it seems that the
>>> boundary of this framework's tests and product intg tests is somewhat blur.
>>> For example, AS needs to test the security scenarios of Axis2 services
>>> something which also done by the system-test-framework. May be we need to
>>> come to a common ground on this.
>>>
>>
>>
>>
>> We are going off the topic here. Lets discuss this on carbon-dev. Please
>>> ask all the question you have in there.
>>
>>
>> +1. forwarded to carbon-dev.
>>
>>
>>> Thanks,
>>> --KasunG
>>>
>>>
>>>>
>>>> Thanks,
>>>> Krishantha.
>>>>
>>>>
>>>>
>>>>>
>>>>> I'm asking this because I feel like things may get duplicated between
>>>>> product integration tests, and STF!
>>>>>
>>>>> Thanks,
>>>>> --KasunG
>>>>>
>>>>>
>>>>>>
>>>>>> Thanks,
>>>>>> Krishantha.
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> *Kasun Gajasinghe*
>>>>> Software Engineer; WSO2 Inc.; http://wso2.com
>>>>>
>>>>> ,
>>>>> *email: **kasung AT spamfree wso2.com** cell: **+94 (77) 678-0813*
>>>>> *blog: **http://blog.kasunbg.org* <http://blog.kasunbg.org>
>>>>>
>>>>> *
>>>>> twitter: **http://twitter.com/kasunbg* <http://twitter.com/kasunbg>
>>>>>
>>>>> *
>>>>> *
>>>>>
>>>>>
>>>>
>>>
>>>
>>> --
>>> *Kasun Gajasinghe*
>>> Software Engineer; WSO2 Inc.; http://wso2.com
>>>
>>> ,
>>> *email: **kasung AT spamfree wso2.com** cell: **+94 (77) 678-0813*
>>> *blog: **http://blog.kasunbg.org* <http://blog.kasunbg.org>
>>>
>>> *
>>> twitter: **http://twitter.com/kasunbg* <http://twitter.com/kasunbg>
>>>
>>> *
>>> *
>>>
>>>
>>
>>
>>
>> --
>> *Kasun Gajasinghe*
>> Software Engineer; WSO2 Inc.; http://wso2.com
>>
>> ,
>> *email: **kasung AT spamfree wso2.com** cell: **+94 (77) 678-0813*
>> *blog: **http://blog.kasunbg.org* <http://blog.kasunbg.org>
>>
>> *
>> twitter: **http://twitter.com/kasunbg* <http://twitter.com/kasunbg>
>>
>> *
>> *
>>
>>
>> _______________________________________________
>> Carbon-dev mailing list
>> Carbon-dev@wso2.org
>> http://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
>>
>>
>
> _______________________________________________
> Carbon-dev mailing list
> Carbon-dev@wso2.org
> http://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev
>
>
_______________________________________________
Carbon-dev mailing list
Carbon-dev@wso2.org
http://mail.wso2.org/cgi-bin/mailman/listinfo/carbon-dev

Reply via email to