Re: [Architecture] PAX exam based OSGi testing seems inefficient & suboptimal

2015-12-17 Thread Afkham Azeez
Yes, in the case of kernel, you have used PAX exam to install all the kernel bundles and then test the relevant features. Ideally, you would add mock bundles and then test just one or a few real bundles. So this is a unit test for OSGi bundles. That should have been the correct approach. Also,

Re: [Architecture] PAX exam based OSGi testing seems inefficient & suboptimal

2015-12-16 Thread Afkham Azeez
1. PAX exam tests being successful does not imply that the product pack will properly start This is because the way in which bundles are added to the PAX exam runtime is completely different from how the features are installed into product packs 2. Installing 100s of bundles programatically to

Re: [Architecture] PAX exam based OSGi testing seems inefficient & suboptimal

2015-12-16 Thread Afkham Azeez
Check the attached class which programatically adds all the bundles necessary just to get MSS, our smallest product running & its complexity. It is not practical to do this for all products. The correct way to integration test products is to use the product packs itself, not an full product

Re: [Architecture] PAX exam based OSGi testing seems inefficient & suboptimal

2015-12-16 Thread Sameera Jayasoma
Hi Azeez, Pax Exam is not a replacement for our integration tests. It is a way to run unit tests which require an OSGi environment. Pax Exam is the most suitable solution to test Carbon Kernel and our components (repos). We need to evaluate Pax Exam for testing our middleware products. Carbon

Re: [Architecture] PAX exam based OSGi testing seems inefficient & suboptimal

2015-12-16 Thread Aruna Karunarathna
On Thu, Dec 17, 2015 at 12:17 AM, Afkham Azeez wrote: > Check the attached class which programatically adds all the bundles > necessary just to get MSS, our smallest product running & its complexity. > It is not practical to do this for all products. The correct way to >

Re: [Architecture] PAX exam based OSGi testing seems inefficient & suboptimal

2015-12-16 Thread Akila Ravihansa Perera
Hi, Here is a suggestion when writing integration tests for our products. - Build a separate p2 profile (test profile) for integration tests which consists of features that you'd include in a normal distribution + integration test features - When running the test cases, query the test bundle

[Architecture] PAX exam based OSGi testing seems inefficient & suboptimal

2015-12-16 Thread Afkham Azeez
I have been trying to develop PAX exam based tests for MSS and it seems very hard to use because there is little help for troubleshooting. MSS has just one feature and it has been a struggle to get the test setup. With much more complex products, it would be a total nightmare. A lot of time is

Re: [Architecture] PAX exam based OSGi testing seems inefficient & suboptimal

2015-12-16 Thread Aruna Karunarathna
On Wed, Dec 16, 2015 at 8:22 PM, Afkham Azeez wrote: > I have been trying to develop PAX exam based tests for MSS and it seems > very hard to use because there is little help for troubleshooting. MSS has > just one feature and it has been a struggle to get the test setup. With >