Hello Dilip,

I will try and answer as much as I can on behalf of Alex:

We have 2 types of tests:

1)      Buildtime

2)      Runtime

Each type of test has 2 main categories(from a QA point of view):

-          Automated

-          Manual

Here is where you can find each:


-          Automated Buildtime:

o   Sanity tests(run for every build):

§  In the Yocto sources: meta/classes/sanity.bbclass

§  In the Yocto sources: meta-yocto/classes/poky-sanity.bbclass

§  There are other many various sanity checks done explicitly throughout poky. 
I do not have the knowledge to get in more detail on this though.

o   We are working on a new feature that will add automated "gray box" 
buildtime tests: https://bugzilla.yoctoproject.org/show_bug.cgi?id=4740


-          Automated Runtime:

o   Automated image tests:

§  Covers only QEMU(virtual) targets

§  After building an image, if the correct configuration is set, it will boot 
up and tests will be run on it consisting of commands sent over ssh

§  The tests can be found in the Yocto sources: meta/lib/oeqa/runtime/

§  This uses the 'testme.bbclass' from /meta/classes/testme.bbclass

§  More documentation on this feature can be found here: 
https://wiki.yoctoproject.org/wiki/Image_tests

§  The test cases are also described in Testopia: 
https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=18

·         Note that this source contains both manual and automated tests

§  We are working on a new feature to expand these tests to BSP(hardware) 
targets: https://bugzilla.yoctoproject.org/show_bug.cgi?id=1596

o   Package testing

§  Documentation: https://wiki.yoctoproject.org/wiki/Ptest


-          Manual Buildtime:

o   Can be found in Testopia: 
https://bugzilla.yoctoproject.org/tr_show_product.cgi

§  At the moment the following buildtime products in Testopia contain tests:

·         ADT: https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=1

·         Eclipse Plugin: 
https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=5

·         HOB: https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=8

·         OE-CORE: https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=25

·         Meta-Yocto: 
https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=26

·         Bitbake: https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=9

·         Build Appliance: 
https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=28


-          Manual Runtime:

o   Covers BSP(hardware) and QEMU(virtual) targets

o   Can be found in Testopia: 
https://bugzilla.yoctoproject.org/tr_show_product.cgi

§  At the moment the following runtime products in Testopia contain tests:

·         BSP: https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=18

·         Runtime(mostly performance and compliance tests): 
https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=34

o   Note that this source contains both manual and automated tests

I hope I did not miss anything and that I was clear in my description. If you 
need any more information, please don't hesitate to ask!

Regards,
Corneliu
Romania Yocto QA

From: yocto-boun...@yoctoproject.org [mailto:yocto-boun...@yoctoproject.org] On 
Behalf Of Dilip Kumar
Sent: Tuesday, November 19, 2013 8:08 PM
To: Georgescu, Alexandru C
Cc: yocto@yoctoproject.org
Subject: Re: [yocto] QA Tests in Yocto development environment block diagram


Dear Alex,

Thank you for your response.

And I need to know one more thing whether these QA tests are done manually or 
it's automated during the build or its done separately by Yocto for particular 
distribution?

Is there any QA tests done during the build procedure locally?

regards
dilip kumar b
On 14-Nov-2013 12:15 am, "Georgescu, Alexandru C" 
<alexandru.c.george...@intel.com<mailto:alexandru.c.george...@intel.com>> wrote:
Hi,
Our overall testing plan is available here: 
https://wiki.yoctoproject.org/wiki/Yocto_1.6_Overall_Test_Plan. Since we are in 
the last phase of planning for 1.6, this is not the final version yet.

Regarding the test cases, all you have to do is to have an account in our bug 
tracking website https://bugzilla.yoctoproject.org/ and follow the instructions 
in the Testopia wiki, our test case platform management system: 
https://wiki.yoctoproject.org/wiki/Testopia. There you can find the tests 
performed against the Yocto Project components.

Regards,
--
Alexandru Georgescu

From: yocto-boun...@yoctoproject.org<mailto:yocto-boun...@yoctoproject.org> 
[mailto:yocto-boun...@yoctoproject.org<mailto:yocto-boun...@yoctoproject.org>] 
On Behalf Of Dilip Kumar
Sent: Wednesday, November 13, 2013 06:27
To: yocto@yoctoproject.org<mailto:yocto@yoctoproject.org>
Subject: [yocto] QA Tests in Yocto development environment block diagram


Dear all,

I need know what is QA tests and what all the tests it will do and need to know 
more information about QA please help me out in this.

regards
dilip kumar b
_______________________________________________
yocto mailing list
yocto@yoctoproject.org
https://lists.yoctoproject.org/listinfo/yocto

Reply via email to