Dear corneliux Thanks a lot for your response with clear and detailed information.
Regards Dilip Kumar b On Thursday, November 21, 2013, Stoicescu, CorneliuX wrote: > Hello Dilip, > > > > I will try and answer as much as I can on behalf of Alex: > > > > We have 2 types of tests: > > 1) Buildtime > > 2) Runtime > > > > Each type of test has 2 main categories(from a QA point of view): > > - Automated > > - Manual > > > > Here is where you can find each: > > > > - Automated Buildtime: > > o Sanity tests(run for every build): > > § In the Yocto sources: meta/classes/sanity.bbclass > > § In the Yocto sources: meta-yocto/classes/poky-sanity.bbclass > > § There are other many various sanity checks done explicitly throughout > poky. I do not have the knowledge to get in more detail on this though. > > o We are working on a new feature that will add automated “gray box” > buildtime tests: https://bugzilla.yoctoproject.org/show_bug.cgi?id=4740 > > > > - Automated Runtime: > > o Automated image tests: > > § Covers only QEMU(virtual) targets > > § After building an image, if the correct configuration is set, it will > boot up and tests will be run on it consisting of commands sent over ssh > > § The tests can be found in the Yocto sources: meta/lib/oeqa/runtime/ > > § This uses the ‘testme.bbclass’ from /meta/classes/testme.bbclass > > § More documentation on this feature can be found here: > https://wiki.yoctoproject.org/wiki/Image_tests > > § The test cases are also described in Testopia: > https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=18 > > · Note that this source contains both manual and automated tests > > § We are working on a new feature to expand these tests to BSP(hardware) > targets: https://bugzilla.yoctoproject.org/show_bug.cgi?id=1596 > > o Package testing > > § Documentation: https://wiki.yoctoproject.org/wiki/Ptest > > > > - Manual Buildtime: > > o Can be found in Testopia: > https://bugzilla.yoctoproject.org/tr_show_product.cgi > > § At the moment the following buildtime products in Testopia contain > tests: > > · ADT: > https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=1 > > · Eclipse Plugin: > https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=5 > > · HOB: > https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=8 > > · OE-CORE: > https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=25 > > · Meta-Yocto: > https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=26 > > · Bitbake: > https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=9 > > · Build Appliance: > https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=28 > > > > - Manual Runtime: > > o Covers BSP(hardware) and QEMU(virtual) targets > > o Can be found in Testopia: > https://bugzilla.yoctoproject.org/tr_show_product.cgi > > § At the moment the following runtime products in Testopia contain tests: > > · BSP: > https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=18 > > · Runtime(mostly performance and compliance tests): > https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=34 > > o Note that this source contains both manual and automated tests > > > > I hope I did not miss anything and that I was clear in my description. If > you need any more information, please don’t hesitate to ask! > > > > Regards, > > Corneliu > > Romania Yocto QA > > > > > > Dear Alex, > > Thank you for your response. > > And I need to know one more thing whether these QA tests are done manually > or it's automated during the build or its done separately by Yocto for > particular distribution? > > Is there any Q >
_______________________________________________ yocto mailing list yocto@yoctoproject.org https://lists.yoctoproject.org/listinfo/yocto