Hello All,


Here is the report for the Full QA Cycle on Release 2.3 M3 rc2



Full Report : 
https://wiki.yoctoproject.org/wiki/WW17_-_2017-04-21_-_Full_Test_Cycle_2.3_rc2



======== Summary ========



The QA cycle for release 2.3 rc2 is complete, There are 3 new issues found, 2 
related to COROPS eSDK and another one related to runqemu. Bug 11409 is the 
most important found during this validation that is affecting qemu and Eclipse 
plugin components.  All High bugs found during M3 were verified and are working 
correctly. Regarding to performances there were improvements on eSDK and roofs 
on both machines. Ptest shows also 100% of pass rate on quilt and openssl 
components.





=========================





======== Details ========



QA Hints



There are two concerns form QA perspective about this release, first one is bug 
11409 that is blocking 70% of the test cases of eclipse plugin and a series of 
bugs about multimedia not working correctly found on Meta-Intel validation 
cycle that derives on more specific bug 11410[1]





Bugs

      * New

-   11409 - runqemu-extract-sdk doesn't work in toolchain for 2.3 rc2 build [2]

-   11421 - Crops-ESDK: devtool build v4l2loopback-driver, fails when trying to 
access /lib/modules/ [3]

-   11431 - Crops-ESDK: devtool is unable to add recipe for nodejs-native 
recipe [4]



      * High / M+ Not New



           -  11300 - selftest: do_populate_sdk_ext task failing on eSDK test 
on GDC Abs [5]



Full Bug Report : 
https://wiki.yoctoproject.org/wiki/WW17_-_2017-04-21_-_Full_Test_Cycle_2.3_rc2#Bugs_Found_during_QA_Test



=========================





====== Performance ======



Improvements on roofs on both machines of about 6%, extracting eSDK was 
improved about 12% on Ubuntu and 9% in fedora. Fedora shows an improvement of 
10% on building kernel. There was a slight regression of 4% when building sato 
image on Ubuntu.



-        Ubuntu



Test           2.3 M3 rc2    2.3 rc2           %

sato           1:10:00            1:12:54          4.14

rootfs         2:26          2:17                  -6.16

rmwork         1:04:47            1:05:33          1.18

kernel         5:12          5:14                   0.64

eSDK           3:07          2:44                  -12.30





-        Fedora



Test           2.3 M3 rc2    2.3 rc2           %

Sato           1:14:57             1:12:49         -2.85

rootfs         2:44:00             2:34            -6.10

rmwork         1:06:45             1:06:45          0.00

kernel         6:38:00             5:56            -10.55

eSDK           3:20:00             3:02            -9.00





Performance Charts : 
https://wiki.yoctoproject.org/charts/perf_milestone_GDC/performance_test.html



========================





========= pTest ========



    -  There were improvements on pass rates for the quilt and openssl modules, 
both are now with 100% PASS rate

    -  There rest of the components remain with the same % of pass rate.





pTest full report : 
https://wiki.yoctoproject.org/wiki/WW17_-_2017-04-21_-_Full_Test_Cycle_2.3_rc2#pTest_for_genericx86-64_on_NUC



========================





======== Links =========

1. https://bugzilla.yoctoproject.org/show_bug.cgi?id=11410

2. https://bugzilla.yoctoproject.org/show_bug.cgi?id=11409

3. https://bugzilla.yoctoproject.org/show_bug.cgi?id=11421

4. https://bugzilla.yoctoproject.org/show_bug.cgi?id=11431

5. https://bugzilla.yoctoproject.org/show_bug.cgi?id=11300



========================

Regards
José

-- 
_______________________________________________
yocto mailing list
yocto@yoctoproject.org
https://lists.yoctoproject.org/listinfo/yocto

Reply via email to