Hello All,
Enjoy viewing the full Report for 2.4 RC1:
https://wiki.yoctoproject.org/wiki/WW40_-_2017-10-06_-_Full_Test_Cycle_2.4_RC1
======= Summary ========
The QA cycle for release 2.4 RC1 is complete. There are 18 new bugs from which
5 are high priority and are targeted to be fixed in 2.4 M4. Four of the High
Priority bugs (12143[1], 12144[2], 12145[3], 12146[4]) are ptest related and
one (12194[5]) is Toaster related. An additional medium+ priority (12131[6]
Kernel traceback when reboot beaglebone) is targeted to be fixed by 2.4 M4. As
an extra note on this report QA wants to highlight that, there are a total of
46 Bugs targeted to be fixed in 2.4 M4 (link [20]).
ptest
Results show that python and e2fsprogs are not executing, hence bugs 12143[1]
and 12146[4], respectively, were opened and given a high priority.
Bash (bug 12145[3]) had a decrement in the pass rate of 1.27% and busybox
(bug 12144[2]) had a decrement in the pass rate of 0.19%. Although they are
high priority, QA sees that the decrement is not very significant, hence this
bugs can be lowered in priority.
Eclipse
Some good news: testing for Eclipse-Oxygen was added for the first time to the
QA test cycle.
Posix
2.4 RC1 Posix results are very similar to last QA cycle 2.4 M3 rc1. They only
show that Edgerouter had one more failure if compared with the previous run.
Failures 2.4 RC1 2.4 M3 RC1
Generic86-64 46 46
Beaglebone 45 45
Edgerouter 47 46
Mpc8315e-rdb 45 45
For more details visit: https://wiki.yoctoproject.org/wiki/Posix_result and
https://wiki.yoctoproject.org/wiki/POSIX-results
LTP
2.4 RC1 LTP results show that, for Genericx86-64 and Beaglebone, the failures
incremented by 1 test. On Edgerouter we have an increment of 2 failures if
compared with QA cycle 2.4 M3 rc1.
2.4 RC1 |
2.4 M3 RC1
Total | Failures |
Total | Failures
Genericx86-64 1391 | 27 | 1391 |
26
Beaglebone 1353 | 18 | 1353 |
17
Edgerouter 1353 | 34 | 1353
| 32
Mpc8315e-rdb 1353 | 31 | 1353 |
31
For more details: https://wiki.yoctoproject.org/wiki/LTP_result
Performance
In general, the measurements were on the same levels showed up on 2.4_M3. The
only noticeable variation was on "rootfs" that is showing an increase of 5% on
Ubuntu and 7% on Fedora, although this does not represent an important
regression.
Ubuntu Test 2.4 M3 rc1 2.4_rc1 %
sato 1:15:58 1:15:24
-0.75
rootfs 2:34 2:45
7.14
rmwork 1:08:15 1:08:19 0.10
kernel 5:36 5:41
1.49
eSDK 2:39 2:40
0.63
Fedora Test 2.4 M3 rc1 2.4_rc1 %
sato 1:14:13 1:17:02
3.80
rootfs 2:35 2:44
5.81
rmwork 1:09:06 1:10:25 1.91
kernel 5:58 6:04
1.68
eSDK 2:37 2:42
3.18
======= QA-Hints========
Due to the fact that, there are 5 high priority bugs and 46 bugs targeted to be
fixed and solved by 2.4 M4, QA requests an RC2 so that all the commits/fixes
relevant to 2.4 release are integrated.
======= Bugs ========
New Bugs
-12143[1] Ptest-runner does not run python, in 2.4rc1
-12144[2] ptest-busybox cases failed in 2.4rc1
-12145[3] ptest-bash cases failed in 2.4rc1
-12146[4] ptest-e2fsprog cases failed in 2.4rc1
-12194[5] Toaster server lost "toaster.conf" environment, user
settings lost
-12131[6] Kernel traceback when reboot beaglebone black Medium+
-12170[7] Add mkfs.ext support to busybox on poky-tiny
-12138[8] [master] the icon on the connection manager appears
without connection in Eclipse Plugin
-12168[9] media player - must be warned that it is not possible to
play MPEG-1 and MP3 formats
-12150[10] bug for QA to create Testcases for this new test on
testopia AUTO_eSDK_sdkext
-12133[11] The search results for numbers are incorrect.
-12140[12] The link and the x button from the search's result did
not work as expected
-12142[13] The color from the table from the project build changed
when you use an special character.
-12164[14] The field from time's task is empty
-12171[15] After building an image, checking the packages there's
nothing.
-12175[16] [Test Case 946] View detailed configuration information
for a build
-12200[17] The button from New custom image is not working as
expected
-12201[18] The button from New custom image is letting you press it
and it's supposed to be disabled.
Not new M+ bugs
-11994[19] Graphical qemu doesn't work over remote X on Fedora 26
Full Bug Report:
https://wiki.yoctoproject.org/wiki/WW40_-_2017-10-06_-_Full_Test_Cycle_2.4_RC1#Bugs_Found_during_QA_Test
======== Links =========
1. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12143[1]
2. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12144[2]
3. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12145[3]
4. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12146[4]
5. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12194[5]
6. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12131[6]
7. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12170[7]
8. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12138[8]
9. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12168[9]
10. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12150[10]
11. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12133[11]
12. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12140[12]
13. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12142[13]
14. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12164[14]
15. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12171[15]
16. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12175[16]
17. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12200[17]
18. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12201[18]
19. https://bugzilla.yoctoproject.org/show_bug.cgi?id=11994[19]
20.
https://wiki.yoctoproject.org/wiki/WW40_-_2017-10-06_-_Full_Test_Cycle_2.4_RC1#Current_community_Open_Bugs_-_Medium.2B.2FHigh[20]
Regards
Libertad G.
--
_______________________________________________
yocto mailing list
yocto@yoctoproject.org
https://lists.yoctoproject.org/listinfo/yocto
