Re: Fedora Rawhide-20170227.n.0 compose check report
On Mon, 2017-02-27 at 17:25 +, Fedora compose checker wrote:
> Missing expected images:
>
> Atomic qcow2 x86_64
There seems to be some sort of problem in pungi-make-ostree:
https://kojipkgs.fedoraproject.org//work/tasks/1386/18091386/root.log
DEBUG util.py:435: + pungi-make-ostree tree
--repo=/mnt/koji/compose/atomic/rawhide/
--log-dir=/mnt/koji/compose/rawhide/Fedora-Rawhide-20170227.n.0/logs/x86_64/Atomic/ostree-2
--treefile=/mnt/koji/compose/rawhide/Fedora-Rawhide-20170227.n.0/work/ostree-2/config_repo/fedora-atomic-docker-host.json
--extra-config=/mnt/koji/compose/rawhide/Fedora-Rawhide-20170227.n.0/work/ostree-2/extra_config.json
DEBUG util.py:435: Traceback (most recent call last):
DEBUG util.py:435:File "/usr/bin/pungi-make-ostree", line 15, in
DEBUG util.py:435: ostree.main()
DEBUG util.py:435:File
"/usr/lib/python2.7/site-packages/pungi/ostree/__init__.py", line 85, in main
DEBUG util.py:435: func()
DEBUG util.py:435:File
"/usr/lib/python2.7/site-packages/pungi/ostree/tree.py", line 95, in run
DEBUG util.py:435: repos = extra_source_repos + [{'name':
'source_repo_from', 'baseurl': source_repo_from}]
DEBUG util.py:435: TypeError: unsupported operand type(s) for +: 'NoneType'
and 'list'
> Server dvd i386
Several i386 image composes still failing for the reason Kevin noted
recently:
dnf.exceptions.Error: Will not install a source rpm package
(docker-anaconda-addon-0.4-4.fc26.src).
> Xfce raw-xz armhfp
Looks a bit odd:
https://kojipkgs.fedoraproject.org//work/tasks/1563/18091563/root.log
DEBUG util.py:435: Unable to create appliance : Failed to find package
'firefox' : no package matched: firefox
Is there an ARM-specific issue with the firefox package?
> Server boot i386
> Atomic raw-xz x86_64
See above.
> Failed openQA tests: 10/107 (x86_64), 1/2 (arm)
>
> ID: 57880 Test: x86_64 Server-dvd-iso install_repository_nfs_graphical
> URL: https://openqa.fedoraproject.org/tests/57880
This is some kinda transient test fail, I think (openQA clicked in the
wrong place or the click got lost or something).
> ID: 57881 Test: x86_64 Server-dvd-iso server_role_deploy_domain_controller
> URL: https://openqa.fedoraproject.org/tests/57881
This is now failing because of:
https://bugzilla.redhat.com/show_bug.cgi?id=1405790
freeipa-client and freeipa-server can't be installed due to dep issues
with certmonger, and certmonger rebuild is failing.
> ID: 57899 Test: x86_64 Workstation-live-iso desktop_terminal
> URL: https://openqa.fedoraproject.org/tests/57899
> ID: 57907 Test: x86_64 Workstation-live-iso desktop_update_graphical
> URL: https://openqa.fedoraproject.org/tests/57907
These two failed because gnome-color-manager unexpectedly asked for
access to the system location immediately upon login, which the test
can't cope with:
https://bugzilla.gnome.org/show_bug.cgi?id=779343
We could adjust the test, but the GNOME behaviour seems odd, so waiting
for input from the devs on whether it's a bug.
> ID: 57925 Test: arm Minimal-raw_xz-raw.xz
> install_arm_image_deployment_upload
> URL: https://openqa.fedoraproject.org/tests/57925
We never get any video output from this test, with a 10 minute (IIRC)
boot timeout. pwhalen reports there's a showstopper with ARM atm
related to module loading:
https://bugzilla.redhat.com/show_bug.cgi?id=1422634
that may be causing this, or it may be something else.
> ID: 57951 Test: x86_64 universal install_iscsi
> URL: https://openqa.fedoraproject.org/tests/57951
This broke between 20170208 and 20170214, my best guess at what
happened is in the new bug report:
https://bugzilla.redhat.com/show_bug.cgi?id=1427359
> ID: 57956 Test: x86_64 universal install_software_raid@uefi
> URL: https://openqa.fedoraproject.org/tests/57956
This is an openQA console typing fail (sigh, still happens
occasionally). Test actually worked fine.
> ID: 57978 Test: x86_64 universal install_cyrillic_language
> URL: https://openqa.fedoraproject.org/tests/57978
Still https://bugzilla.redhat.com/show_bug.cgi?id=1413813 . If that
doesn't get any attention soon I may have to make the test work around
it to cover the rest of the test case...
> ID: 57983 Test: x86_64 universal install_rescue_encrypted
> URL: https://openqa.fedoraproject.org/tests/57983
> ID: 57984 Test: x86_64 universal install_rescue_encrypted@uefi
> URL: https://openqa.fedoraproject.org/tests/57984
Still https://bugzilla.redhat.com/show_bug.cgi?id=1376638 . Looks like
there's now a PR to fix this, but it is not yet merged.
> ID: 57986 Test: x86_64 Workstation-live-iso
> desktop_notifications_postinstall
> URL: https://openqa.fedoraproject.org/tests/57986
This is a hard fail caused by the same SELinux alert that causes all
the soft fails (see below). It's a hard fail because any AVC alert that
triggers a de
Re: [Test-Announce] Fedora 26 Rawhide 20170226.n.0 nightly compose nominated for testing
On Sun, 2017-02-26 at 13:46 +, rawh...@fedoraproject.org wrote: > Announcing the creation of a new nightly release validation test event > for Fedora 26 Rawhide 20170226.n.0. Please help run some tests for this > nightly compose if you have time. For more information on nightly > release validation testing, see: > https://fedoraproject.org/wiki/QA:Release_validation_test_plan So unlike the last few candidate composes, this one does seem to basically work in openQA testing and thus should be a suitable candidate for the manual tests. As we haven't had a good candidate compose for some time and there's been a mass rebuild and other big changes since the last one, it would be great to get all the tests run on this compose - please do join in the testing if you can! Thanks, everyone. -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net http://www.happyassassin.net ___ test mailing list -- test@lists.fedoraproject.org To unsubscribe send an email to test-le...@lists.fedoraproject.org
New automated test coverage: openQA tests of critical path updates
Hi folks! I am currently rolling out some changes to the Fedora openQA deployment which enable a new testing workflow. From now on, a subset of openQA tests should be run automatically on every critpath update, both on initial submission and on any edit of the update. For the next little while, at least, this won't be incredibly visible. openQA sends out fedmsgs for all tests, so you can sign up for FMN notifications to learn about these results. They'll also be discoverable from the openQA web UI - https://openqa.fedoraproject.org . The results are also being forwarded to ResultsDB, so they'll be visible via ResultsDB API queries and the ResultsDB web UI. But for now, that's it...I think. Our intent is to set up the necessary bits so that these results will show up in the Bodhi web UI alongside the results for relevant Taskotron tests. There's an outside possibility that Bodhi is actually already set up to find these results in ResultsDB, in which case they'll just suddenly start showing up in Bodhi - we should know about that soon enough. :) But most likely Bodhi will need a bit of a tweak to find them. This is probably a good thing, because we need to let the tests run for a while to find out how reliable they are, and if there's an unacceptable number of false negatives/positives. Once we have some info on that and are happy that we can get things sufficiently reliable for the results to be useful, we'll hook up the Bodhi integration. The tests that are run are most of the tests that, on the 'compose test' workflow, get run on the Server DVD and Workstation Live images after installation. Between them they do a decent job of covering basic system functionality. They also cover FreeIPA server and client setup, and Workstation browser (Firefox) and terminal functionality. So hopefully, if your critpath update completely breaks one of those basic workflows, you'll find out about it before pushing it stable. At present it looks like the Workstation tests may sometimes fail simply because the base install gets stuck during boot for some reason; I'm going to look into that this week. In testing so far the Server tests seem fairly reliable, but I want to gather data from a few days worth of test runs to see how those look. Once we start sending results to Bodhi, I'll try and write up some basic instructions on how to interpret and debug openQA test results; QA folks will also be available in IRC and by email for help with this, of course. You can see sample runs on Server: https://openqa.stg.fedoraproject.org/tests/overview?groupid=1=FEDORA-2017-376ae2b92c=25=fedora and Workstation: https://openqa.stg.fedoraproject.org/tests/overview?version=25=fedora=FEDORA-2017-87896dfb59=1 the 'desktop_notifications_live' failure is a stale bit of data - that test isn't actually run any more because obviously it makes no sense in this context, but because it got run one time in early development, openQA continues to show it for that update (it won't show for any *other* update). The `desktop_update_graphical` fail is a good example of the kind of issue I'll have to look into this week: it seems to have failed because of an intermittent crasher bug in PackageKit, rather than an issue in the update. We'll have to look at skipping known- unreliable tests, or marking them somehow so you know the deal in Bodhi, or automatically re-running them, or things along those lines. -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net http://www.happyassassin.net ___ test mailing list -- test@lists.fedoraproject.org To unsubscribe send an email to test-le...@lists.fedoraproject.org
2017-02-27 @ 16:00 UTC - Fedora QA Meeting - Minutes
== #fedora-meeting: Fedora QA meeting == Meeting started by adamw at 16:00:42 UTC. The full logs are available at https://meetbot.fedoraproject.org/fedora-meeting/2017-02-27/fedora-qa.2017-02-27-16.00.log.html . Meeting summary --- * Roll call (adamw, 16:00:49) * Previous meeting follow-up (adamw, 16:05:14) * "adamw to follow up with releng on compose failure" - i forget precisely which compose failure that was, there were a few, but anyhow, we worked through several and composes are now happening again (adamw, 16:06:18) * "adamw to look into Kerberos credential cache Change and see if it's significant" - whoops, haven't done that yet (adamw, 16:06:30) * ACTION: adamw to look into Kerberos credential cache Change and see if it's significant (adamw, 16:06:35) * LINK: https://fedoraproject.org/w/index.php?title=Atomic/PRD (roshi, 16:08:32) * "roshi and cmurf to work with Atomic WG to try and get the PRD and wiki space updated, so we can then think about how to derive requirements and test processes from it" - Atomic PRD (draft?) is up at https://fedoraproject.org/wiki/Atomic/PRD , please review and send along any comments you have (adamw, 16:11:57) * Fedora 26 status (adamw, 16:12:33) * we had a couple of weeks of missing or broken composes, but we seem to have better results in the last few days (adamw, 16:15:07) * Fedora 26 Branch point is tomorrow (2017-02-28) (adamw, 16:15:27) * Fedora 27 Changes: No More Alphas (adamw, 16:21:12) * qa consequence 1: involvement in overseeing the process that decides whether to push things to Rawhide in this system (adamw, 16:40:04) * qa consequence 2: Alpha RC testing, go/no-go etc. drop out of the cycle (adamw, 16:40:27) * qa consequence 3: will need to re-examine the qa schedule and see if some events that are directly or indirectly related to the Alpha schedule need to change (adamw, 16:41:06) * Fedora 27 Changes: Bodhi Non-RPM Artifacts (adamw, 16:43:01) * https://fedoraproject.org/wiki/Changes/BodhiNonRPMArtifacts (adamw, 16:44:36) * this will have some impact on taskotron, but tflink thinks we're prepared (adamw, 16:45:51) * it will also affect the openqa update testing scheduler, i am trying to get info on how fedmsgs for non-rpm updates will look (adamw, 16:46:19) * we will likely have to adjust fedora-easy-karma and maybe update some wiki pages too (adamw, 16:46:40) * Open floor (adamw, 16:48:19) * https://fedoraproject.org/wiki/Changes/ArmSupportInFmw looks to have consequences for release blocking images, we should follow up and ensure it is properly tested (adamw, 16:57:50) * sumantrom points out that there is a call out for Fedora Classroom instructor volunteers, please do volunteer if you have time and expertise! https://lists.fedoraproject.org/archives/list/test@lists.fedoraproject.org/message/COTDSCJ6NOT6UZQ5SXN3Y7B2J7MYT7SD/ (adamw, 16:59:46) Meeting ended at 17:05:39 UTC. Action Items * adamw to look into Kerberos credential cache Change and see if it's significant Action Items, by person --- * adamw * adamw to look into Kerberos credential cache Change and see if it's significant * **UNASSIGNED** * (none) People Present (lines said) --- * adamw (95) * roshi (25) * sumantrom (14) * kparal (12) * handsome_pirate (10) * garretraziel (8) * Southern_Gentlem (7) * zodbot (5) * siddharthvipul (5) * tflink (3) * prakash (3) * pwhalen (2) * coremodule (2) * nirik (1) * pschindl_ (1) Generated by `MeetBot`_ 0.1.4 .. _`MeetBot`: http://wiki.debian.org/MeetBot -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net http://www.happyassassin.net ___ test mailing list -- test@lists.fedoraproject.org To unsubscribe send an email to test-le...@lists.fedoraproject.org
2017-02-13 @ 16:00 UTC - Fedora QA Meeting - Minutes
== #fedora-meeting: Fedora QA meeting == Meeting started by adamw at 16:00:06 UTC. The full logs are available at https://meetbot.fedoraproject.org/fedora-meeting/2017-02-13/fedora-qa.2017-02-13-16.00.log.html . Meeting summary --- * Roll call (adamw, 16:00:17) * Previous meeting follow-up (adamw, 16:05:18) * no action items at last meeting (adamw, 16:05:30) * Factory 2.0, CI, Modularity, no-Alphas, Atomic, oh my...the future of Fedora QA (adamw, 16:09:12) * ACTION: roshi and cmurf to work with Atomic WG to try and get the PRD and wiki space updated, so we can then think about how to derive requirements and test processes from it (adamw, 16:45:53) * ACTION: roshi to bring up the PRD at the next Atomic meeting (roshi, 16:45:54) * there's lots of Interesting Times coming up, we have our finger on the pulse and we're skating to where the puck's going to be and are otherwise up to date on our cliches (adamw, 16:48:00) * Fedora 26 Changes and status (adamw, 16:48:35) * Rawhide compose is currently broken due to some kind of issue between RPM and NSS (adamw, 16:51:59) * ACTION: adamw to follow up with releng on compose failure (adamw, 16:52:07) * Anaconda LVM RAID Change seems significant, if approved we'll have to run some install tests to check it out (adamw, 16:58:49) * ACTION: adamw to look into Kerberos credential cache Change and see if it's significant (adamw, 17:04:33) * Open floor (adamw, 17:06:49) * LINK: http://fedoraplanet.org/quality/ (adamw, 17:08:14) * we now have a QA subplanet: http://fedoraplanet.org/quality/ . please enrol your blog if you have one: https://fedoraproject.org/wiki/Planet#Joining_a_sub-planet (adamw, 17:09:10) Meeting ended at 17:14:35 UTC. Action Items * roshi and cmurf to work with Atomic WG to try and get the PRD and wiki space updated, so we can then think about how to derive requirements and test processes from it * roshi to bring up the PRD at the next Atomic meeting * adamw to follow up with releng on compose failure * adamw to look into Kerberos credential cache Change and see if it's significant Action Items, by person --- * adamw * adamw to follow up with releng on compose failure * adamw to look into Kerberos credential cache Change and see if it's significant * cmurf * roshi and cmurf to work with Atomic WG to try and get the PRD and wiki space updated, so we can then think about how to derive requirements and test processes from it * roshi * roshi and cmurf to work with Atomic WG to try and get the PRD and wiki space updated, so we can then think about how to derive requirements and test processes from it * roshi to bring up the PRD at the next Atomic meeting * **UNASSIGNED** * (none) People Present (lines said) --- * adamw (131) * roshi (62) * cmurf (25) * tflink (13) * kparal (12) * zodbot (11) * sumantrom (4) * coremodule (4) * nirik (3) * marc84 (2) * brunowolff (2) * pschindl_ (1) * garretraziel (1) * Southern_Gentlem (1) * a2batic (1) Generated by `MeetBot`_ 0.1.4 .. _`MeetBot`: http://wiki.debian.org/MeetBot -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net http://www.happyassassin.net ___ test mailing list -- test@lists.fedoraproject.org To unsubscribe send an email to test-le...@lists.fedoraproject.org
Fedora Rawhide-20170227.n.0 compose check report
Missing expected images: Atomic qcow2 x86_64 Server dvd i386 Xfce raw-xz armhfp Server boot i386 Atomic raw-xz x86_64 Failed openQA tests: 10/107 (x86_64), 1/2 (arm) ID: 57880 Test: x86_64 Server-dvd-iso install_repository_nfs_graphical URL: https://openqa.fedoraproject.org/tests/57880 ID: 57881 Test: x86_64 Server-dvd-iso server_role_deploy_domain_controller URL: https://openqa.fedoraproject.org/tests/57881 ID: 57899 Test: x86_64 Workstation-live-iso desktop_terminal URL: https://openqa.fedoraproject.org/tests/57899 ID: 57907 Test: x86_64 Workstation-live-iso desktop_update_graphical URL: https://openqa.fedoraproject.org/tests/57907 ID: 57925 Test: arm Minimal-raw_xz-raw.xz install_arm_image_deployment_upload URL: https://openqa.fedoraproject.org/tests/57925 ID: 57951 Test: x86_64 universal install_iscsi URL: https://openqa.fedoraproject.org/tests/57951 ID: 57956 Test: x86_64 universal install_software_raid@uefi URL: https://openqa.fedoraproject.org/tests/57956 ID: 57978 Test: x86_64 universal install_cyrillic_language URL: https://openqa.fedoraproject.org/tests/57978 ID: 57983 Test: x86_64 universal install_rescue_encrypted URL: https://openqa.fedoraproject.org/tests/57983 ID: 57984 Test: x86_64 universal install_rescue_encrypted@uefi URL: https://openqa.fedoraproject.org/tests/57984 ID: 57986 Test: x86_64 Workstation-live-iso desktop_notifications_postinstall URL: https://openqa.fedoraproject.org/tests/57986 Soft failed openQA tests: 52/107 (x86_64) (Tests completed, but using a workaround for a known bug) ID: 57874 Test: x86_64 Server-boot-iso install_default URL: https://openqa.fedoraproject.org/tests/57874 ID: 57875 Test: x86_64 Server-boot-iso install_default@uefi URL: https://openqa.fedoraproject.org/tests/57875 ID: 57876 Test: x86_64 Server-dvd-iso install_default_upload URL: https://openqa.fedoraproject.org/tests/57876 ID: 57877 Test: x86_64 Server-dvd-iso install_default@uefi URL: https://openqa.fedoraproject.org/tests/57877 ID: 57879 Test: x86_64 Server-dvd-iso install_repository_nfs_variation URL: https://openqa.fedoraproject.org/tests/57879 ID: 57889 Test: x86_64 Server-dvd-iso install_updates_nfs URL: https://openqa.fedoraproject.org/tests/57889 ID: 57895 Test: x86_64 Everything-boot-iso install_default URL: https://openqa.fedoraproject.org/tests/57895 ID: 57896 Test: x86_64 Everything-boot-iso install_default@uefi URL: https://openqa.fedoraproject.org/tests/57896 ID: 57927 Test: x86_64 universal install_package_set_minimal URL: https://openqa.fedoraproject.org/tests/57927 ID: 57928 Test: x86_64 universal install_anaconda_text URL: https://openqa.fedoraproject.org/tests/57928 ID: 57930 Test: x86_64 universal install_repository_http_variation URL: https://openqa.fedoraproject.org/tests/57930 ID: 57931 Test: x86_64 universal install_repository_http_graphical URL: https://openqa.fedoraproject.org/tests/57931 ID: 57933 Test: x86_64 universal install_delete_pata URL: https://openqa.fedoraproject.org/tests/57933 ID: 57934 Test: x86_64 universal install_delete_pata@uefi URL: https://openqa.fedoraproject.org/tests/57934 ID: 57935 Test: x86_64 universal install_sata URL: https://openqa.fedoraproject.org/tests/57935 ID: 57936 Test: x86_64 universal install_sata@uefi URL: https://openqa.fedoraproject.org/tests/57936 ID: 57937 Test: x86_64 universal install_kickstart_user_creation URL: https://openqa.fedoraproject.org/tests/57937 ID: 57938 Test: x86_64 universal install_scsi_updates_img URL: https://openqa.fedoraproject.org/tests/57938 ID: 57939 Test: x86_64 universal install_multi URL: https://openqa.fedoraproject.org/tests/57939 ID: 57940 Test: x86_64 universal install_multi@uefi URL: https://openqa.fedoraproject.org/tests/57940 ID: 57941 Test: x86_64 universal install_simple_encrypted URL: https://openqa.fedoraproject.org/tests/57941 ID: 57942 Test: x86_64 universal install_simple_free_space URL: https://openqa.fedoraproject.org/tests/57942 ID: 57943 Test: x86_64 universal install_multi_empty URL: https://openqa.fedoraproject.org/tests/57943 ID: 57944 Test: x86_64 universal install_software_raid URL: https://openqa.fedoraproject.org/tests/57944 ID: 57945 Test: x86_64 universal install_delete_partial URL: https://openqa.fedoraproject.org/tests/57945 ID: 57946 Test: x86_64 universal install_btrfs URL: https://openqa.fedoraproject.org/tests/57946 ID: 57947 Test: x86_64 universal install_ext3 URL: https://openqa.fedoraproject.org/tests/57947 ID: 57948 Test: x86_64 universal install_xfs URL: https://openqa.fedoraproject.org/tests/57948 ID: 57949 Test: x86_64 universal install_lvmthin URL: https://openqa.fedoraproject.org/tests/57949 ID: 57950 Test: x86_64 universal install_no_swap URL: https://openqa.fedoraproject.org/tests/57950 ID: 57953 Test:
Fedora 25 compose report: changes
___ test mailing list -- test@lists.fedoraproject.org To unsubscribe send an email to test-le...@lists.fedoraproject.org
F25 much more worse then F24, I hope F26 will be better
Hi, - last dnf update took far too much time - shutdown process not tolerable, takes too much time. - usb connection erroneous. i.e. after copying to flash medium or external disk connected by an usb adapter in most trials, when I try to eject the usb connected medium, there - after a copying process is finished a long time ago - comes the message "usb medium in use", this for ever. Also after shutdown of F25 in some cases I had to repair the usb connected medium with a new partition table. Things like that are not nice. Conclusion: I use F24 and if F26 will be better switch to F26 and omit F25. Kind regards ___ test mailing list -- test@lists.fedoraproject.org To unsubscribe send an email to test-le...@lists.fedoraproject.org
