Just to understand correctly, the issue is results getting marked as neutral, then Britney sees these neutral results and incorrectly migrates the package? Is the issue at its core with Britney or autopkgtest?
-- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is subscribed to Auto Package Testing. https://bugs.launchpad.net/bugs/2035101 Title: autopkgtest failures are ignored, apparently for packages with only superficial tests Status in Auto Package Testing: New Status in britney: New Bug description: Example 1 ========= Yesterday, I noticed that gnome-metronome 1.3.0-0ubuntu2 was allowed to migrate from mantic-proposed to mantic despite its own autopkgtest failing on every architecture. This migration happened after an automatic migration-reference run happened which returned the result "neutral". "neutral" is expected for superficial autopkgtests like the one in gnome-metronome. Before that migration-reference run, the failures were correctly shown on the excuses page. Screenshots attached. https://autopkgtest.ubuntu.com/packages/gnome-metronome/mantic/amd64 (I then uploaded 1.3.0-0ubuntu3 which fixed the autopkgtest regression) Here's the gnome-metronome autopkgtest code: https://salsa.debian.org/a-wai/gnome-metronome/-/blob/debian/master/debian/tests/control Example 2 ========= https://ubuntu-archive-team.ubuntu.com/proposed-migration/update_excuses.html#webkit2gtk does not show that the 2.41 series of webkit2gtk triggered an autopkgtest failure for devhelp https://autopkgtest.ubuntu.com/packages/devhelp/mantic/amd64 However, Debian's britney is showing the failure: https://release.debian.org/britney/pseudo-excuses-experimental.html#webkit2gtk Here's the devhelp autopkgetst code: https://salsa.debian.org/gnome-team/devhelp/-/blob/debian/latest/debian/tests/control Theory ====== My theory is that failures are being ignored for packages which only have superficial autopkgtests, like for devhelp and gnome-metronome. Possibly, this issue has been fixed in Debian's copy of britney already To manage notifications about this bug go to: https://bugs.launchpad.net/auto-package-testing/+bug/2035101/+subscriptions -- Mailing list: https://launchpad.net/~canonical-ubuntu-qa Post to : [email protected] Unsubscribe : https://launchpad.net/~canonical-ubuntu-qa More help : https://help.launchpad.net/ListHelp
