Mario, you asserted that there were jobs that "failed once and hit retry and they pass". But the links you posted are to the test runs for fwupd 1.9.1-1, which have never passed. Are you saying that there were individual tests within the two runs of 1.9.1-1/amd64 that demonstrated flakiness? (if so, which ones?) or are you referring to something else, such as the tests passing on arm64 but not amd64?
-- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is subscribed to Auto Package Testing. https://bugs.launchpad.net/bugs/2021908 Title: fwupd: network-based tests failed to run Status in Auto Package Testing: New Status in fwupd package in Ubuntu: New Bug description: `fwupd` package added network-based tests (to test whether firmware updates could be performed) since version 1.9.1. The tests failed due to the HTTP proxy blocklist (which needs access to cdn.fwupd.org). The issue was discovered in the local runner with these log lines: ..snip failed to download http://cdn.fwupd.org/downloads/01b95b0206f1a42a2bf95a432d162ef1f9f1f71edb5696127c923ceffadfdf68-a3bu-xplained123.zip: Failed to download, server response was 403: <!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd"> <html><head> <meta type="copyright" content="Copyright (C) 1996-2019 The Squid Software Foundation and contributors"> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> <title>ERROR: The requested URL could not be retrieved</title> In the Ubuntu-hosted autopkgtest runners, it failed with a cryptic message: ...snip failed to load emulation data: emulation is not allowed from config FAIL: fwupd/fwupd.test (Child process exited with code 1) To manage notifications about this bug go to: https://bugs.launchpad.net/auto-package-testing/+bug/2021908/+subscriptions -- Mailing list: https://launchpad.net/~canonical-ubuntu-qa Post to : canonical-ubuntu-qa@lists.launchpad.net Unsubscribe : https://launchpad.net/~canonical-ubuntu-qa More help : https://help.launchpad.net/ListHelp