Public bug reported: [Impact]
* linux autopkgtest should only execute either rebuild tests, when triggered by toolchain. or execute regression suite when triggered by meta but never both. As otherwise, it results in false negative results for the kernel [Test Case] * Trigger adt test of linux with a matching linux-meta. Check that rebuild test is skipped, and that the regression suite test runs. * trigger adt test of linux with triggered by gcc-6/7/8 (as appropriate) and observe that rebuild test runs, and regression suite test is skipped. * (when this is applied to flavours) trigger adt test of linux-* with a matching flavour meta, and check that regression test-suite is skipped on kernels that cannot boot in scaling stack (e.g. gcp, azure, aws, etc) [Fix] * debian/tests/* are modified to pay more attention as to what they are triggered by, and raise appropriate skipped error codes [Regression Potential] * incorrect tests may run at incorrect time is the regression potential here, hence the two test cases verify that the right tests are executed when expected. * care was taken to take into account all linux kernel flavours, hence the third test case need to be reverified on flavoured kernels. [Other Info] * affects all stable series xenial and up, across all kernel flavours ** Affects: linux (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1823056 Title: autopkgtests run too often, too much and don't skip enough Status in linux package in Ubuntu: New Bug description: [Impact] * linux autopkgtest should only execute either rebuild tests, when triggered by toolchain. or execute regression suite when triggered by meta but never both. As otherwise, it results in false negative results for the kernel [Test Case] * Trigger adt test of linux with a matching linux-meta. Check that rebuild test is skipped, and that the regression suite test runs. * trigger adt test of linux with triggered by gcc-6/7/8 (as appropriate) and observe that rebuild test runs, and regression suite test is skipped. * (when this is applied to flavours) trigger adt test of linux-* with a matching flavour meta, and check that regression test-suite is skipped on kernels that cannot boot in scaling stack (e.g. gcp, azure, aws, etc) [Fix] * debian/tests/* are modified to pay more attention as to what they are triggered by, and raise appropriate skipped error codes [Regression Potential] * incorrect tests may run at incorrect time is the regression potential here, hence the two test cases verify that the right tests are executed when expected. * care was taken to take into account all linux kernel flavours, hence the third test case need to be reverified on flavoured kernels. [Other Info] * affects all stable series xenial and up, across all kernel flavours To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1823056/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp