Public bug reported:

[Impact]

 * linux autopkgtest should only execute either rebuild tests, when triggered 
by toolchain.
   or execute regression suite when triggered by meta
   but never both. As otherwise, it results in false negative results for the 
kernel

[Test Case]

 * Trigger adt test of linux with a matching linux-meta. Check that
rebuild test is skipped, and that the regression suite test runs.

 * trigger adt test of linux with triggered by gcc-6/7/8 (as
appropriate) and observe that rebuild test runs, and regression suite
test is skipped.

 * (when this is applied to flavours) trigger adt test of linux-* with a
matching flavour meta, and check that regression test-suite is skipped
on kernels that cannot boot in scaling stack (e.g. gcp, azure, aws, etc)

[Fix]

 * debian/tests/* are modified to pay more attention as to what they are
triggered by, and raise appropriate skipped error codes

[Regression Potential]

 * incorrect tests may run at incorrect time is the regression potential
here, hence the two test cases verify that the right tests are executed
when expected.

 * care was taken to take into account all linux kernel flavours, hence
the third test case need to be reverified on flavoured kernels.

[Other Info]

 * affects all stable series xenial and up, across all kernel flavours

** Affects: linux (Ubuntu)
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1823056

Title:
  autopkgtests run too often, too much and don't skip enough

Status in linux package in Ubuntu:
  New

Bug description:
  [Impact]

   * linux autopkgtest should only execute either rebuild tests, when triggered 
by toolchain.
     or execute regression suite when triggered by meta
     but never both. As otherwise, it results in false negative results for the 
kernel

  [Test Case]

   * Trigger adt test of linux with a matching linux-meta. Check that
  rebuild test is skipped, and that the regression suite test runs.

   * trigger adt test of linux with triggered by gcc-6/7/8 (as
  appropriate) and observe that rebuild test runs, and regression suite
  test is skipped.

   * (when this is applied to flavours) trigger adt test of linux-* with
  a matching flavour meta, and check that regression test-suite is
  skipped on kernels that cannot boot in scaling stack (e.g. gcp, azure,
  aws, etc)

  [Fix]

   * debian/tests/* are modified to pay more attention as to what they
  are triggered by, and raise appropriate skipped error codes

  [Regression Potential]

   * incorrect tests may run at incorrect time is the regression
  potential here, hence the two test cases verify that the right tests
  are executed when expected.

   * care was taken to take into account all linux kernel flavours,
  hence the third test case need to be reverified on flavoured kernels.

  [Other Info]

   * affects all stable series xenial and up, across all kernel flavours

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1823056/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to     : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp

Reply via email to