Your message dated Thu, 12 Nov 2020 21:48:44 +0000
with message-id <[email protected]>
and subject line Bug#974437: fixed in artemis 18.1.0+dfsg-2
has caused the Debian Bug report #974437,
regarding artemis: autopkgtest must be marked superficial
to be marked as done.
This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.
(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact [email protected]
immediately.)
--
974437: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=974437
Debian Bug Tracking System
Contact [email protected] with problems
--- Begin Message ---
Source: artemis
X-Debbugs-CC: [email protected]
Severity: important
Usertags: superficialtest
Dear Maintainer,
It has been noticed that the autopkgtest in artemis is running a
trivial command that does not provide significant test coverage:
- xvfb-run --auto-servernum --server-args="-screen 0 1024x768x24"
/usr/bin/bamview -h
Executing that command is considered to be a trivial test, which
does not provide significant coverage for a package as a whole.
But these tests are a useful way to detect regressions in dependencies
and prevent them from breaking your package.
However, it is important that we are realistic about the level of
test coverage provided by these commands: most regressions cannot be
detected in this way. So it is not appropriate for packages with only
superficial tests to have the reduced migration time to migrate from
unstable to testing as that means less opportunity for testing by users
compared to the package with no tests.
To support this, the keyword "Restrictions: superficial" has been
defined [1]. Packages where all tests are marked with this keyword are not
considered for the reduced migration age from unstable to testing, and
will not be allowed to migrate automatically in later stages of the
freeze [2].
Its always better to have more extensive testing than having
superficial testing, which again is better than having no test.
Please consider i) Adding a non-trivial test, and/or ii) Mark the
trivial test with "Restrictions: superficial", similar to
[3] or [4].
The Release Team has listed this issue in the list of Release Critical
Issues for bullseye [5] and has mentioned that the test must be marked
superficial if it is not testing one of its own installed binary
packages in some way. As a result, the severity of this bug report might
be increased to serious in future.
[1]
https://salsa.debian.org/ci-team/autopkgtest/-/blob/master/doc/README.package-tests.rst#defined-restrictions
[2] https://release.debian.org/bullseye/freeze_policy.html
[3]
https://salsa.debian.org/utopia-team/dbus/-/commit/a80908df7d119b181eec5eb0542634a30c2ad468
[4]
https://salsa.debian.org/apparmor-team/apparmor/-/commit/580667513a097088ebe579884b38ac8d8666d3b3
[5] https://release.debian.org/bullseye/rc_policy.txt
--
Regards
Sudip
--- End Message ---
--- Begin Message ---
Source: artemis
Source-Version: 18.1.0+dfsg-2
Done: Pierre Gruet <[email protected]>
We believe that the bug you reported is fixed in the latest version of
artemis, which is due to be installed in the Debian FTP archive.
A summary of the changes between this version and the previous one is
attached.
Thank you for reporting the bug, which will now be closed. If you
have further comments please address them to [email protected],
and the maintainer will reopen the bug report if appropriate.
Debian distribution maintenance software
pp.
Pierre Gruet <[email protected]> (supplier of updated artemis package)
(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing [email protected])
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512
Format: 1.8
Date: Thu, 12 Nov 2020 21:44:47 +0100
Source: artemis
Architecture: source
Version: 18.1.0+dfsg-2
Distribution: unstable
Urgency: medium
Maintainer: Debian Med Packaging Team
<[email protected]>
Changed-By: Pierre Gruet <[email protected]>
Closes: 974437
Changes:
artemis (18.1.0+dfsg-2) unstable; urgency=medium
.
* Marking current autopkgtest as superficial (Closes: #974437)
* Adding an autopkgtest running some build tests
Checksums-Sha1:
378222cd8a0569760041350e1b1295320dc213f9 2656 artemis_18.1.0+dfsg-2.dsc
60e369c29d5ff61f9ca110d77f14ad5107dd6dbd 14596
artemis_18.1.0+dfsg-2.debian.tar.xz
0da524a53cc60e9dc2aaaf9b42587894cf965c19 17744
artemis_18.1.0+dfsg-2_amd64.buildinfo
Checksums-Sha256:
f0f0dfe16af87cf6cbd72608b4e3dfb4d77931b2620f5d9f16a760feee1613bc 2656
artemis_18.1.0+dfsg-2.dsc
17725f358010d1c6b4dc8222eb771741910d8a6644f67d0999152f926bef302e 14596
artemis_18.1.0+dfsg-2.debian.tar.xz
8ee6d3387836e3e86616fb11f86b2d97b6d0386ccefa7d807b3a8df83e10fde0 17744
artemis_18.1.0+dfsg-2_amd64.buildinfo
Files:
9c73776def91558df835d31f494d4c62 2656 science optional
artemis_18.1.0+dfsg-2.dsc
4ea09602288350694f60a42520d1faa8 14596 science optional
artemis_18.1.0+dfsg-2.debian.tar.xz
d9a85e1b0f5bfeb1df8f7f6bffb303c0 17744 science optional
artemis_18.1.0+dfsg-2_amd64.buildinfo
-----BEGIN PGP SIGNATURE-----
iQIzBAEBCgAdFiEEM8soQxPpC9J9y0UjYAMWptwndHYFAl+tp9kACgkQYAMWptwn
dHbZpA/+M/LDqCa5skHupOwOJSNHrUai9cq4SZ8HZZArszohGE5r6kvBk13/J1Xr
zMqhRyelhYPV75hHXJNRoiLuqH+zXp6yRBjVbOLFTqwUSmG6Kg7J9NYGrU8R6ZM4
aTNM2rgHe+vv5ut6cn7tzJGyk2N4hytsRrQcae43d3GRXajLPr/1SqilTjzpx0hC
AQsrOoog4q8o129KJT+ZhVR+xWY4uEuEShbrZ6pTbqkeZE+0tfTX02bpcA4lT2L1
Xc9hAjhNhwjhlPoZzDj+c3TnqEsUepGXaykDFmVlQttlnGkS5lac2t1gdO6Yp/sq
4XODsk7FU6nmE0iBFtMJ+z63AAJaKkdo5MSwS788UODmcUSwqamcEkiswsD3xelc
Y1H91GSS7xSJasKUam050SRgj62kD6tLhQjHMeP8Rpf4cM/xgLEQWVgs+45NuzSX
z0UxX5DAjYuBD3ApaamGqZIZRtBiVGOXRxrLcMQB9Rsj/+/r08anBdTnHzn94n7c
R16gEEHPqQ1YvHNw1G2500+FVXrP380EoLdfqQJik8126LK2V+ddClaaiDRov2oi
O5JAbu9JKv7fywoki6hEX1nDwgTHYAl7JMRdCQcBMxhtXTz5XJ0A8WdaYc3O7FYq
l65TkttGz6OSQO75grXuJMpnl4n7QGGGb1yahsjPb1YolZXGO+o=
=vuw4
-----END PGP SIGNATURE-----
--- End Message ---
