Bug#925879: reprotest: flaky autopkgtest: Unknown encoding 'RK1048' at /usr/bin/help2man line 56.
Hi, On Tue, 06 Oct 2020 11:34:48 -0700 Vagrant Cascadian wrote: On 2019-03-27, Paul Gevers wrote: > Since the introduction of 0.7.8 the autopkgtest of reprotest sometimes > fails in unstable and testing, while a retry not much later succeeds. > Because the unstable-to-testing migration software now blocks on > regressions in testing, flaky tests, i.e. tests that flip between > passing and failing without changes to the list of installed packages, > are wasting peoples time. Please either fix the test to be more robust, > or mark this particular test as "flaky". In the short term, probably worth marking as flaky... > I: pybuild base:217: python3.7 setup.py config > I: pybuild base:217: /usr/bin/python3 setup.py build > Unknown encoding 'RK1048' at /usr/bin/help2man line 56. > I: pybuild base:217: /usr/bin/python3 setup.py install --root This is probably triggered because reprotest randomly picks a locale to run: loc = random.choice(['fr_CH.UTF-8', 'es_ES', 'ru_RU.CP1251', 'kk_KZ.RK1048', 'zh_CN']) It might be better to adjust the test to only test specific locales, which may require adjusting the code a bit. Testing locales entirely randomly also results in reprotest producing inconsisent tests when using it... so it's not surprising that it's also inconsistent in the autopkgtests. live well, vagrant Bug #894126 (help2man bug about this) got closed (supposedly fixed) recently. Does that mean this issue should be fixed too? Paul OpenPGP_signature Description: OpenPGP digital signature
Bug#925879: reprotest: flaky autopkgtest: Unknown encoding 'RK1048' at /usr/bin/help2man line 56.
On 2019-03-27, Paul Gevers wrote: > Since the introduction of 0.7.8 the autopkgtest of reprotest sometimes > fails in unstable and testing, while a retry not much later succeeds. > Because the unstable-to-testing migration software now blocks on > regressions in testing, flaky tests, i.e. tests that flip between > passing and failing without changes to the list of installed packages, > are wasting peoples time. Please either fix the test to be more robust, > or mark this particular test as "flaky". In the short term, probably worth marking as flaky... > I: pybuild base:217: python3.7 setup.py config > I: pybuild base:217: /usr/bin/python3 setup.py build > Unknown encoding 'RK1048' at /usr/bin/help2man line 56. > I: pybuild base:217: /usr/bin/python3 setup.py install --root This is probably triggered because reprotest randomly picks a locale to run: loc = random.choice(['fr_CH.UTF-8', 'es_ES', 'ru_RU.CP1251', 'kk_KZ.RK1048', 'zh_CN']) It might be better to adjust the test to only test specific locales, which may require adjusting the code a bit. Testing locales entirely randomly also results in reprotest producing inconsisent tests when using it... so it's not surprising that it's also inconsistent in the autopkgtests. live well, vagrant signature.asc Description: PGP signature
Bug#925879: reprotest: flaky autopkgtest: Unknown encoding 'RK1048' at /usr/bin/help2man line 56.
Source: reprotest Version: 0.7.8 Severity: important X-Debbugs-CC: debian...@lists.debian.org User: debian...@lists.debian.org Usertags: flaky Dear maintainers, Since the introduction of 0.7.8 the autopkgtest of reprotest sometimes fails in unstable and testing, while a retry not much later succeeds. Because the unstable-to-testing migration software now blocks on regressions in testing, flaky tests, i.e. tests that flip between passing and failing without changes to the list of installed packages, are wasting peoples time. Please either fix the test to be more robust, or mark this particular test as "flaky". I copied some of the output at the bottom of this report. For the failures I inspected the failure always seems to be on the same place. More information about this bug and the reason for filing it can be found on https://wiki.debian.org/ContinuousIntegration/RegressionEmailInformation Paul https://ci.debian.net/data/autopkgtest/testing/amd64/r/reprotest/2089644/log.gz running install_scripts Installing reprotest script to /tmp/reprotest.6zIS1E/build-experiment-1/debian/reprotest/usr/bin dh_installdocs -O--buildsystem=pybuild dh_installchangelogs -O--buildsystem=pybuild dh_installman -O--buildsystem=pybuild dh_python3 -O--buildsystem=pybuild dh_installinit -O--buildsystem=pybuild dh_perl -O--buildsystem=pybuild dh_link -O--buildsystem=pybuild dh_strip_nondeterminism -O--buildsystem=pybuild dh_compress -O--buildsystem=pybuild dh_fixperms -O--buildsystem=pybuild dh_missing -O--buildsystem=pybuild dh_installdeb -O--buildsystem=pybuild dh_gencontrol -O--buildsystem=pybuild dh_md5sums -O--buildsystem=pybuild dh_builddeb -O--buildsystem=pybuild dpkg-deb: building package 'reprotest' in '../reprotest_0.7.8_all.deb'. make[1]�: on quitte le repertoire ��/tmp/reprotest.6zIS1E/build-experiment-1�� dpkg-buildpackage: info: envoi d'un binaire seulement (aucune inclusion de code source) Binary files /tmp/tmp077cc2f3/control/reprotest_0.7.8_all.deb and /tmp/tmp077cc2f3/experiment-1/reprotest_0.7.8_all.deb differ - Captured stderr call - dpkg-source --before-build . debian/rules binary I: pybuild base:217: python3.7 setup.py config I: pybuild base:217: /usr/bin/python3 setup.py build I: pybuild base:217: /usr/bin/python3 setup.py install --root /tmp/reprotest.6zIS1E/const_build_path/debian/reprotest dpkg-genbuildinfo --build=binary dpkg-genchanges --build=binary >../reprotest_0.7.8_amd64.changes dpkg-genchanges: info: binary-only upload (no source code included) dpkg-source --after-build . dpkg-source --before-build . debian/rules binary I: pybuild base:217: python3.7 setup.py config I: pybuild base:217: /usr/bin/python3 setup.py build Unknown encoding 'RK1048' at /usr/bin/help2man line 56. I: pybuild base:217: /usr/bin/python3 setup.py install --root /tmp/reprotest.6zIS1E/build-experiment-1/debian/reprotest dpkg-genbuildinfo --build=binary dpkg-genchanges --build=binary >../reprotest_0.7.8_amd64.changes dpkg-genchanges: info: envoi des binaires seulement (le code source n'est pas inclus) dpkg-source --after-build . == 1 failed, 1 passed, 19 deselected in 10.65 seconds == make: *** [debian/rules:47: autopkgtest-pytest] Error 1 signature.asc Description: OpenPGP digital signature
