Your message dated Mon, 01 Feb 2021 04:48:53 +0000 with message-id <e1l6r8v-000cbj...@fasolo.debian.org> and subject line Bug#955772: fixed in dask.distributed 2021.01.0+ds.1-1 has caused the Debian Bug report #955772, regarding dask.distributed: flaky autopkgtest: timeout reached in test_robust_to_bad_sizeof_estimates to be marked as done.
This means that you claim that the problem has been dealt with. If this is not the case it is now your responsibility to reopen the Bug report if necessary, and/or fix the problem forthwith. (NB: If you are a system administrator and have no idea what this message is talking about, this may indicate a serious mail system misconfiguration somewhere. Please contact ow...@bugs.debian.org immediately.) -- 955772: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=955772 Debian Bug Tracking System Contact ow...@bugs.debian.org with problems
--- Begin Message ---Source: dask.distributed Version: 2.10.0+ds.1-3 Severity: serious Tags: sid bullseye X-Debbugs-CC: debian...@lists.debian.org User: debian...@lists.debian.org Usertags: flaky Dear maintainer(s), You package has an autopkgtest, great. However, until recently it always failed. With the upload of 2.10.0+ds.1-3 it now *sometimes* passes. Because the unstable-to-testing migration software now blocks on regressions in testing, flaky tests, i.e. tests that flip between passing and failing without changes to the list of installed packages, are causing people unrelated to your package to spend time on these tests. Please either fix the test to be more robust, or or use the "flaky" restriction for the offending test until a solution has been found. I copied the output at the bottom of this report. All the failing tests that I inspected look like it. I'll have the migration software ignore the results of your autopkgtest until this bug is fixed. Paul https://ci.debian.net/data/autopkgtest/testing/amd64/d/dask.distributed/4801510/log.gz =================================== FAILURES =================================== _____________________ test_robust_to_bad_sizeof_estimates ______________________ def test_func(): result = None workers = [] with clean(timeout=active_rpc_timeout, **clean_kwargs) as loop: async def coro(): with dask.config.set(config): s = False for i in range(5): try: s, ws = await start_cluster( nthreads, scheduler, loop, security=security, Worker=Worker, scheduler_kwargs=scheduler_kwargs, worker_kwargs=worker_kwargs, ) except Exception as e: logger.error( "Failed to start gen_cluster, retrying", exc_info=True, ) else: workers[:] = ws args = [s] + workers break if s is False: raise Exception("Could not start cluster") if client: c = await Client( s.address, loop=loop, security=security, asynchronous=True, **client_kwargs ) args = [c] + args try: future = func(*args) if timeout: future = asyncio.wait_for(future, timeout) result = await future if s.validate: s.validate_state() finally: if client and c.status not in ("closing", "closed"): await c._close(fast=s.status == "closed") await end_cluster(s, workers) await asyncio.wait_for(cleanup_global_workers(), 1) try: c = await default_client() except ValueError: pass else: await c._close(fast=True) for i in range(5): if all(c.closed() for c in Comm._instances): break else: await asyncio.sleep(0.05) else: L = [c for c in Comm._instances if not c.closed()] Comm._instances.clear() # raise ValueError("Unclosed Comms", L) print("Unclosed Comms", L) return result result = loop.run_sync( > coro, timeout=timeout * 2 if timeout else timeout ) /usr/lib/python3/dist-packages/distributed/utils_test.py:957: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib/python3/dist-packages/tornado/ioloop.py:576: in run_sync return future_cell[0].result() /usr/lib/python3/dist-packages/distributed/utils_test.py:927: in coro result = await future /usr/lib/python3.7/asyncio/tasks.py:442: in wait_for return fut.result() /usr/lib/python3/dist-packages/tornado/gen.py:1162: in run yielded = self.gen.send(value) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ c = <Client: not connected> s = <Scheduler: "tcp://127.0.0.1:33643" processes: 0 cores: 0> a = <Worker: 'tcp://127.0.0.1:40861', 0, closed, stored: 0, running: 0/1, ready: 0, comm: 0, waiting: 0> @gen_cluster( nthreads=[("127.0.0.1", 1)], client=True, worker_kwargs={"memory_monitor_interval": 10}, ) def test_robust_to_bad_sizeof_estimates(c, s, a): np = pytest.importorskip("numpy") memory = psutil.Process().memory_info().rss a.memory_limit = memory / 0.7 + 400e6 class BadAccounting(object): def __init__(self, data): self.data = data def __sizeof__(self): return 10 def f(n): x = np.ones(int(n), dtype="u1") result = BadAccounting(x) return result futures = c.map(f, [100e6] * 8, pure=False) start = time() while not a.data.disk: yield gen.sleep(0.1) > assert time() < start + 5 E assert 1585911987.756759 < (1585911982.712976 + 5) E + where 1585911987.756759 = time() /usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1121: AssertionError
signature.asc
Description: OpenPGP digital signature
--- End Message ---
--- Begin Message ---Source: dask.distributed Source-Version: 2021.01.0+ds.1-1 Done: Diane Trout <di...@ghic.org> We believe that the bug you reported is fixed in the latest version of dask.distributed, which is due to be installed in the Debian FTP archive. A summary of the changes between this version and the previous one is attached. Thank you for reporting the bug, which will now be closed. If you have further comments please address them to 955...@bugs.debian.org, and the maintainer will reopen the bug report if appropriate. Debian distribution maintenance software pp. Diane Trout <di...@ghic.org> (supplier of updated dask.distributed package) (This message was generated automatically at their request; if you believe that there is a problem with it please contact the archive administrators by mailing ftpmas...@ftp-master.debian.org) -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Format: 1.8 Date: Sat, 30 Jan 2021 22:55:04 -0800 Source: dask.distributed Architecture: source Version: 2021.01.0+ds.1-1 Distribution: unstable Urgency: medium Maintainer: Debian Python Team <team+pyt...@tracker.debian.org> Changed-By: Diane Trout <di...@ghic.org> Closes: 954507 955772 959550 Changes: dask.distributed (2021.01.0+ds.1-1) unstable; urgency=medium . [ Stefano Rivera ] * New upstream release. (Closes: #954507, 955772) * Refresh patches. * Bump Standards-Version to 4.5.1, no changes needed. * Declare Rules-Requires-Root: no. * "set -e" for shell loops in debian/rules. * Upstream renamed directories containing .min.js, update Files-Excluded, debiar/rules, debian/missing-sources. * Bump python3-dask Build-Dep to >= 2020.12.0, following upstream. * Explicitly specify the test directory, to avoid incorrect auto-detection. * Patch: Support pytest-asyncio >= 0.14. . [ Ondřej Nový ] * d/control: Update Maintainer field with new Debian Python Team contact address. * d/control: Update Vcs-* fields with new Debian Python Team Salsa layout. . [ Diane Trout ] * Fix typo in python-distributed-doc Depends line * link html5shiv.min.js into _static (Closes: #959550) * Add use-local-favicon.patch to avoid privacy leak * Mark tests that require installation for easier skipping by adding debian/patches/mark-test-require-installation.patch (Closes: #954507) * Mark test that requires bokeh for easier skipping by adding debian/patches/mark-test-requires-bokeh.patch * There were still a few tests that didn't work in the buildd * Remove lists of tests to skip in the autopkgtests since they all run * Refresh patches * Update patch descriptions and forwarded flag if missing * Update to debhelper-compat 13 * Update path in d/copyright to missing javascript sources * Update minimum build-dep versions for cloudpickle and toolz * Make sure the favicon.ico file is not marked executable * Make sure dask-worker-space directories created by tests are not present in package * Disable a few tests at build time * Try running the autopkgtests with unrestricted networking Checksums-Sha1: fca9f150a80bfecbaf03c948f46456ae9ff2d27a 3124 dask.distributed_2021.01.0+ds.1-1.dsc 4f80e99005489a46467fbe94997585ea4e017a64 878124 dask.distributed_2021.01.0+ds.1.orig.tar.xz 108c1cc2cc68d44b00b4678f58329fb803829588 2022660 dask.distributed_2021.01.0+ds.1-1.debian.tar.xz aa7904d58a465813d8c3c2403b8935b90804cd78 9258 dask.distributed_2021.01.0+ds.1-1_amd64.buildinfo Checksums-Sha256: 99cb0ea7a526ae827af9c3206ab351746d0f926276a63b96e77a4aa608b031f4 3124 dask.distributed_2021.01.0+ds.1-1.dsc 8decd051720a8faaa161ac627731baf5da4284e67db76cf61977314d93f246ad 878124 dask.distributed_2021.01.0+ds.1.orig.tar.xz 5c095b964ff9f5a2b0c09312e87bad3f31d9d0b546745d60314a9aac6cf8ce3f 2022660 dask.distributed_2021.01.0+ds.1-1.debian.tar.xz 33de13b02d58cc3b7996cc529c29662beb5e823d93f22b6915c9419a6378302d 9258 dask.distributed_2021.01.0+ds.1-1_amd64.buildinfo Files: 850f022f2c50b9769b7e27c0a190c25c 3124 python optional dask.distributed_2021.01.0+ds.1-1.dsc 6a400c18280e6fe8a917ff0f23f61642 878124 python optional dask.distributed_2021.01.0+ds.1.orig.tar.xz 90bdac636ad1868b8c445e3af34f5479 2022660 python optional dask.distributed_2021.01.0+ds.1-1.debian.tar.xz bdea1ea9926caf81b2a2e1c9f3582f2d 9258 python optional dask.distributed_2021.01.0+ds.1-1_amd64.buildinfo -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEETQVcMeSBIEX5AQ11mQ04NnM013AFAmAXg44ACgkQmQ04NnM0 13CzFBAAsXTHtKak9p0lKoY7biItkD8T2HgwLC31SqOY/ojJbZlaok79eWZdcrOR 74U+jnhMkjr6SVf6oQTYmw9IlJ/YrA1M2HCJU7F52v71VLqmbc6Wlt5RwgSVNNYH 0BncjMoxEZIWnf2GSveDr1SGFnOWwY/3ojISH41cxQd41PhaEPqZw5hxoHQQQxcE kFHiIQQxKt3xjI8UO+Rqe0eE+8wqtzArDH9ZcrmSHPVwcpvyRJXIFZkqXJtaGQRC oMbOX+CWcmkXw3I+YTH6F2VbnNGGQbnaNvKpXtWqSK/FY2gk5z3EzJbn1ES0Uz7M 53MxEYRIlNdafetmdTsrMybpJmR64GCPiNasuI5GOlgwZALvHfwKXWNEPXT5R/1m Ft/NT3O6OtcFb9eeCzNSJu7j0xvJkZqzDdALIHEzwt+Leo4nZ/hvKT0YMiwYIt4r 23omnzJB4MNXoxoy1bKBzb0tqQEwukWlE3CLeUA+LS3irm/p8bGJNCZhIMEol//S JCrtklDfzjASVitwUsrgNtv3p1SpDtyZQ1fWnYr7RNEHoFaOWlxl5tDq0nIFN1Hr cOjzYBrhwA7tuRD5sq45sGWnXO3M+nlLl4VZSLg7L+I+rDqrkdEn0iCxXDOVnh6G ZNQhAC1cGrZEPNuxqXs0x8KyWeTKJNym13PoNpE9thOp9qofE30= =46yT -----END PGP SIGNATURE-----
--- End Message ---
