Your message dated Mon, 01 Feb 2021 04:48:53 +0000
with message-id <[email protected]>
and subject line Bug#955772: fixed in dask.distributed 2021.01.0+ds.1-1
has caused the Debian Bug report #955772,
regarding dask.distributed: flaky autopkgtest: timeout reached in
test_robust_to_bad_sizeof_estimates
to be marked as done.
This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.
(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact [email protected]
immediately.)
--
955772: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=955772
Debian Bug Tracking System
Contact [email protected] with problems
--- Begin Message ---
Source: dask.distributed
Version: 2.10.0+ds.1-3
Severity: serious
Tags: sid bullseye
X-Debbugs-CC: [email protected]
User: [email protected]
Usertags: flaky
Dear maintainer(s),
You package has an autopkgtest, great. However, until recently it always
failed. With the upload of 2.10.0+ds.1-3 it now *sometimes* passes.
Because the unstable-to-testing migration software now blocks on
regressions in testing, flaky tests, i.e. tests that flip between
passing and failing without changes to the list of installed packages,
are causing people unrelated to your package to spend time on these
tests. Please either fix the test to be more robust, or or use the
"flaky" restriction for the offending test until a solution has been found.
I copied the output at the bottom of this report. All the failing tests
that I inspected look like it.
I'll have the migration software ignore the results of your autopkgtest
until this bug is fixed.
Paul
https://ci.debian.net/data/autopkgtest/testing/amd64/d/dask.distributed/4801510/log.gz
=================================== FAILURES
===================================
_____________________ test_robust_to_bad_sizeof_estimates
______________________
def test_func():
result = None
workers = []
with clean(timeout=active_rpc_timeout, **clean_kwargs) as loop:
async def coro():
with dask.config.set(config):
s = False
for i in range(5):
try:
s, ws = await start_cluster(
nthreads,
scheduler,
loop,
security=security,
Worker=Worker,
scheduler_kwargs=scheduler_kwargs,
worker_kwargs=worker_kwargs,
)
except Exception as e:
logger.error(
"Failed to start gen_cluster, retrying",
exc_info=True,
)
else:
workers[:] = ws
args = [s] + workers
break
if s is False:
raise Exception("Could not start cluster")
if client:
c = await Client(
s.address,
loop=loop,
security=security,
asynchronous=True,
**client_kwargs
)
args = [c] + args
try:
future = func(*args)
if timeout:
future = asyncio.wait_for(future, timeout)
result = await future
if s.validate:
s.validate_state()
finally:
if client and c.status not in ("closing", "closed"):
await c._close(fast=s.status == "closed")
await end_cluster(s, workers)
await asyncio.wait_for(cleanup_global_workers(), 1)
try:
c = await default_client()
except ValueError:
pass
else:
await c._close(fast=True)
for i in range(5):
if all(c.closed() for c in Comm._instances):
break
else:
await asyncio.sleep(0.05)
else:
L = [c for c in Comm._instances if not c.closed()]
Comm._instances.clear()
# raise ValueError("Unclosed Comms", L)
print("Unclosed Comms", L)
return result
result = loop.run_sync(
> coro, timeout=timeout * 2 if timeout else timeout
)
/usr/lib/python3/dist-packages/distributed/utils_test.py:957:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
_ _ _ _
/usr/lib/python3/dist-packages/tornado/ioloop.py:576: in run_sync
return future_cell[0].result()
/usr/lib/python3/dist-packages/distributed/utils_test.py:927: in coro
result = await future
/usr/lib/python3.7/asyncio/tasks.py:442: in wait_for
return fut.result()
/usr/lib/python3/dist-packages/tornado/gen.py:1162: in run
yielded = self.gen.send(value)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
_ _ _ _
c = <Client: not connected>
s = <Scheduler: "tcp://127.0.0.1:33643" processes: 0 cores: 0>
a = <Worker: 'tcp://127.0.0.1:40861', 0, closed, stored: 0, running:
0/1, ready: 0, comm: 0, waiting: 0>
@gen_cluster(
nthreads=[("127.0.0.1", 1)],
client=True,
worker_kwargs={"memory_monitor_interval": 10},
)
def test_robust_to_bad_sizeof_estimates(c, s, a):
np = pytest.importorskip("numpy")
memory = psutil.Process().memory_info().rss
a.memory_limit = memory / 0.7 + 400e6
class BadAccounting(object):
def __init__(self, data):
self.data = data
def __sizeof__(self):
return 10
def f(n):
x = np.ones(int(n), dtype="u1")
result = BadAccounting(x)
return result
futures = c.map(f, [100e6] * 8, pure=False)
start = time()
while not a.data.disk:
yield gen.sleep(0.1)
> assert time() < start + 5
E assert 1585911987.756759 < (1585911982.712976 + 5)
E + where 1585911987.756759 = time()
/usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1121:
AssertionError
signature.asc
Description: OpenPGP digital signature
--- End Message ---
--- Begin Message ---
Source: dask.distributed
Source-Version: 2021.01.0+ds.1-1
Done: Diane Trout <[email protected]>
We believe that the bug you reported is fixed in the latest version of
dask.distributed, which is due to be installed in the Debian FTP archive.
A summary of the changes between this version and the previous one is
attached.
Thank you for reporting the bug, which will now be closed. If you
have further comments please address them to [email protected],
and the maintainer will reopen the bug report if appropriate.
Debian distribution maintenance software
pp.
Diane Trout <[email protected]> (supplier of updated dask.distributed package)
(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing [email protected])
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512
Format: 1.8
Date: Sat, 30 Jan 2021 22:55:04 -0800
Source: dask.distributed
Architecture: source
Version: 2021.01.0+ds.1-1
Distribution: unstable
Urgency: medium
Maintainer: Debian Python Team <[email protected]>
Changed-By: Diane Trout <[email protected]>
Closes: 954507 955772 959550
Changes:
dask.distributed (2021.01.0+ds.1-1) unstable; urgency=medium
.
[ Stefano Rivera ]
* New upstream release. (Closes: #954507, 955772)
* Refresh patches.
* Bump Standards-Version to 4.5.1, no changes needed.
* Declare Rules-Requires-Root: no.
* "set -e" for shell loops in debian/rules.
* Upstream renamed directories containing .min.js, update Files-Excluded,
debiar/rules, debian/missing-sources.
* Bump python3-dask Build-Dep to >= 2020.12.0, following upstream.
* Explicitly specify the test directory, to avoid incorrect auto-detection.
* Patch: Support pytest-asyncio >= 0.14.
.
[ Ondřej Nový ]
* d/control: Update Maintainer field with new Debian Python Team
contact address.
* d/control: Update Vcs-* fields with new Debian Python Team Salsa
layout.
.
[ Diane Trout ]
* Fix typo in python-distributed-doc Depends line
* link html5shiv.min.js into _static (Closes: #959550)
* Add use-local-favicon.patch to avoid privacy leak
* Mark tests that require installation for easier skipping by adding
debian/patches/mark-test-require-installation.patch (Closes: #954507)
* Mark test that requires bokeh for easier skipping by adding
debian/patches/mark-test-requires-bokeh.patch
* There were still a few tests that didn't work in the buildd
* Remove lists of tests to skip in the autopkgtests since they all run
* Refresh patches
* Update patch descriptions and forwarded flag if missing
* Update to debhelper-compat 13
* Update path in d/copyright to missing javascript sources
* Update minimum build-dep versions for cloudpickle and toolz
* Make sure the favicon.ico file is not marked executable
* Make sure dask-worker-space directories created by tests are not
present in package
* Disable a few tests at build time
* Try running the autopkgtests with unrestricted networking
Checksums-Sha1:
fca9f150a80bfecbaf03c948f46456ae9ff2d27a 3124
dask.distributed_2021.01.0+ds.1-1.dsc
4f80e99005489a46467fbe94997585ea4e017a64 878124
dask.distributed_2021.01.0+ds.1.orig.tar.xz
108c1cc2cc68d44b00b4678f58329fb803829588 2022660
dask.distributed_2021.01.0+ds.1-1.debian.tar.xz
aa7904d58a465813d8c3c2403b8935b90804cd78 9258
dask.distributed_2021.01.0+ds.1-1_amd64.buildinfo
Checksums-Sha256:
99cb0ea7a526ae827af9c3206ab351746d0f926276a63b96e77a4aa608b031f4 3124
dask.distributed_2021.01.0+ds.1-1.dsc
8decd051720a8faaa161ac627731baf5da4284e67db76cf61977314d93f246ad 878124
dask.distributed_2021.01.0+ds.1.orig.tar.xz
5c095b964ff9f5a2b0c09312e87bad3f31d9d0b546745d60314a9aac6cf8ce3f 2022660
dask.distributed_2021.01.0+ds.1-1.debian.tar.xz
33de13b02d58cc3b7996cc529c29662beb5e823d93f22b6915c9419a6378302d 9258
dask.distributed_2021.01.0+ds.1-1_amd64.buildinfo
Files:
850f022f2c50b9769b7e27c0a190c25c 3124 python optional
dask.distributed_2021.01.0+ds.1-1.dsc
6a400c18280e6fe8a917ff0f23f61642 878124 python optional
dask.distributed_2021.01.0+ds.1.orig.tar.xz
90bdac636ad1868b8c445e3af34f5479 2022660 python optional
dask.distributed_2021.01.0+ds.1-1.debian.tar.xz
bdea1ea9926caf81b2a2e1c9f3582f2d 9258 python optional
dask.distributed_2021.01.0+ds.1-1_amd64.buildinfo
-----BEGIN PGP SIGNATURE-----
iQIzBAEBCgAdFiEETQVcMeSBIEX5AQ11mQ04NnM013AFAmAXg44ACgkQmQ04NnM0
13CzFBAAsXTHtKak9p0lKoY7biItkD8T2HgwLC31SqOY/ojJbZlaok79eWZdcrOR
74U+jnhMkjr6SVf6oQTYmw9IlJ/YrA1M2HCJU7F52v71VLqmbc6Wlt5RwgSVNNYH
0BncjMoxEZIWnf2GSveDr1SGFnOWwY/3ojISH41cxQd41PhaEPqZw5hxoHQQQxcE
kFHiIQQxKt3xjI8UO+Rqe0eE+8wqtzArDH9ZcrmSHPVwcpvyRJXIFZkqXJtaGQRC
oMbOX+CWcmkXw3I+YTH6F2VbnNGGQbnaNvKpXtWqSK/FY2gk5z3EzJbn1ES0Uz7M
53MxEYRIlNdafetmdTsrMybpJmR64GCPiNasuI5GOlgwZALvHfwKXWNEPXT5R/1m
Ft/NT3O6OtcFb9eeCzNSJu7j0xvJkZqzDdALIHEzwt+Leo4nZ/hvKT0YMiwYIt4r
23omnzJB4MNXoxoy1bKBzb0tqQEwukWlE3CLeUA+LS3irm/p8bGJNCZhIMEol//S
JCrtklDfzjASVitwUsrgNtv3p1SpDtyZQ1fWnYr7RNEHoFaOWlxl5tDq0nIFN1Hr
cOjzYBrhwA7tuRD5sq45sGWnXO3M+nlLl4VZSLg7L+I+rDqrkdEn0iCxXDOVnh6G
ZNQhAC1cGrZEPNuxqXs0x8KyWeTKJNym13PoNpE9thOp9qofE30=
=46yT
-----END PGP SIGNATURE-----
--- End Message ---
_______________________________________________
Python-modules-team mailing list
[email protected]
https://alioth-lists.debian.net/cgi-bin/mailman/listinfo/python-modules-team
