[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-20 Thread STINNER Victor 


STINNER Victor  added the comment:

The first implementation of my PR also emitted ResourceWarning when .join() 
hasn't been called, but the merged PR only emit a warning if .close() and 
.terminated() have not been called: if the pool is still running.

--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-20 Thread STINNER Victor 


STINNER Victor  added the comment:


New changeset 9a8d1d7562b11969034b92217fe66aab7a951fb6 by Victor Stinner in 
branch 'master':
bpo-35424: emit ResourceWarning at multiprocessing.Pool destruction (GH-10974)
https://github.com/python/cpython/commit/9a8d1d7562b11969034b92217fe66aab7a951fb6


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-18 Thread STINNER Victor 


STINNER Victor  added the comment:


New changeset c74e7c48ba4f8437d4c8b402098b8cefc33a28a9 by Victor Stinner (Miss 
Islington (bot)) in branch '3.7':
bpo-35424: Fix test_multiprocessing_main_handling (GH-11223) (GH-11227)
https://github.com/python/cpython/commit/c74e7c48ba4f8437d4c8b402098b8cefc33a28a9


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-18 Thread miss-islington 


Change by miss-islington :


--
pull_requests: +10462

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-18 Thread STINNER Victor 


STINNER Victor  added the comment:


New changeset 6cdce3ddef805e11d75142f3e20e23c3fe21fdf4 by Victor Stinner in 
branch 'master':
bpo-35424: Fix test_multiprocessing_main_handling (GH-11223)
https://github.com/python/cpython/commit/6cdce3ddef805e11d75142f3e20e23c3fe21fdf4


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-18 Thread STINNER Victor 


Change by STINNER Victor :


--
pull_requests: +10458

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-14 Thread STINNER Victor 


STINNER Victor  added the comment:

See this discussion:
[Python-Dev] Usage of the multiprocessing API and object lifetime
https://mail.python.org/pipermail/python-dev/2018-December/155946.html

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-06 Thread miss-islington 


miss-islington  added the comment:


New changeset e44b5b2afa6fe2966d8caff45e36c0980413bb86 by Miss Islington (bot) 
in branch '3.6':
bpo-35424: test_multiprocessing: join 3 pools (GH-10986)
https://github.com/python/cpython/commit/e44b5b2afa6fe2966d8caff45e36c0980413bb86


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-06 Thread miss-islington 


miss-islington  added the comment:


New changeset b7c67c4d510a7a72a35983cc168dbb2ce796cb8c by Miss Islington (bot) 
in branch '3.7':
bpo-35424: test_multiprocessing: join 3 pools (GH-10986)
https://github.com/python/cpython/commit/b7c67c4d510a7a72a35983cc168dbb2ce796cb8c


--
nosy: +miss-islington

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-06 Thread miss-islington 


Change by miss-islington :


--
pull_requests: +10228

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-06 Thread miss-islington 


Change by miss-islington :


--
pull_requests: +10229

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-06 Thread STINNER Victor 


STINNER Victor  added the comment:


New changeset 388c8c208d9d09bd28289c1e4776b947d4d0f0f0 by Victor Stinner in 
branch 'master':
bpo-35424: test_multiprocessing: join 3 pools (GH-10986)
https://github.com/python/cpython/commit/388c8c208d9d09bd28289c1e4776b947d4d0f0f0


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-06 Thread STINNER Victor 


STINNER Victor  added the comment:

While testing PR 10974, I found two tests which emits ResourceWarning. I wrote 
10986 to fix them.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-06 Thread STINNER Victor 


Change by STINNER Victor :


--
pull_requests: +10227

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-05 Thread STINNER Victor 


Change by STINNER Victor :


--
keywords: +patch
pull_requests: +10216
stage:  -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35424] multiprocessing.Pool: emit ResourceWarning

2018-12-05 Thread STINNER Victor 


New submission from STINNER Victor :

Since 2 years, I'm fixing frequently "dangling thread" and "dangling process" 
warnings on buildbots. These bugs are really hard to reproduce. They usually 
require to get access to a specific buildbot, simulate a specific workload, and 
get the proper timing to get the warning.

I propose to emit a ResourceWarning in multiprocessing.Pool destructor if the 
pool has not been cleaned properly. I'm not sure in which cases a warning 
should be emitted.

Attached PR is a WIP implementation.

--
components: Tests
messages: 331201
nosy: pablogsal, vstinner
priority: normal
severity: normal
status: open
title: multiprocessing.Pool: emit ResourceWarning
versions: Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com