[issue39104] ProcessPoolExecutor hangs on shutdown nowait with pickling failure

[STINNER Victor]

STINNER Victor  added the comment:

> bpo-39104: Fix hanging ProcessPoolExecutor on shutdown nowait with pickling 
> failure (GH-17670)
> https://github.com/python/cpython/commit/a5cbab552d294d99fde864306632d7e511a75d3c

ProcessPoolSpawnProcessPoolExecutorTest.test_killed_child() of 
test_concurrent_futures started to fail randomly since this change: see 
bpo-39995.

--
nosy: +vstinner

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue39104] ProcessPoolExecutor hangs on shutdown nowait with pickling failure

[Antoine Pitrou]

Antoine Pitrou  added the comment:

Thank you Thomas. Ii'd rather not backport delicate changes, so closing now.

--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
type:  -> behavior
versions:  -Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue39104] ProcessPoolExecutor hangs on shutdown nowait with pickling failure

[miss-islington]

miss-islington  added the comment:


New changeset a5cbab552d294d99fde864306632d7e511a75d3c by Thomas Moreau in 
branch 'master':
bpo-39104: Fix hanging ProcessPoolExecutor on shutdown nowait with pickling 
failure (GH-17670)
https://github.com/python/cpython/commit/a5cbab552d294d99fde864306632d7e511a75d3c


--
nosy: +miss-islington

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue39104] ProcessPoolExecutor hangs on shutdown nowait with pickling failure

[Patrick Buxton]

Change by Patrick Buxton :


--
nosy: +bquinlan

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue39104] ProcessPoolExecutor hangs on shutdown nowait with pickling failure

[Patrick Buxton]

Patrick Buxton  added the comment:

Added core developer to get some feedback

--
nosy: +patbuxton, pitrou

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue39104] ProcessPoolExecutor hangs on shutdown nowait with pickling failure

[Thomas Moreau]

Change by Thomas Moreau :


--
keywords: +patch
pull_requests: +17134
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/17670

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue39104] ProcessPoolExecutor hangs on shutdown nowait with pickling failure

[Thomas Moreau]

New submission from Thomas Moreau :

The attached scripts hangs on python3.7+.
This is due to the fact that the main process closes the communication channels 
directly while the queue_management_thread might still use them.

To prevent that, all the closing should be handled by the 
queue_management_thread.

--
components: Library (Lib)
files: main.py
messages: 358697
nosy: tomMoral
priority: normal
severity: normal
status: open
title: ProcessPoolExecutor hangs on shutdown nowait with pickling failure
versions: Python 3.7, Python 3.8, Python 3.9
Added file: https://bugs.python.org/file48794/main.py

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com