[issue37293] concurrent.futures.InterpreterPoolExecutor

[jakirkham]

Change by jakirkham :


--
nosy: +jakirkham

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue37293] concurrent.futures.InterpreterPoolExecutor

[Eric Snow]

Eric Snow  added the comment:

@Davin, we've spoken before about something similar for multiprocessing, IIRC. 
:)

--
nosy: +davin

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue37293] concurrent.futures.InterpreterPoolExecutor

[Eric Snow]

Eric Snow  added the comment:

FWIW, performance benefits when subinterpreters stop sharing the GIL are not 
the only benefit.  In fact, PEP 554 is specifically written to avoid that 
consideration, focusing on the benefits of the concurrency model (i.e. CSP).  
So I wouldn't call this pointless even without per-interpreter GIL. :)

(Of course, this *would* be blocked on acceptance and implementation of PEP 
554.)

--
stage:  -> needs patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue37293] concurrent.futures.InterpreterPoolExecutor

[Crusader Ky]

New submission from Crusader Ky :

As one of the logical consequences to PEP 554, it would be neat to have a 
concurrent.futures.InterpreterPoolExecutor.

I wrote the initial code at https://github.com/crusaderky/subinterpreters_tests 
- currently missing unit tests and pickle5 buffers support.

If everybody is happy with the design, I'll start working on a PR as soon as 
the GIL becomes per-interpreter (it's kinda pointless before that).

--
components: Extension Modules
messages: 345681
nosy: Crusader Ky, eric.snow
priority: normal
severity: normal
status: open
title: concurrent.futures.InterpreterPoolExecutor
type: enhancement
versions: Python 3.9

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com