[issue19173] Expose Queue maxsize parameter to multiprocessing.Pool class

2018-04-13 Thread Antoine Pitrou

Antoine Pitrou  added the comment:

A similar issue for concurrent.futures is bpo-29595.

--
versions: +Python 3.8 -Python 3.4

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue19173] Expose Queue maxsize parameter to multiprocessing.Pool class

2018-04-12 Thread Ned Deily

Change by Ned Deily :


--
nosy: +davin, pitrou

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue19173] Expose Queue maxsize parameter to multiprocessing.Pool class

2013-10-05 Thread noxdafox

New submission from noxdafox:

As a developer I want the multiprocessing Pool class to expose the internal 
queue size limit in order to better control the task flow in my application.

Consider the following scenarios:
1. The tasks I want to run into the pool require a considerably big amount of 
data as input (a big XML string for example). A limitless queue and a high 
number of tasks would cause my application to consume a huge amount of memory, 
this is unacceptable.
2. I want to always ensure a small amount of tasks queued into the pool so 
that, if my application crashes, I won't loose much data.

Patch includes code changes, tests and documentation.

--
components: Library (Lib)
files: maxqueuesize.patch
keywords: patch
messages: 198992
nosy: noxdafox
priority: normal
severity: normal
status: open
title: Expose Queue maxsize parameter to multiprocessing.Pool class
type: enhancement
versions: Python 3.4
Added file: http://bugs.python.org/file31967/maxqueuesize.patch

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue19173
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue19173] Expose Queue maxsize parameter to multiprocessing.Pool class

2013-10-05 Thread noxdafox

noxdafox added the comment:

Please ignore the first provided patch, doc changes where wrong

--
Added file: http://bugs.python.org/file31968/maxqueuesize.patch

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue19173
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue19173] Expose Queue maxsize parameter to multiprocessing.Pool class

2013-10-05 Thread Antoine Pitrou

Changes by Antoine Pitrou pit...@free.fr:


--
nosy: +sbt

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue19173
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com