Craiu Constantin-Tiberiu created SPARK-52971:
------------------------------------------------
Summary: Enable configurable limits for Python Worker Idle Pool
Key: SPARK-52971
URL: https://issues.apache.org/jira/browse/SPARK-52971
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 4.1.0
Reporter: Craiu Constantin-Tiberiu
Currently, the idle worker queue in PythonWorkerFactory can grow unbounded.
A conf can be added to cap the limit.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
