Sebastian Hillig created SPARK-47565: ----------------------------------------
Summary: PySpark workers dying in daemon mode idle queue fail query Key: SPARK-47565 URL: https://issues.apache.org/jira/browse/SPARK-47565 Project: Spark Issue Type: Improvement Components: PySpark Affects Versions: 3.3.4, 3.5.1, 3.4.2 Reporter: Sebastian Hillig PySpark workers may die after entering the idle queue in `PythonWorkerFactory`. This may happen because of code that runs in the process, or external factors. When drawn from the warmpool, such a worker will result in an I/O exception on the first read/write . -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org