Sebastian Hillig created SPARK-47565:
----------------------------------------

             Summary: PySpark workers dying in daemon mode idle queue fail query
                 Key: SPARK-47565
                 URL: https://issues.apache.org/jira/browse/SPARK-47565
             Project: Spark
          Issue Type: Improvement
          Components: PySpark
    Affects Versions: 3.3.4, 3.5.1, 3.4.2
            Reporter: Sebastian Hillig


PySpark workers may die after entering the idle queue in `PythonWorkerFactory`. 
This may happen because of code that runs in the process, or external factors.

When drawn from the warmpool, such a worker will result in an I/O exception on 
the first read/write .



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to