Hyukjin Kwon created SPARK-45739: ------------------------------------ Summary: Catch IOException instead of EOFException alone for faulthandler Key: SPARK-45739 URL: https://issues.apache.org/jira/browse/SPARK-45739 Project: Spark Issue Type: Improvement Components: PySpark Affects Versions: 4.0.0 Reporter: Hyukjin Kwon
{{spark.python.worker.faulthandler.enabled}} can describe the fatal exception such as segfault hanlder. Exceptions such as {{java.net.SocketException: Connection reset}} can happen because the worker unexpectedly die. We should better catch all IO exception there. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org