Rahul Pathak created SPARK-52364:
------------------------------------
Summary: dispatcher-Executor deadlock
Key: SPARK-52364
URL: https://issues.apache.org/jira/browse/SPARK-52364
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 3.4.1
Reporter: Rahul Pathak
Using spark 3.4.1 with java 17
Job was hung and below deadlock detected in jstack
{code:java}
Found one Java-level deadlock:
=============================
"dispatcher-Executor":
waiting to lock monitor 0x000055be23022e00 (object 0x000000054d844b80, a
org.apache.hadoop.crypto.CryptoOutputStream),
which is held by "Executor task launch worker for task 459.0 in stage 33.0
(TID 8697)""Executor task launch worker for task 459.0 in stage 33.0 (TID
8697)":
waiting to lock monitor 0x00007f3f6b0911b0 (object 0x00000004649e5530, a
java.lang.Object),
which is held by "dispatcher-Executor" {code}
FYI : Driver already tried to kill this task as speculative execution was
enabled and other attempt succeeded.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
