Tengfei Huang created SPARK-52395:
-------------------------------------
Summary: Fail fast on the first shuffle block fetch failure
Key: SPARK-52395
URL: https://issues.apache.org/jira/browse/SPARK-52395
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 4.0.0
Reporter: Tengfei Huang
Shuffle blocks are handled in sequence to guarantee thread safety on handling
shuffle data. This becomes an issue when the first block fetch failure is
admitted but plenty of succeeded blocks are already in the queue. This leads to
task runs for meaningless/wasted until the failed block is handled.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
