Tengfei Huang created SPARK-54956:
-------------------------------------
Summary: Unify the indeterminate shuffle retry solution
Key: SPARK-54956
URL: https://issues.apache.org/jira/browse/SPARK-54956
Project: Spark
Issue Type: Task
Components: Spark Core
Affects Versions: 4.1.0
Reporter: Tengfei Huang
Currently, we have two version of implementations to deal with indeterminate
shuffle retry.
The shuffle output checksum based solution and the legacy one.
Ideally, the major difference is how we detect the indeterminate shuffle retry,
after that the solution to deal with it should be the same.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
