Zhongwei Zhu created SPARK-43399: ------------------------------------ Summary: Add config to control threshold of unregister map output when fetch failed Key: SPARK-43399 URL: https://issues.apache.org/jira/browse/SPARK-43399 Project: Spark Issue Type: Improvement Components: Spark Core Affects Versions: 3.4.0 Reporter: Zhongwei Zhu
Spark will unregister map output on the executor when fetch failed from this executor. This might be too aggressive when fetch failed is temporary and recoverable. So adding the config to control the number of fetch failed failures needed to unregister map output and allow to disable unregister. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org