Kent Yao created SPARK-23253: -------------------------------- Summary: Only write shuffle temporary index file when there is not an existing one Key: SPARK-23253 URL: https://issues.apache.org/jira/browse/SPARK-23253 Project: Spark Issue Type: Improvement Components: Shuffle, Spark Core Affects Versions: 2.2.1 Reporter: Kent Yao
Shuffle Index temporay file is used for atomic creating shuffle index file, it is not needed when the index file already exists after another attempts of same task had it done. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org