[ https://issues.apache.org/jira/browse/SPARK-32923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mridul Muralidharan resolved SPARK-32923. ----------------------------------------- Resolution: Fixed This has been handled by SPARK-32923 > Add support to properly handle different type of stage retries > -------------------------------------------------------------- > > Key: SPARK-32923 > URL: https://issues.apache.org/jira/browse/SPARK-32923 > Project: Spark > Issue Type: Sub-task > Components: Shuffle, Spark Core > Affects Versions: 3.1.0 > Reporter: Min Shen > Priority: Major > > In SPARK-23243 and SPARK-25341, the concept of an INDETERMINATE stage was > introduced, which would be handled differently if retried. > Since these was added to address a data correctness issue, we should also add > support for these in push-based shuffle, so that we would be able to rollback > the merged shuffle partitions of a shuffle map stage if it's an INDETERMINATE > stage. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org