[ https://issues.apache.org/jira/browse/SPARK-28237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xiao Li reassigned SPARK-28237: ------------------------------- Assignee: Yesheng Ma > Idempotence checker for Idempotent batches in RuleExecutors > ----------------------------------------------------------- > > Key: SPARK-28237 > URL: https://issues.apache.org/jira/browse/SPARK-28237 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 3.0.0 > Reporter: Yesheng Ma > Assignee: Yesheng Ma > Priority: Major > Fix For: 3.0.0 > > > The current {{RuleExecutor}} system contains two kinds of strategies: > {{Once}} and {{FixedPoint}}. The {{Once}} strategy is supposed to run once. > However, for particular rules (e.g. PullOutNondeterministic), they are > designed to be idempotent, but Spark currently lacks corresponding mechanism > to prevent such kind of non-idempotent behavior from happening. -- This message was sent by Atlassian JIRA (v7.6.14#76016) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org