[ https://issues.apache.org/jira/browse/HUDI-6151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Danny Chen closed HUDI-6151. ---------------------------- Resolution: Fixed Fixed via master branch: b95248e011931f4748a7a9fbb8298cbbb71bda88 > Rollback previously applied commits to MDT when operations are retried. > ----------------------------------------------------------------------- > > Key: HUDI-6151 > URL: https://issues.apache.org/jira/browse/HUDI-6151 > Project: Apache Hudi > Issue Type: Bug > Reporter: Prashant Wason > Assignee: Prashant Wason > Priority: Blocker > Labels: pull-request-available > Fix For: 0.14.0 > > > Operations like Clean, Compaction are retried after failures with the same > instant time. If the previous run of the operation successfully committed to > the MDT but failed to commit to the dataset, then the operation will be > retried later with the same instantTime causing duplicate updates applied to > MDT. > Currently, we simply delete the completed deltacommit without rolling back > the deltacommit. > To handle this, we detect a replay of operation and rollback any changes from > that operation in MDT. -- This message was sent by Atlassian Jira (v8.20.10#820010)