nsivabalan opened a new pull request, #8223:
URL: https://github.com/apache/hudi/pull/8223
### Change Logs
Fixing a corner case bug where compaction in MDT could get triggered w/
partially failed commit in DT.
Currently the logic to deduce pending instants in MDT is as below
a = we get latest completed delta commit from MDT.
Find any inflights in DT timeline **before** {a}
and if we don't find any such inflights, we will go ahead and may be compact
MDT.
But what incase the latest delta commit in MDT succeeded in MDT, but failed
in DT. so, it could potentially result in triggering compaction in MDT which
should not happen.
So, the right fix is
a = we get latest completed delta commit from MDT.
Find any inflights in DT timeline **before or equals** to {a}
This should take care of not triggering compaction in MDT when here are
inflights in DT which is committed to MDT.
### Impact
Stabilizes metadata table.
### Risk level (write none, low medium or high below)
medium
### Documentation Update
N/A
### Contributor's checklist
- [ ] Read through [contributor's
guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
