[ https://issues.apache.org/jira/browse/HUDI-169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinoth Chandar resolved HUDI-169. --------------------------------- Resolution: Fixed > Hoodie 2.0 Rollback could be slow if there are too many files needed to > rollback for a partition > ------------------------------------------------------------------------------------------------ > > Key: HUDI-169 > URL: https://issues.apache.org/jira/browse/HUDI-169 > Project: Apache Hudi (incubating) > Issue Type: Task > Components: Common Core, Performance > Reporter: Balaji Varadarajan > Assignee: Balaji Varadarajan > Priority: Major > Labels: pull-request-available > Fix For: 0.5.1 > > Time Spent: 20m > Remaining Estimate: 0h > > The logic which rolls-back a commit performs parallel rollback only at > partition level. Depending on the input batch, there could be skew in number > of files per partition that needs to be rolled-back. > For partition with too many files to be rolled-back, each rollback appends a > log-block to the file-slice. This could potentially take a long time as they > are done serially. -- This message was sent by Atlassian Jira (v8.3.4#803005)