[
https://issues.apache.org/jira/browse/HUDI-169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar resolved HUDI-169.
---------------------------------
Resolution: Fixed
> Hoodie 2.0 Rollback could be slow if there are too many files needed to
> rollback for a partition
> ------------------------------------------------------------------------------------------------
>
> Key: HUDI-169
> URL: https://issues.apache.org/jira/browse/HUDI-169
> Project: Apache Hudi (incubating)
> Issue Type: Task
> Components: Common Core, Performance
> Reporter: Balaji Varadarajan
> Assignee: Balaji Varadarajan
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.5.1
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> The logic which rolls-back a commit performs parallel rollback only at
> partition level. Depending on the input batch, there could be skew in number
> of files per partition that needs to be rolled-back.
> For partition with too many files to be rolled-back, each rollback appends a
> log-block to the file-slice. This could potentially take a long time as they
> are done serially.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
