[ 
https://issues.apache.org/jira/browse/HUDI-204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinoth Chandar reassigned HUDI-204:
-----------------------------------

    Assignee: BALAJI VARADARAJAN

> Make MOR rollback idempotent and disable using rolling stats for small file 
> selection
> -------------------------------------------------------------------------------------
>
>                 Key: HUDI-204
>                 URL: https://issues.apache.org/jira/browse/HUDI-204
>             Project: Apache Hudi (incubating)
>          Issue Type: Bug
>          Components: Write Client
>            Reporter: BALAJI VARADARAJAN
>            Assignee: BALAJI VARADARAJAN
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> 1. Rollback assumes all fileIds that are affected by rollback to be always 
> present. This breaks when rollback fails intermittently and is retried
> 2. Sometime Rolling stats wrongly tracks file sizes to be 0. We had earlier 
> discussed to completely revisit rolling stats. We will disable using rolling 
> stats to prevent wrong small file selection



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Reply via email to