nbalajee opened a new issue, #18278:
URL: https://github.com/apache/hudi/issues/18278

   ### Task Description
   
   When performing rollback on MDT, listStatus is called once per log file (N 
calls). This can be optimized to one listing call per partition (P calls, where 
P is much less than N) by pre-computing the latest log file versions upfront.
   
   Plan: 
   RollbackHelper.java -- Add preComputeLogVersions + optimize 
maybeDeleteAndCollectStats
   RollbackHelperV1.java -- Apply same optimization to V1's 
maybeDeleteAndCollectStats
   
   
   ### Task Type
   
   Performance optimization
   
   ### Related Issues
   
   **Parent feature issue:** (if applicable )
   **Related issues:**
   NOTE: Use `Relationships` button to add parent/blocking issues after issue 
is created.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to