[GitHub] [hudi] danny0405 commented on pull request #7490: [HUDI-5407][HUDI-5408] Fixing rollback in MDT to be eager

2023-02-10 Thread via GitHub
danny0405 commented on PR #7490: URL: https://github.com/apache/hudi/pull/7490#issuecomment-1426623404 > @danny0405 : we have scanV2 which already fixes this. Migrating to scanV2 is the plan in next release. Please make sure all the engines have the fix, scanV2 sounds like a Spark sp

[GitHub] [hudi] danny0405 commented on pull request #7490: [HUDI-5407][HUDI-5408] Fixing rollback in MDT to be eager

2023-01-23 Thread via GitHub
danny0405 commented on PR #7490: URL: https://github.com/apache/hudi/pull/7490#issuecomment-1401429022 > So, when we read the log blocks via AbstractLogRecordReader, ideally we want to ignore log2. but when we encounter log4 for a rollback block, we only check the previous log block for mat