hudi-bot opened a new issue, #17320: URL: https://github.com/apache/hudi/issues/17320
testMetadataBootstrapMORPartitionedInlineCompactionOn fails with file group reader-based compaction (HoodieSparkMergeHandleV2). Currently if the compaction plan and operations contain bootstrap files, the compaction goes through the old flow using the regular HoodieMergeHandle. We should support bootstrap files in file group reader-based compaction in HoodieSparkMergeHandleV2. ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-8632 - Type: Sub-task - Parent: https://issues.apache.org/jira/browse/HUDI-9107 - Fix version(s): - 1.1.0 --- ## Comments 22/Jan/25 05:52;yihua;Found another issue: HUDI-8896. Right now reading partition columns for bootstrapped table (bootstrap skeleton + data file) relies on engine-specific handling, not in the file group reader. So compaction and clustering using the file group reader to read out records from metadata-only bootstrapped table can encounter nulls in the partition columns, causing the new base file written to have nulls in the partition columns.;;; -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
