[
https://issues.apache.org/jira/browse/HUDI-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Y Ethan Guo updated HUDI-8635:
------------------------------
Description:
We need to make sure the write stats generated by the new file group
reader-based merge handle for compaction (
HoodieSparkFileGroupReaderBasedMergeHandle) are intact in all cases.
was:
Right now we disable the file group reader-based compaction for MDT as a
precaution. We should test more and remove such limitation.
{code:java}
boolean useFileGroupReaderBasedCompaction = !metaClient.isMetadataTable()
&& config.getBooleanOrDefault(HoodieReaderConfig.FILE_GROUP_READER_ENABLED)
&& compactionHandler.supportsFileGroupReader()
&& !hasBootstrapFile(operations)
&& StringUtils.isNullOrEmpty(config.getInternalSchema()); {code}
> Revisit stats generated in HoodieSparkMergeHandleV2
> ---------------------------------------------------
>
> Key: HUDI-8635
> URL: https://issues.apache.org/jira/browse/HUDI-8635
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Y Ethan Guo
> Priority: Blocker
> Fix For: 1.0.1
>
>
> We need to make sure the write stats generated by the new file group
> reader-based merge handle for compaction (
> HoodieSparkFileGroupReaderBasedMergeHandle) are intact in all cases.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
