[
https://issues.apache.org/jira/browse/HUDI-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Y Ethan Guo updated HUDI-8635:
------------------------------
Description:
Right now we disable the file group reader-based compaction for MDT as a
precaution. We should test more and remove such limitation.
{code:java}
boolean useFileGroupReaderBasedCompaction = !metaClient.isMetadataTable()
&& config.getBooleanOrDefault(HoodieReaderConfig.FILE_GROUP_READER_ENABLED)
&& compactionHandler.supportsFileGroupReader()
&& !hasBootstrapFile(operations)
&& StringUtils.isNullOrEmpty(config.getInternalSchema()); {code}
> Revisit stats generated in HoodieSparkMergeHandleV2
> ---------------------------------------------------
>
> Key: HUDI-8635
> URL: https://issues.apache.org/jira/browse/HUDI-8635
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Y Ethan Guo
> Priority: Major
>
> Right now we disable the file group reader-based compaction for MDT as a
> precaution. We should test more and remove such limitation.
> {code:java}
> boolean useFileGroupReaderBasedCompaction = !metaClient.isMetadataTable()
> &&
> config.getBooleanOrDefault(HoodieReaderConfig.FILE_GROUP_READER_ENABLED)
> && compactionHandler.supportsFileGroupReader()
> && !hasBootstrapFile(operations)
> && StringUtils.isNullOrEmpty(config.getInternalSchema()); {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
