[ https://issues.apache.org/jira/browse/HUDI-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sagar Sumit updated HUDI-2754: ------------------------------ Fix Version/s: 0.12.1 (was: 0.12.0) > Performance improvement for IncrementalRelation > ----------------------------------------------- > > Key: HUDI-2754 > URL: https://issues.apache.org/jira/browse/HUDI-2754 > Project: Apache Hudi > Issue Type: Bug > Components: incremental-query, performance > Reporter: Jintao > Assignee: Jintao > Priority: Major > Labels: pull-request-available > Fix For: 0.12.1 > > > When HoodieIncrSource is used to fetch the update from another Hudi table, > the IncrementalRelation will be used to read the data. But it has a > performance issue because the column pruning and predicate pushdown don't > happen. As the result, Hudi reads too much useless data. > By enabling the column pruning and predicate pushdown, the data to read is > reduced dramatically. -- This message was sent by Atlassian Jira (v8.20.10#820010)