nsivabalan commented on issue #14482: URL: https://github.com/apache/hudi/issues/14482#issuecomment-4795169424
This appears to have been addressed in master by [#17514](https://github.com/apache/hudi/pull/17514) (commit `180592a0ad71`, *feat(spark): implement column pruning for incremental queries*). The PR migrates `IncrementalRelationV1` and `IncrementalRelationV2` from `TableScan` to `PrunedScan`, implements `buildScan(requiredColumns)`, and enables Parquet filter pushdown plus record-level filters — addressing both the column pruning and predicate pushdown gaps described here. Could the reporter confirm on a recent master build and close if resolved? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
