Jark Wu created FLINK-12805: ------------------------------- Summary: Introduce PartitionableTableSource for partition pruning Key: FLINK-12805 URL: https://issues.apache.org/jira/browse/FLINK-12805 Project: Flink Issue Type: New Feature Components: Table SQL / API Reporter: Jark Wu Assignee: Jark Wu
Many data sources are partitionable storage, e.g. HIVE, HDFS, Druid. And many queries just need to read a small subset of the total data. We can use partition information to prune or skip over files irrelevant to the user's queries. Both query optimization time and execution time can be reduced obviously, especially for a large partitioned table. -- This message was sent by Atlassian JIRA (v7.6.3#76005)