Jacques Nadeau created DRILL-1386:
-------------------------------------
Summary: Enable Partition Pruning for filesystem queries
Key: DRILL-1386
URL: https://issues.apache.org/jira/browse/DRILL-1386
Project: Apache Drill
Issue Type: Improvement
Components: Query Planning & Optimization, Storage - JSON, Storage -
Parquet, Storage - Text & CSV
Affects Versions: 0.5.0
Reporter: Jacques Nadeau
Assignee: Aman Sinha
Fix For: 0.6.0
If you have files:
/files/2012/Jan/log.csv
/files/2013/Jan/log.csv
And write the query "select * from `/files/` where dir0 = 2012 and dir1='Jan' "
Drill will read both files and then filter out all of the second file. Drill
should recognize that dir0=2012 and dir1='Jan' can be pushed down into the
storage layer to prune the files read as part of the query.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)