James Turton created DRILL-8290:
-----------------------------------
Summary: Short circuit recursive file listings for LIMIT 0 queries
Key: DRILL-8290
URL: https://issues.apache.org/jira/browse/DRILL-8290
Project: Apache Drill
Issue Type: Improvement
Components: Query Planning & Optimization
Affects Versions: 1.20.2
Reporter: James Turton
Fix For: 2.0.0
The existing LIMIT 0 query optimisations do not prevent a query run against the
top of a deep DFS directory tree from recursively listing FileStatuses for
everything within it using a pool of worker threads. This Issue proposes a new
optimisation whereby such queries will recurse into the directory tree on a
single thread that returns as soon as any single FileStatus has been obtained.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
