Aman Sinha created DRILL-3901: --------------------------------- Summary: Performance regression with doing Explain of COUNT(*) over 100K files Key: DRILL-3901 URL: https://issues.apache.org/jira/browse/DRILL-3901 Project: Apache Drill Issue Type: Bug Affects Versions: 1.1.0 Reporter: Aman Sinha
We are seeing a performance regression when doing an Explain of SELECT COUNT(*) over 100K files in a flat directory (no subdirectories) on latest master branch compared to a run that was done on Sept 26. Some initial details (I will have more later): {code} master branch on Sept 26 No metadata cache: 71.452 secs With metadata cache: 15.804 secs Latest master branch No metadata cache: 110 secs With metadata cache: 32 secs {code} So, both cases show regression. [~mehant] and I took an initial look at this and it appears we might be doing the directory expansion twice. -- This message was sent by Atlassian JIRA (v6.3.4#6332)