[ https://issues.apache.org/jira/browse/DRILL-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947078#comment-14947078 ]
Aman Sinha commented on DRILL-3901: ----------------------------------- [~mehant] could you pls review the minimal patch ? I believe you have a broader patch but for 1.2 we should make the minimal change to resolve the performance regression at least for the non-metadata-cache scenario. > Performance regression with doing Explain of COUNT(*) over 100K files > --------------------------------------------------------------------- > > Key: DRILL-3901 > URL: https://issues.apache.org/jira/browse/DRILL-3901 > Project: Apache Drill > Issue Type: Bug > Affects Versions: 1.1.0 > Reporter: Aman Sinha > Assignee: Mehant Baid > Attachments: > 0001-DRILL-3901-Don-t-do-early-expansion-of-directory-in-.patch > > > We are seeing a performance regression when doing an Explain of SELECT > COUNT(*) over 100K files in a flat directory (no subdirectories) on latest > master branch compared to a run that was done on Sept 26. Some initial > details (I will have more later): > {code} > master branch on Sept 26 > No metadata cache: 71.452 secs > With metadata cache: 15.804 secs > Latest master branch > No metadata cache: 110 secs > With metadata cache: 32 secs > {code} > So, both cases show regression. > [~mehant] and I took an initial look at this and it appears we might be doing > the directory expansion twice. > -- This message was sent by Atlassian JIRA (v6.3.4#6332)