[
https://issues.apache.org/jira/browse/DRILL-7004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16943152#comment-16943152
]
benj commented on DRILL-7004:
-----------------------------
Ok, thanks for the precision.
Note that in a suprising way, in the presented case there are not many file in
each directory (60 files per directory) but there are many directories and the
system tested have several server with several dozen of processors each. So
it's strange that the time increase linearly from 1 directory (60 files) to 24
directories (of 60 files each) or to 31*24 directories (of 60 files each). _(Ok
there is a factor 2 for the 24 Directories - but it's not enough meaningful)_
> improve show files functionnality
> ---------------------------------
>
> Key: DRILL-7004
> URL: https://issues.apache.org/jira/browse/DRILL-7004
> Project: Apache Drill
> Issue Type: Wish
> Components: Storage - Other
> Affects Versions: 1.15.0
> Reporter: benj
> Priority: Major
>
> For instant, it's possible to show files/directories in a particular
> directory with the command
> {code:java}
> SHOW files FROM tmp.`mypath`;
> {code}
> It would be certainly very useful to improve this functionality with :
> * possibility to list recursively
> * possibility to use at least wildcard
> {code:java}
> SHOW files FROM tmp.`mypath/*/test/*/*a*`;
> {code}
> * possibility to use the result like a table
> {code:java}
> SELECT p.* FROM (SHOW files FROM tmp.`mypath`) AS p WHERE ...
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
