[
https://issues.apache.org/jira/browse/HIVE-9367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277070#comment-14277070
]
Xuefu Zhang commented on HIVE-9367:
-----------------------------------
Nice improvement. However, I'm a little concerned about overriding listStatus()
method, as an caller (including subclasses) would suddently get a list with
folders excluded. I'm wondering if it's possible to achieve the same
optimization w/o overriding that method.
> CombineFileInputFormatShim#getDirIndices is expensive
> -----------------------------------------------------
>
> Key: HIVE-9367
> URL: https://issues.apache.org/jira/browse/HIVE-9367
> Project: Hive
> Issue Type: Improvement
> Reporter: Jimmy Xiang
> Assignee: Jimmy Xiang
> Attachments: HIVE-9367.1.patch
>
>
> [~lirui] found out that we spent quite some time on
> CombineFileInputFormatShim#getDirIndices. Looked into it and it seems to me
> we should be able to get rid of this method completely if we can enhance
> CombineFileInputFormatShim a little.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
