[
https://issues.apache.org/jira/browse/KYLIN-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857248#comment-16857248
]
ASF GitHub Bot commented on KYLIN-3271:
---------------------------------------
nichunen commented on pull request #674: KYLIN-3271 KYLIN-3454 minor refactor,
accelerate ResourceTool
URL: https://github.com/apache/kylin/pull/674
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Optimize sub-path check of ResourceTool
> ---------------------------------------
>
> Key: KYLIN-3271
> URL: https://issues.apache.org/jira/browse/KYLIN-3271
> Project: Kylin
> Issue Type: Improvement
> Components: Metadata
> Affects Versions: v2.2.0
> Reporter: nichunen
> Assignee: nichunen
> Priority: Minor
> Fix For: v2.4.0
>
>
> kylin uses class org.apache.kylin.common.persistence.ResourceTool to do
> metadata download, upload, remove, etc. The algorithm for resource
> transversal is not very effective. For instance, for an "execute_output" with
> key "/execute_output/\{uuid}", the algorithm will try to check whether it's a
> folder with sub-resources, this makes un-necessary time cost, and in cases of
> metadata with lots of jobs, it may last for a long time before the finish.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
