[
https://issues.apache.org/jira/browse/KYLIN-978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14900162#comment-14900162
]
Yerui Sun commented on KYLIN-978:
---------------------------------
I see the commit, it looks good.
Thanks a lot for the discussion and the commit, thank you Shaofeng!
BTW, I post a patch for 2.x-staging branch last Friday, would you please review
and comment it? Maybe also need to remove the code of cleaning small files on
hdfs?
> GarbageCollectionStep dropped Hive Intermediate Table but didn't drop
> external hdfs path
> ----------------------------------------------------------------------------------------
>
> Key: KYLIN-978
> URL: https://issues.apache.org/jira/browse/KYLIN-978
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
> Affects Versions: v1.0, v0.7.2
> Reporter: Yerui Sun
> Assignee: Shaofeng SHI
> Fix For: v1.1
>
> Attachments: KYLIN-978-1.x-staging-v2.patch,
> KYLIN-978-1.x-staging-v3.patch, KYLIN-978-2.x-staging.patch
>
>
> In GarbageCollectionStep, the hive intermediate table created in step 1 was
> dropped.
> As the table is external table, data was stored in a external hdfs path, like
> '.../kylin-$\{jobId\}/kylin_intermediate_...', which didn't deleted when drop
> hive table.
> Considering the purpose of GarbageCollectionStep, the external data path
> should also be deleted.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
