[
https://issues.apache.org/jira/browse/KYLIN-978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yerui Sun updated KYLIN-978:
----------------------------
Description:
In GarbageCollectionStep, the hive intermediate table created in step 1 was
dropped.
As the table is external table, data was stored in a external hdfs path, like
'.../kylin-$\{jobId\}/kylin_intermediate_...', which didn't deleted when drop
hive table.
Considering the purpose of GarbageCollectionStep, the external data path should
also be deleted.
was:
In GarbageCollectionStep, the hive intermediate table created in step 1 was
dropped.
As the table is external table, data was stored in a external hdfs path, like
'.../kylin-${jobId}/kylin_intermediate_...', which didn't deleted when drop
hive table.
Considering the purpose of GarbageCollectionStep, the external data path should
also be deleted.
> GarbageCollectionStep dropped Hive Intermediate Table but didn't drop
> external hdfs path
> ----------------------------------------------------------------------------------------
>
> Key: KYLIN-978
> URL: https://issues.apache.org/jira/browse/KYLIN-978
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
> Affects Versions: v0.7.2
> Reporter: Yerui Sun
> Assignee: ZhouQianhao
>
> In GarbageCollectionStep, the hive intermediate table created in step 1 was
> dropped.
> As the table is external table, data was stored in a external hdfs path, like
> '.../kylin-$\{jobId\}/kylin_intermediate_...', which didn't deleted when drop
> hive table.
> Considering the purpose of GarbageCollectionStep, the external data path
> should also be deleted.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
