[ 
https://issues.apache.org/jira/browse/CARBONDATA-4251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kunal Kapoor updated CARBONDATA-4251:
-------------------------------------
    Fix Version/s:     (was: 2.2.1)
                   2.2.0

> optimize clean index file performance
> -------------------------------------
>
>                 Key: CARBONDATA-4251
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4251
>             Project: CarbonData
>          Issue Type: Improvement
>          Components: core
>    Affects Versions: 2.2.0
>            Reporter: Jiayu Shen
>            Priority: Minor
>             Fix For: 2.2.0
>
>          Time Spent: 3.5h
>  Remaining Estimate: 0h
>
> When cleanfile cleans up data, it cleans up all the carbonindex and 
> carbonmergeindex that once existed, even though many carbonindex have been 
> all deleted, which have been merged into carbonergeindex. considering that 
> there are tens of thousands of carbonindex that once existed after the 
> completion of the compaction, the clean file command will take serveral hours.
> Here, we just need to clean up the existing files, carbonmergeindex or 
> carbonindex files



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to