[ https://issues.apache.org/jira/browse/CARBONDATA-4251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kunal Kapoor updated CARBONDATA-4251: ------------------------------------- Fix Version/s: (was: 2.2.1) 2.2.0 > optimize clean index file performance > ------------------------------------- > > Key: CARBONDATA-4251 > URL: https://issues.apache.org/jira/browse/CARBONDATA-4251 > Project: CarbonData > Issue Type: Improvement > Components: core > Affects Versions: 2.2.0 > Reporter: Jiayu Shen > Priority: Minor > Fix For: 2.2.0 > > Time Spent: 3.5h > Remaining Estimate: 0h > > When cleanfile cleans up data, it cleans up all the carbonindex and > carbonmergeindex that once existed, even though many carbonindex have been > all deleted, which have been merged into carbonergeindex. considering that > there are tens of thousands of carbonindex that once existed after the > completion of the compaction, the clean file command will take serveral hours. > Here, we just need to clean up the existing files, carbonmergeindex or > carbonindex files -- This message was sent by Atlassian Jira (v8.3.4#803005)