[ https://issues.apache.org/jira/browse/CARBONDATA-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ajantha Bhat resolved CARBONDATA-3579. -------------------------------------- Resolution: Fixed > Support merge index files when adding partition > ----------------------------------------------- > > Key: CARBONDATA-3579 > URL: https://issues.apache.org/jira/browse/CARBONDATA-3579 > Project: CarbonData > Issue Type: Improvement > Reporter: Jacky Li > Assignee: Jacky Li > Priority: Major > Fix For: 2.0.0 > > Time Spent: 2h 50m > Remaining Estimate: 0h > > Normally, application will use Carbon SDK to write files into a partition > folder, then add the folder to partitioned carbon table. > If there are many threads writes to the same partition folder, there will be > many carbon index files, and it is not good for query performance since all > index files need to be read to spark driver. > So, a better way is to merge the index files when adding new partition to > carbon table. -- This message was sent by Atlassian Jira (v8.3.4#803005)