Jacky Li created CARBONDATA-3579:
------------------------------------

             Summary: Support merge index files when adding partition
                 Key: CARBONDATA-3579
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3579
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Jacky Li
             Fix For: 2.0.0


Normally, application will use Carbon SDK to write files into a partition 
folder, then add the folder to partitioned carbon table. 
If there are many threads writes to the same partition folder, there will be 
many carbon index files, and it is not good for query performance since all 
index files need to be read to spark driver.

So, a better way is to merge the index files when adding new partition to 
carbon table.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to