[ https://issues.apache.org/jira/browse/CARBONDATA-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jacky Li resolved CARBONDATA-2494. ---------------------------------- Resolution: Fixed Fix Version/s: 1.4.0 > Improve Lucene datamap size and performnace. > -------------------------------------------- > > Key: CARBONDATA-2494 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2494 > Project: CarbonData > Issue Type: Improvement > Reporter: Ravindra Pesala > Priority: Major > Fix For: 1.4.0 > > Time Spent: 2h 50m > Remaining Estimate: 0h > > Improved lucene datamap size and performance by using the following > parameters. > New DM properties > `flush_cache`: size of the cache to maintain in Lucene writer, if specified > then it tries to aggregate the unique data till the cache limit and flush to > Lucene. It is best suitable for low cardinality dimensions. > `split_blocklet`: when made as true then store the data in blocklet wise in > lucene , it means new folder will be created for each blocklet thus it > eliminates storing on blockletid in lucene. And also it makes lucene small > chunks of data. -- This message was sent by Atlassian JIRA (v7.6.3#76005)