[
https://issues.apache.org/jira/browse/CARBONDATA-4054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat updated CARBONDATA-4054:
-------------------------------------
Fix Version/s: (was: 2.2.0)
2.1.1
> Size control of minor compaction
> --------------------------------
>
> Key: CARBONDATA-4054
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4054
> Project: CarbonData
> Issue Type: Improvement
> Reporter: ZHANGSHUNYU
> Priority: Major
> Fix For: 2.1.1
>
> Time Spent: 10h
> Remaining Estimate: 0h
>
> {{Currentlly, minor compaction only consider the num of segments and major}}
> compaction only consider the SUM size of segments, but consider a scenario
> that the user want to use minor compaction by the num of segments but he
> dont want to merge the segment whose datasize larger the threshold for
> example 2GB, as it is no need to merge so much big segment and it is time
> costly.
> so we need to add a parameter to control the threshold of segment included
> in minor compaction, so that the user can specify the segment not included
> in minor compaction once the datasize exeed the threshold, of course default
> value must be threre.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
