[
https://issues.apache.org/jira/browse/CARBONDATA-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat resolved CARBONDATA-3879.
--------------------------------------
Fix Version/s: (was: 2.0.2)
2.1.0
Resolution: Fixed
> Filtering Segmets Optimazation
> ------------------------------
>
> Key: CARBONDATA-3879
> URL: https://issues.apache.org/jira/browse/CARBONDATA-3879
> Project: CarbonData
> Issue Type: Improvement
> Components: data-query
> Affects Versions: 2.0.0
> Reporter: Xingjun Hao
> Priority: Major
> Fix For: 2.1.0
>
> Time Spent: 4.5h
> Remaining Estimate: 0h
>
> During filter segments flow, there are a lot of LIST.CONTAINS, which has
> heavy time overhead when there are tens of thousands segments.
> For example, if there are 50000 segments. it will trigger LIST.CONTAINS for
> each segment, the LIST also has about 50000 elements. so the time complexity
> will be O（50000 * 50000 ）
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
