Xingjun Hao created CARBONDATA-3879:
---------------------------------------
Summary: Filtering Segmets Optimazation
Key: CARBONDATA-3879
URL: https://issues.apache.org/jira/browse/CARBONDATA-3879
Project: CarbonData
Issue Type: Improvement
Components: data-query
Affects Versions: 2.0.0
Reporter: Xingjun Hao
Fix For: 2.0.2
During filter segments flow, there are a lot of LIST.CONTAINS, which has heavy
time overhead when there are tens of thousands segments.
For example, if there are 50000 segments. it will trigger LIST.CONTAINS for
each segment, the LIST also has about 50000 elements. so the time complexity
will be O（50000 * 50000 ）
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
