Github user kumarvishal09 commented on the issue: https://github.com/apache/incubator-carbondata/pull/659 @watermen Attached heap dump is of executor side btree or driver side? 1. Because in driver side btree is loaded based on segment and one segment will have only one segment property instance. 2. In executor side carbon is loading segment property for each block(carbon data file), so number of segment properties instance will be more in executor side. In my opinion we need to optimise in executor side btree loading , for one segment across blocks there should be only one segment property instance
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---