[ https://issues.apache.org/jira/browse/KYLIN-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15760047#comment-15760047 ]
kangkaisen commented on KYLIN-2269: ----------------------------------- OK. I agree with you. > Reduce MR memory usage for global dict > -------------------------------------- > > Key: KYLIN-2269 > URL: https://issues.apache.org/jira/browse/KYLIN-2269 > Project: Kylin > Issue Type: Improvement > Affects Versions: v1.6.0 > Reporter: kangkaisen > Assignee: kangkaisen > Attachments: KYLIN-2269.patch > > > currently, in {{Build Base Cuboid Data}}, if user use the global dict and the > global dict size significantly larger the mapper memory size, the > {{CachedTreeMap}} will load all values as much as possible and the soft > references object will stick around for a while when GC, So which will make > the {{Build Base Cuboid Data}} mapper pause for a long time even could not > finish. -- This message was sent by Atlassian JIRA (v6.3.4#6332)