[ https://issues.apache.org/jira/browse/KYLIN-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15741084#comment-15741084 ]
kangkaisen commented on KYLIN-2269: ----------------------------------- Hi, [~mahongbin]. please you review the patch when you have time, I am not sure this feature and {{shardBy}} feature whether could be used at the same time. if no, I will add the check. Thank you. > Reduce MR memory usage for global dict > -------------------------------------- > > Key: KYLIN-2269 > URL: https://issues.apache.org/jira/browse/KYLIN-2269 > Project: Kylin > Issue Type: Improvement > Affects Versions: v1.6.0 > Reporter: kangkaisen > Assignee: kangkaisen > Attachments: KYLIN-2269.patch > > > currently, in {{Build Base Cuboid Data}}, if user use the global dict and the > global dict size significantly larger the mapper memory size, the > {{CachedTreeMap}} will load all values as much as possible and the soft > references object will stick around for a while when GC, So which will make > the {{Build Base Cuboid Data}} mapper pause for a long time even could not > finish. -- This message was sent by Atlassian JIRA (v6.3.4#6332)