[ https://issues.apache.org/jira/browse/KYLIN-2992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237137#comment-16237137 ]
kangkaisen commented on KYLIN-2992: ----------------------------------- The main idea is changing reducer sort to shuffle sort, There are two key points: # implement a {{RowKeyWritable}} class to compare KeyValue with KeyValue.KVComparator() # construct a KeyValue base on cuboid with KeyValue.createFirstOnRow The more detail could refer this Chinese blog: https://blog.bcmeng.com/post/kylin-hfile-improve.html > Avoid OOM in CubeHFileJob.Reducer > ---------------------------------- > > Key: KYLIN-2992 > URL: https://issues.apache.org/jira/browse/KYLIN-2992 > Project: Kylin > Issue Type: Improvement > Components: Storage - HBase > Affects Versions: v2.1.0 > Reporter: kangkaisen > Assignee: kangkaisen > Priority: Major > > Refer to HBASE-13897, we also could improve CubeHFileJob.Reducer and avoid > OOM. -- This message was sent by Atlassian JIRA (v6.4.14#64029)