[
https://issues.apache.org/jira/browse/KYLIN-1099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14979997#comment-14979997
]
Dong Li edited comment on KYLIN-1099 at 10/29/15 7:56 AM:
----------------------------------------------------------
This patch uses Enumerator to read data from source and write to dictionary
line by line, which could decrease memory cost of dictionary generation.
Please review, if it's OK, I'll port it to 2.x branch.
was (Author: lidong_sjtu):
This patch use Enumerator to read data from source and write to dictionary line
by line, which could decrease memory cost of dictionary generation.
Please review, if it's OK, I'll port it to 2.x branch.
> Support dictionary of cardinality over 10 millions
> --------------------------------------------------
>
> Key: KYLIN-1099
> URL: https://issues.apache.org/jira/browse/KYLIN-1099
> Project: Kylin
> Issue Type: Bug
> Reporter: liyang
> Assignee: liyang
> Attachments: 1.x -
> 0001-KYLIN-1099-Support-dictionary-of-cardinality-over-10.patch
>
>
> Many use cases involve columns with high cardinality over 10 millions.
> Dictionary should be supported on these columns assuming mem is sufficient.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
