[
https://issues.apache.org/jira/browse/DATAFU-100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16539063#comment-16539063
]
Eyal Allweil commented on DATAFU-100:
-------------------------------------
I wonder if the performance is different (better) when the data is split into
more files. Typically when we store a large number of records, they're split to
many more files - more like hundreds or thousands.
The other thought I have is whether the worst case time is a useful metric - if
at least one reducer takes a much longer time than average, it will affect the
total job time significantly.
> Document recommendations on using HyperLogLogPlus
> -------------------------------------------------
>
> Key: DATAFU-100
> URL: https://issues.apache.org/jira/browse/DATAFU-100
> Project: DataFu
> Issue Type: Improvement
> Reporter: Matthew Hayes
> Priority: Minor
> Attachments: DATAFU-100.patch
>
>
> We should provide recommendations about how to HyperLogLogPlus effectively.
> For example 1) how should the precision value be used, 2) when would a count
> distinct be better, etc.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
