[
https://issues.apache.org/jira/browse/MAHOUT-320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840601#action_12840601
]
Ankur commented on MAHOUT-320:
------------------------------
Binary comparison looks more or less the same in both the classes. Its the data
serialization/serialization where Bigram scores over IntPairWritable. Bigram
encodes/decodes the data in VInt format which uses zero compressed encodings
for more info see o.a.h.io.WritableUtils.java. The encoding can give
considerable savings when serializing huge amounts of numeric data.
> Modify IntPairWritable in LDA implementation to be binary comparable to
> improve performance.
> --------------------------------------------------------------------------------------------
>
> Key: MAHOUT-320
> URL: https://issues.apache.org/jira/browse/MAHOUT-320
> Project: Mahout
> Issue Type: Improvement
> Components: Clustering
> Affects Versions: 0.3
> Reporter: Drew Farris
> Assignee: Robin Anil
> Priority: Minor
> Attachments: MAHOUT-320.patch
>
>
> Per discussion with Robin, modifying o.a.m.clustering.lda.IntPairWritable to
> be binary comparable will improve the performance of the comparison
> operations during a sort because no marshaling will need to occur to compare
> IntPairWritable instances.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
