[
https://issues.apache.org/jira/browse/MAHOUT-709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042935#comment-13042935
]
Yarco Hayduk commented on MAHOUT-709:
-------------------------------------
OK. I found an issue - you need to remove the topdown mining completely to
avoid generating redundant patterns. Now I get a 56kb pattern file instead of
1499kb one ;)
The pattern mining on any level needs to be done in a bottom-up fashion only.
The current implementation is mining the patterns in a top-down fashion only at
a certain level. Will submit a patch once I am done. Further, will try to
refactor the code into logical peaces (FP-Bonsai pruning, counting etc etc).
> FP-Growth Redundant patterns
> ----------------------------
>
> Key: MAHOUT-709
> URL: https://issues.apache.org/jira/browse/MAHOUT-709
> Project: Mahout
> Issue Type: Bug
> Components: Frequent Itemset/Association Rule Mining
> Affects Versions: 0.4, 0.5
> Reporter: Yarco Hayduk
> Assignee: Robin Anil
> Labels: fp-growth, frequent, parallel, pattern
> Fix For: 0.6
>
> Attachments: SixTransactions.dat, bresult-new.txt, dumpedPatterns,
> patterns-converted.txt
>
>
> The algorithm outputs more patterns that it is needed.
> I have tested Mahout's PFP-Growth algorithm with the
> http://www.borgelt.net/fpgrowth.html FP-Growth implementation. This
> implementation has an option to generate closed patterns too.
> When I filtered out the sub patterns from the output of Parallel FP-Growth I
> arrived to the same result, as in http://www.borgelt.net/fpgrowth.html
> Succinctly, you are not outputting closed items
> I am attaching the dummy DB along with the output of both algorithms
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
