[
https://issues.apache.org/jira/browse/MAHOUT-929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217028#comment-13217028
]
Saikat Kanjilal commented on MAHOUT-929:
----------------------------------------
In reading through the ClusterClassificationMapper I have some questions:
1) Do we need to worry about outlier removals when providing unit tests for the
map reduce
2) Is there a sample class I can look at to see how many mappers and reducers
to specify or is this baked into the unit tests from the mahouttest already
3) I am going to start with the simple test as Paritosh specified , something
that classifies whether or not the vectors were classified correctly, so to do
this I plan to take most of the code inside ClusterClassificationDriver and
make the changes to have this logic work for doing the operations in
map-reduce, let me know if there are issues with this approach
4) In the ClusterClassificationDriverTest I noticed we were using 3 clusters,
does it matter how many clusters we create, I was wondering what the
relationship is (if any) with the number of clusters to the actual map-reduce
operation of classification
> Refactor Clustering (Vector Classification) into a Separate Postprocess with
> Outlier Pruning
> --------------------------------------------------------------------------------------------
>
> Key: MAHOUT-929
> URL: https://issues.apache.org/jira/browse/MAHOUT-929
> Project: Mahout
> Issue Type: Improvement
> Components: Classification, Clustering
> Affects Versions: 0.6
> Reporter: Jeff Eastman
> Assignee: Paritosh Ranjan
> Fix For: 0.7
>
> Attachments: Mahout-929, Mahout-929, Mahout-929, Mahout-929
>
>
> The current clustering drivers have a -cp option to produce clusteredPoints
> directory containing the input vectors classified by the final clusters
> produced by the algorithm. These options are redundantly implemented in those
> drivers.
> - Factor out & implement an independent post processor to perform the
> classification step independently of the various clustering implementations.
> - Implement a pluggable outlier removal capability for this classifier.
> - Consider building off of the ClusterClassifier & ClusterIterator ideas.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
