I think you need to be a little bit more specific as to what you are proposing exactly. I think "uniform clustering api" needs a bit of elaboration. I, generally, cannot say that I experienced any pain calling out clustering algorithms say in R as a well-documented function. In Mahout just doing the same was primarily a pain; but assuming one can call it with ease and even interactively, I can't say I experienced any major inconvenience with just doing this.
I guess one can see that one can abstract away notions of clusters and clustering output, but I don't have enough experience to tell whether it is a good idea to cover _any_ possible clustering methodology. On Tue, Mar 18, 2014 at 10:50 PM, chalitha udara Perera < [email protected]> wrote: > Hi everyone, > > Greatly appreciate your interest on this issue. I have gone through the > document ScalaSparkBindings [1] . In this project my initial idea was to > provide high level API for end user programmers so that they have the > flexibility of plugin in different types of algorithms without concerning > about underline details of different types of inputs or outputs. Also I > consider providing proper test coverage for all clustering algorithm is a > must for the 1.0 release. > > Would like to get your opinion regarding this and little more detail on > current requirements for clustering would help me to improve proposal. > > Thanks, > Chalitha > > > > On Mon, Mar 17, 2014 at 11:21 PM, Dmitriy Lyubimov <[email protected] > >wrote: > > > Yes. there's interest. > > Note that we are trying to unify linear algebra primitives and > optimization > > on Spark as well. All new linear algebra and interaction with spark > context > > should probably go thru this layer. This is ongoing thing but some stuff > is > > working [1] > > > > [1] mAHOUT-1346 https://issues.apache.org/jira/browse/MAHOUT-1346 > > > > > > On Mon, Mar 17, 2014 at 10:37 AM, chalitha udara Perera < > > [email protected]> wrote: > > > > > Hi All, > > > > > > Going through the mail tread Mahout 1.0 goals, I found that the main > > focus > > > of mahout is now towards the code re-factoring and integration with > Spark > > > rather than implementing new algorithms. Recently I have used mahout > for > > > implementing document clustering module a Content Management System. > > > > > > To be honest we had some problems with lack of uniformity among > different > > > clustering algorithms. For example simple Kmeans takes input as the > > > sequence file with document TF-IDF vectors, while Spectral Kmeans takes > > the > > > csv file that defines the similarity matrix. > > > > > > I think if we can provide a uniform clustering API as mentioned in 1.0 > > > goals, it would be very useful for end user developers. > > > > > > I would like to proceed with this idea as my GSOC 2014 project. Please > > let > > > me know if you are interested in this project > > > -- > > > J.M Chalitha Udara Perera > > > > > > *Department of Computer Science and Engineering,* > > > *University of Moratuwa,* > > > *Sri Lanka* > > > > > > > > > -- > J.M Chalitha Udara Perera > > *Department of Computer Science and Engineering,* > *University of Moratuwa,* > *Sri Lanka* >
