Hi everyone, Greatly appreciate your interest on this issue. I have gone through the document ScalaSparkBindings [1] . In this project my initial idea was to provide high level API for end user programmers so that they have the flexibility of plugin in different types of algorithms without concerning about underline details of different types of inputs or outputs. Also I consider providing proper test coverage for all clustering algorithm is a must for the 1.0 release.
Would like to get your opinion regarding this and little more detail on current requirements for clustering would help me to improve proposal. Thanks, Chalitha On Mon, Mar 17, 2014 at 11:21 PM, Dmitriy Lyubimov <[email protected]>wrote: > Yes. there's interest. > Note that we are trying to unify linear algebra primitives and optimization > on Spark as well. All new linear algebra and interaction with spark context > should probably go thru this layer. This is ongoing thing but some stuff is > working [1] > > [1] mAHOUT-1346 https://issues.apache.org/jira/browse/MAHOUT-1346 > > > On Mon, Mar 17, 2014 at 10:37 AM, chalitha udara Perera < > [email protected]> wrote: > > > Hi All, > > > > Going through the mail tread Mahout 1.0 goals, I found that the main > focus > > of mahout is now towards the code re-factoring and integration with Spark > > rather than implementing new algorithms. Recently I have used mahout for > > implementing document clustering module a Content Management System. > > > > To be honest we had some problems with lack of uniformity among different > > clustering algorithms. For example simple Kmeans takes input as the > > sequence file with document TF-IDF vectors, while Spectral Kmeans takes > the > > csv file that defines the similarity matrix. > > > > I think if we can provide a uniform clustering API as mentioned in 1.0 > > goals, it would be very useful for end user developers. > > > > I would like to proceed with this idea as my GSOC 2014 project. Please > let > > me know if you are interested in this project > > -- > > J.M Chalitha Udara Perera > > > > *Department of Computer Science and Engineering,* > > *University of Moratuwa,* > > *Sri Lanka* > > > -- J.M Chalitha Udara Perera *Department of Computer Science and Engineering,* *University of Moratuwa,* *Sri Lanka*
