It may be relevant to note that Cython has recently gained some OpenMP support: http://docs.cython.org/src/userguide/parallelism.html -- I haven't tried it, but perhaps it could help improve the scikit-learn implementation.
-Ken On Dec 23, 2011 7:31 AM, "Benjamin Hepp" <[email protected]> wrote: > > Hi, > > I was wondering about the KMeans implementation in scikit-learn. From a > quick scan of the code I see that the main stuff is implemented in > Cython but it's spread in two different functions for the m- and the > e-step and the main loop is in python. I'm using my own KMeans routine > written as a Python C-module making use of OpenMP (it actually scales > really well). > > For consistency I would like to switch to scikit-learn completely so I > could either make a new KMeans classifier (there's already KMeans and > MiniBatchKMeans), maybe call it KMeansParallel or so. Or I could modify > the existing KMeans classifier. What do you think is more appropriate? > > Cheers, > Benni > > > > > ------------------------------------------------------------------------------ > Write once. Port to many. > Get the SDK and tools to simplify cross-platform app development. Create > new or port existing apps to sell to consumers worldwide. Explore the > Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join > http://p.sf.net/sfu/intel-appdev > _______________________________________________ > Scikit-learn-general mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/scikit-learn-general > ------------------------------------------------------------------------------ Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev _______________________________________________ Scikit-learn-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
