Re: GPU Acceleration of Spark Logistic Regression and Other MLlib libraries

2016-01-22 Thread John Canny
Hi Rajesh, FYI, we are developing our own version of BIDMach integration with Spark, and achieving large gains over Spark MLLib for both CPU and GPU computation. You can find the project here: https://github.com/BIDData/BIDMach_Spark I'm not sure I follow your comment "However, I think compari

Re: GPU Acceleration of Spark Logistic Regression and Other MLlib libraries

2016-01-22 Thread Sam Halliday
Hi all, (I'm author of netlib-java) Interesting to see this discussion come to life again. JNI is quite limiting: pinning (or critical array access) essentially disables the GC for the whole JVM for the duration of the native call. I can justify this for CPU heavy tasks because frankly there are