Re: Spark Local Pipelines

2017-03-12 Thread Georg Heiler
Great idea. I see the same problem. I would suggest checking the following projects as a kick start as well ( not only mleap) https://github.com/ucbrise/clipper and https://github.com/Hydrospheredata/mist Regards Georg Asher Krim schrieb am So. 12. März 2017 um 23:21: > Hi All, > > I spent a lot

Spark Local Pipelines

2017-03-12 Thread Asher Krim
Hi All, I spent a lot of time at Spark Summit East this year talking with Spark developers and committers about challenges with productizing Spark. One of the biggest shortcomings I've encountered in Spark ML pipelines is the lack of a way to serve single requests with any reasonable performance.

SPIP docs are live

2017-03-12 Thread Sean Owen
http://spark.apache.org/improvement-proposals.html (Thanks Cody!) We should use this process where appropriate now, and we can refine it further if needed.