Re: Revisiting Online serving of Spark models?

t; > >>>>>> @holden/felix/nick/joseph/maximiliano/saikat/leif: you’re more > than > > >>>>>> welcome to give a talk. I can move things around to make room. > > >>>>>> > > >>>>>> @josep

Re: Revisiting Online serving of Spark models?

bricks proprietary ML Serving export format which is similar to > >>>>>> PMML > >>>>>> but not a standard in any way. > >>>>>> > >>>>>> Also, the Databricks ML Serving Runtime is only available to > >>>>>> Databricks customers. This seems in conflict wi

Re: Revisiting Online serving of Spark models?

I've almost completed a library for speeding up current spark models serving - https://github.com/Hydrospheredata/fastserving. It depends on spark, but it provides a way to turn spark logical plan from dataframe sample, that was passed into pipeline/transformer, into an alternative transformer

Re: Revisiting Online serving of Spark models?

e direction of the > >>>>>> Databricks proprietary ML Serving export format which is similar to > >>>>>> PMML > >>>>>> but not a standard in any way. > >>>>>> > >>>>>> Also, th

Re: Revisiting Online serving of Spark models?

;> Also, the Databricks ML Serving Runtime is only available to >>>>>> Databricks customers. This seems in conflict with the community >>>>>> efforts >>>>>> described here. Can you comment on behalf of Databricks? >>>>>> >

Re: Revisiting Online serving of Spark models?

gt;>> >>>>> *Chris Fregly *Founder @ *PipelineAI* <https://pipeline.ai/> (100,000 >>>>> Users) >>>>> Organizer @ *Advanced Spark and TensorFlow Meetup* >>>>> <https://www.meetup.com/Advanced-Spark-and-TensorFlow-Meetup/>

Re: Revisiting Online serving of Spark models?

/> (85,000 >>>> Global Members) >>>> >>>> >>>> >>>> *San Francisco - Chicago - Austin - >>>> Washington DC - London - Dusseldorf * >>>> *Try our PipelineAI Community Edition with GPUs and TPUs!! >>>> <http://community.pipeline.ai/>* >

Re: Revisiting Online serving of Spark models?

elineAI Community Edition with GPUs and TPUs!! >>> <http://community.pipeline.ai/>* >>> >>> >>> On May 30, 2018, at 9:32 AM, Felix Cheung >>> wrote: >>> >>> Hi! >>> >>> Thank you! Let’s meet then >>> >&

Re: Revisiting Online serving of Spark models?

t; >> Thank you! Let’s meet then >> >> June 6 4pm >> >> Moscone West Convention Center >> 800 Howard Street, San Francisco, CA 94103 >> <https://maps.google.com/?q=800+Howard+Street,+San+Francisco,+CA+94103=gmail=g> >> >> Ground floor (outside of

Re: Revisiting Online serving of Spark models?

ase Joseph, we will use this to kick off the discusssion and > post notes after and follow up online. As for Seattle, I would be very > interested to meet in person lateen and discuss ;) > > > _ > From: Saikat Kanjilal > Sent: Tuesday, May 29, 2018 11:46 AM &g

Re: Revisiting Online serving of Spark models?

and post notes after and follow up online. As for Seattle, I would be very interested to meet in person lateen and discuss ;) _ From: Saikat Kanjilal mailto:sxk1...@hotmail.com>> Sent: Tuesday, May 29, 2018 11:46 AM Subject: Re: Revisiting Online servi

Re: Revisiting Online serving of Spark models?

. As for Seattle, I would be very interested > to meet in person lateen and discuss ;) > > > _____ > From: Saikat Kanjilal > Sent: Tuesday, May 29, 2018 11:46 AM > Subject: Re: Revisiting Online serving of Spark models? > To: Maximiliano Felice > Cc: Felix Cheung , Holden

Re: Revisiting Online serving of Spark models?

> From: Saikat Kanjilal > Sent: Tuesday, May 29, 2018 11:46 AM > > Subject: Re: Revisiting Online serving of Spark models? > To: Maximiliano Felice > Cc: Felix Cheung , Holden Karau < > hol...@pigscanfly.ca>, Joseph Bradley , Leif Walsh > , dev > >

Re: Revisiting Online serving of Spark models?

: Re: Revisiting Online serving of Spark models? To: Maximiliano Felice Cc: Felix Cheung , Holden Karau , Joseph Bradley , Leif Walsh , dev Would love to join but am in Seattle, thoughts on how to make this work? Regards Sent from my iPhone On May 29, 2018, at 10:35 AM, Maximiliano Felice

Re: Revisiting Online serving of Spark models?

>> wrote: Bump. From: Felix Cheung mailto:felixcheun...@hotmail.com>> Sent: Saturday, May 26, 2018 1:05:29 PM To: Saikat Kanjilal; Maximiliano Felice; Joseph Bradley Cc: Leif Walsh; Holden Karau; dev Subject: Re: Revisiting Online serving of Spark mode

Re: Revisiting Online serving of Spark models?

9, 2018 9:47 AM > Subject: Re: Revisiting Online serving of Spark models? > To: Felix Cheung > Cc: Saikat Kanjilal , Maximiliano Felice < > maximilianofel...@gmail.com>, Joseph Bradley , > Leif Walsh , dev > > > > I'm down for that, we could all go for a walk

Re: Revisiting Online serving of Spark models?

You had me at blue bottle! _ From: Holden Karau Sent: Tuesday, May 29, 2018 9:47 AM Subject: Re: Revisiting Online serving of Spark models? To: Felix Cheung Cc: Saikat Kanjilal , Maximiliano Felice , Joseph Bradley , Leif Walsh , dev I'm down for that, we could

Re: Revisiting Online serving of Spark models?

ung > *Sent:* Saturday, May 26, 2018 1:05:29 PM > *To:* Saikat Kanjilal; Maximiliano Felice; Joseph Bradley > *Cc:* Leif Walsh; Holden Karau; dev > > *Subject:* Re: Revisiting Online serving of Spark models? > > Hi! How about we meet the community and discuss on June 6 4pm at (near) >

Re: Revisiting Online serving of Spark models?

Bump. From: Felix Cheung Sent: Saturday, May 26, 2018 1:05:29 PM To: Saikat Kanjilal; Maximiliano Felice; Joseph Bradley Cc: Leif Walsh; Holden Karau; dev Subject: Re: Revisiting Online serving of Spark models? Hi! How about we meet the community and discuss

Re: Revisiting Online serving of Spark models?

2018 7:47:07 AM To: Maximiliano Felice Cc: Leif Walsh; Felix Cheung; Holden Karau; Joseph Bradley; dev Subject: Re: Revisiting Online serving of Spark models? I’m in the same exact boat as Maximiliano and have use cases as well for model serving and would love to join this discussion. Sent f

Re: Revisiting Online serving of Spark models?

__ From: Felix Cheung <felixcheun...@hotmail.com<mailto:felixcheun...@hotmail.com>> Sent: Thursday, May 10, 2018 10:10 AM Subject: Re: Revisiting Online serving of Spark models? To: Holden Karau <hol...@pigscanfly.ca<mailto:hol...@pigscanfly.ca>>, Joseph Bradley <jos

Re: Revisiting Online serving of Spark models?

> >>> What’s the next step? Would folks be interested in getting together to >>> discuss/get some feedback? >>> >>> >>> _ >>> From: Felix Cheung <felixcheun...@hotmail.com> &g

Re: Revisiting Online serving of Spark models?

>> What’s the next step? Would folks be interested in getting together to >> discuss/get some feedback? >> >> >> _____ >> From: Felix Cheung <felixcheun...@hotmail.com> >> Sent: Thursday, May 10, 2018 10:10 AM >> Subject: R

Re: Revisiting Online serving of Spark models?

+1 on meeting up! From: Holden Karau <hol...@pigscanfly.ca> Sent: Monday, May 21, 2018 2:52:20 PM To: Joseph Bradley Cc: Felix Cheung; dev Subject: Re: Revisiting Online serving of Spark models? (Oh also the write API has already been extended to take f

Re: Revisiting Online serving of Spark models?

.org> >> >> >> >> Huge +1 on this! >> >> -- >> *From:* holden.ka...@gmail.com <holden.ka...@gmail.com> on behalf of >> Holden Karau <hol...@pigscanfly.ca> >> *Sent:* Thursday, May 10, 2018 9:39:26 A

Re: Revisiting Online serving of Spark models?

ned models >>> outside of Spark for online serving. >>> >>> What’s the next step? Would folks be interested in getting together to >>> discuss/get some feedback? >>> >>> >>> _ >>> From: Felix Cheung <

Re: Revisiting Online serving of Spark models?

gt; _ > From: Felix Cheung <felixcheun...@hotmail.com> > Sent: Thursday, May 10, 2018 10:10 AM > Subject: Re: Revisiting Online serving of Spark models? > To: Holden Karau <hol...@pigscanfly.ca>, Joseph Bradley < > j

Re: Revisiting Online serving of Spark models?

be interested in getting together to discuss/get some feedback? _ From: Felix Cheung <felixcheun...@hotmail.com> Sent: Thursday, May 10, 2018 10:10 AM Subject: Re: Revisiting Online serving of Spark models? To: Holden Karau <hol...@pigscanfly.ca>, Joseph

Re: Revisiting Online serving of Spark models?

Huge +1 on this! From: holden.ka...@gmail.com <holden.ka...@gmail.com> on behalf of Holden Karau <hol...@pigscanfly.ca> Sent: Thursday, May 10, 2018 9:39:26 AM To: Joseph Bradley Cc: dev Subject: Re: Revisiting Online serving of Spark models? On

Re: Revisiting Online serving of Spark models?

On Thu, May 10, 2018 at 9:25 AM, Joseph Bradley wrote: > Thanks for bringing this up Holden! I'm a strong supporter of this. > > Awesome! I'm glad other folks think something like this belongs in Spark. > This was one of the original goals for mllib-local: to have local

Re: Revisiting Online serving of Spark models?

Thanks for bringing this up Holden! I'm a strong supporter of this. This was one of the original goals for mllib-local: to have local versions of MLlib models which could be deployed without the big Spark JARs and without a SparkContext or SparkSession. There are related commercial offerings

Revisiting Online serving of Spark models?

Hi y'all, With the renewed interest in ML in Apache Spark now seems like a good a time as any to revisit the online serving situation in Spark ML. DB & other's have done some excellent working moving a lot of the necessary tools into a local linear algebra package that doesn't depend on having a