Re: Dose v.011 support Spark ML, DataFrame and Pipeline

2017-04-21 Thread Fangzhou Yang
) From: Pat Ferrel Sent: Friday, April 21, 2017 1:55:42 AM To: user@predictionio.incubator.apache.org Subject: Re: Dose v.011 support Spark ML, DataFrame and Pipeline No, the API for Access to data in the EventServer does not require dataframes and so does not use them but

Re: Dose v.011 support Spark ML, DataFrame and Pipeline

2017-04-20 Thread Pat Ferrel
t: Wednesday, April 19, 2017 10:37:08 PM To: user@predictionio.incubator.apache.org Subject: Re: Dose v.011 support Spark ML, DataFrame and Pipeline There is no restriction in templates for what they use of Spark. The ones you are looking at simply don’t need those interfaces. If you need them and

Re: Dose v.011 support Spark ML, DataFrame and Pipeline

2017-04-19 Thread Fangzhou Yang
Is the template that you maintaining on the github? If yes, could you provide the link? Many Thanks, Fangzhou From: Pat Ferrel Sent: Wednesday, April 19, 2017 10:37:08 PM To: user@predictionio.incubator.apache.org Subject: Re: Dose v.011 support Spark ML, DataFra

Re: Dose v.011 support Spark ML, DataFrame and Pipeline

2017-04-19 Thread Pat Ferrel
There is no restriction in templates for what they use of Spark. The ones you are looking at simply don’t need those interfaces. If you need them and are writing templates you can use them. In fact I maintain a template that does not use Spark for the Algorithm, only for IO. If you think some n

Dose v.011 support Spark ML, DataFrame and Pipeline

2017-04-19 Thread Fangzhou Yang
Hi all, I'm new to predictionio. I just noticed that v0.11 can already support Spark 2.x, can it also currently support Spark ML, DataFrame and Pipeline. It seems the Algorithm interfaces support only Spark RDD. If SparkML is not supported for now, will it be on the roadmap? Are there anyone