Re: [Pyspark 2.3+] Timeseries with Spark

2019-12-29 Thread Masood Krohy
Hi Rishi, Spark and Flint are useful during the data engineering phase, but you'd need to look elsewhere after that. I'm not aware of any active Spark-native project to do ML/forecast on time series data. If the data that you want to train the model on can fit in one node's memory, you can

Re: [Pyspark 2.3+] Timeseries with Spark

2019-12-29 Thread Rishi Shah
Hi All, Checking in to see if anyone had input around time series libraries using Spark. I in interested in financial forecasting model & regression mainly at this point. Input is a bunch of pricing data points. I have read a lot of spark-timeseries and flint libraries but I am not sure of the

Re: [Pyspark 2.3+] Timeseries with Spark

2019-06-16 Thread Rishi Shah
Thanks Jorn. I am interested in timeseries forecasting for now but in general I was unable to find a good way to work with different time series methods using spark.. On Fri, Jun 14, 2019 at 1:55 AM Jörn Franke wrote: > Time series can mean a lot of different things and algorithms. Can you >

Re: [Pyspark 2.3+] Timeseries with Spark

2019-06-13 Thread Jörn Franke
Time series can mean a lot of different things and algorithms. Can you describe more what you mean by time series use case, ie what is the input, what do you like to do with the input and what is the output? > Am 14.06.2019 um 06:01 schrieb Rishi Shah : > > Hi All, > > I have a time series

[Pyspark 2.3+] Timeseries with Spark

2019-06-13 Thread Rishi Shah
Hi All, I have a time series use case which I would like to implement in Spark... What would be the best way to do so? Any built in libraries? -- Regards, Rishi Shah