No real time in Spark unless near real time is your real time :-) Use Spark ML Pipeline API inside Spark Streaming workflow.
Jacek On 13 Jul 2016 5:57 p.m., "Danilo Rizzo" <dani.ri...@gmail.com> wrote: > Hi All, I'm trying to create a ML pipeline that is in charge of the model > training. > In my use case I have the need to evaluate the mode in real time from an > external application; googling I saw that I can submit a spark job using > the submit API. > > Not sure if this is the best way to achieve that, any thoughts? I'm > wondering if it is able to manage a lot of requests of model evaluation > keeping the response time faster enough to be used in a web application > > -- > Danilo Rizzo >
