Reinforcement Learning with Spark

Hi All, Is there any Reinforcement Learning algorithm implemented with Spark -i.e. any link to GitHub/open source project etc.? Best, Md. Rezaul Karim, BSc, MSc Research Scientist, Fraunhofer FIT, Germany Ph.D. Researcher, Information Systems, RWTH Aachen University, Germany eMail:

Re: Apache Spark - Question about Structured Streaming Sink addBatch dataframe size

Hi Jacek: The javadoc mentions that we can only consume data from the data frame in the addBatch method.  So, if I would like to save the data to a new sink then I believe that I will need to collect the data and then save it.  This is the reason I am asking about how to control the size of

Spark MLlib Question - Online Scoring of PipelineModel

Is Spark planning to support *online scoring* (without any Spark dependencies) of a PipelineModel trained offline? Not being able to do so is a huge barrier to entry for using Spark in production at my company... For online support, I found this https://github.com/combust/mleap Any feedback on