Running in-memory SQL on streamed relational data

2015-02-28 Thread Ashish Mukherjee
Hi, I have been looking at Spark Streaming , which seems to be for the use case of live streams which are processed one line at a time generally in real-time. Since SparkSQL reads data from some filesystem, I was wondering if there is something which connects SparkSQL with Spark Streaming, so I

Re: Running in-memory SQL on streamed relational data

2015-02-28 Thread Akhil Das
I think you can do simple operations like foreachRDD or transform to get access to the RDDs in the stream and then you can do SparkSQL over it. Thanks Best Regards On Sat, Feb 28, 2015 at 3:27 PM, Ashish Mukherjee ashish.mukher...@gmail.com wrote: Hi, I have been looking at Spark Streaming