Hello Benjamin, Have you take a look at the slides of my talk in Strata San Jose - http://www.slideshare.net/databricks/taking-spark-streaming-to-the-next-level-with-datasets-and-dataframes Unfortunately there is not video, as Strata does not upload videos for everyone. I presented the same talk at Kafka Summit couple of days back, that will probably get uploaded soon. Let me know if you have any more questions.
On Thu, Apr 28, 2016 at 5:19 AM, Benjamin Kim <bbuil...@gmail.com> wrote: > Can someone explain to me how the new Structured Streaming works in the > upcoming Spark 2.0+? I’m a little hazy how data will be stored and > referenced if it can be queried and/or batch processed directly from > streams and if the data will be append only to or will there be some sort > of upsert capability available. This almost sounds similar to what AWS > Kinesis is trying to achieve, but it can only store the data for 24 hours. > Am I close? > > Thanks, > Ben > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
