Re: Is "spark streaming" streaming or mini-batch?

2016-08-24 Thread Mich Talebzadeh
Is "spark streaming" streaming or mini-batch? I look at something Like Complex Event Processing (CEP) which is a leader use case for data streaming (and I am experimenting with Spark for it) and in the realm of CEP there is really no such thing as continuous data streaming. The point is

Re: Is "spark streaming" streaming or mini-batch?

2016-08-24 Thread Steve Loughran
On 23 Aug 2016, at 17:58, Mich Talebzadeh > wrote: In general depending what you are doing you can tighten above parameters. For example if you are using Spark Streaming for Anti-fraud detection, you may stream data in at 2 seconds

Re: Is "spark streaming" streaming or mini-batch?

2016-08-23 Thread Matei Zaharia
ex.de/blog/storm-in-a-teacup/ > <https://www.inovex.de/blog/storm-in-a-teacup/> and it mentioned that spark > streaming actually mini-batch not actual streaming. > > I have not used streaming and I am not sure what is the difference in the 2 > terms. Hence could not make a judgement myself. >

Re: Is "spark streaming" streaming or mini-batch?

2016-08-23 Thread Aseem Bansal
Thanks everyone for clarifying. On Tue, Aug 23, 2016 at 9:11 PM, Aseem Bansal <asmbans...@gmail.com> wrote: > I was reading this article https://www.inovex.de/blog/storm-in-a-teacup/ > and it mentioned that spark streaming actually mini-batch not actual > streaming. > > I ha

Re: Is "spark streaming" streaming or mini-batch?

2016-08-23 Thread Mich Talebzadeh
ug 23, 2016 at 8:41 AM Aseem Bansal <asmbans...@gmail.com> wrote: > >> I was reading this article https://www.inovex.de/blog/storm-in-a-teacup/ >> and it mentioned that spark streaming actually mini-batch not actual >> streaming. >> >> I have not used streaming and I am not sure what is the difference in the >> 2 terms. Hence could not make a judgement myself. >> >

Re: Is "spark streaming" streaming or mini-batch?

2016-08-23 Thread Russell Spitzer
ementation dependent On Tue, Aug 23, 2016 at 8:41 AM Aseem Bansal <asmbans...@gmail.com> wrote: > I was reading this article https://www.inovex.de/blog/storm-in-a-teacup/ > and it mentioned that spark streaming actually mini-batch not actual > streaming. > > I have

Re: Is "spark streaming" streaming or mini-batch?

2016-08-23 Thread pandees waran
It's based on "micro batching" model. Sent from my iPhone > On Aug 23, 2016, at 8:41 AM, Aseem Bansal <asmbans...@gmail.com> wrote: > > I was reading this article https://www.inovex.de/blog/storm-in-a-teacup/ and > it mentioned that spark streaming actually min

Is "spark streaming" streaming or mini-batch?

2016-08-23 Thread Aseem Bansal
I was reading this article https://www.inovex.de/blog/storm-in-a-teacup/ and it mentioned that spark streaming actually mini-batch not actual streaming. I have not used streaming and I am not sure what is the difference in the 2 terms. Hence could not make a judgement myself.