Is "spark streaming" streaming or mini-batch?
I look at something Like Complex Event Processing (CEP) which is a leader
use case for data streaming (and I am experimenting with Spark for it) and
in the realm of CEP there is really no such thing as continuous data
streaming. The point is
On 23 Aug 2016, at 17:58, Mich Talebzadeh
> wrote:
In general depending what you are doing you can tighten above parameters. For
example if you are using Spark Streaming for Anti-fraud detection, you may
stream data in at 2 seconds
ex.de/blog/storm-in-a-teacup/
> <https://www.inovex.de/blog/storm-in-a-teacup/> and it mentioned that spark
> streaming actually mini-batch not actual streaming.
>
> I have not used streaming and I am not sure what is the difference in the 2
> terms. Hence could not make a judgement myself.
>
Thanks everyone for clarifying.
On Tue, Aug 23, 2016 at 9:11 PM, Aseem Bansal <asmbans...@gmail.com> wrote:
> I was reading this article https://www.inovex.de/blog/storm-in-a-teacup/
> and it mentioned that spark streaming actually mini-batch not actual
> streaming.
>
> I ha
ug 23, 2016 at 8:41 AM Aseem Bansal <asmbans...@gmail.com> wrote:
>
>> I was reading this article https://www.inovex.de/blog/storm-in-a-teacup/
>> and it mentioned that spark streaming actually mini-batch not actual
>> streaming.
>>
>> I have not used streaming and I am not sure what is the difference in the
>> 2 terms. Hence could not make a judgement myself.
>>
>
ementation dependent
On Tue, Aug 23, 2016 at 8:41 AM Aseem Bansal <asmbans...@gmail.com> wrote:
> I was reading this article https://www.inovex.de/blog/storm-in-a-teacup/
> and it mentioned that spark streaming actually mini-batch not actual
> streaming.
>
> I have
It's based on "micro batching" model.
Sent from my iPhone
> On Aug 23, 2016, at 8:41 AM, Aseem Bansal <asmbans...@gmail.com> wrote:
>
> I was reading this article https://www.inovex.de/blog/storm-in-a-teacup/ and
> it mentioned that spark streaming actually min
I was reading this article https://www.inovex.de/blog/storm-in-a-teacup/
and it mentioned that spark streaming actually mini-batch not actual
streaming.
I have not used streaming and I am not sure what is the difference in the 2
terms. Hence could not make a judgement myself.