Hi Jeniba,
The second part of this meetup recording has a very good answer to your
question. TD explains the current behavior and the on-going work in Spark
Streaming to fix HA.
https://www.youtube.com/watch?v=jcJq3ZalXD8
-kr, Gerard.
On Tue, Dec 16, 2014 at 11:32 AM, Jeniba Johnson
TD's portion seems to start at 27:24: http://youtu.be/jcJq3ZalXD8?t=27m24s
On Tue Dec 16 2014 at 7:13:43 AM Gerard Maas gerard.m...@gmail.com wrote:
Hi Jeniba,
The second part of this meetup recording has a very good answer to your
question. TD explains the current behavior and the on-going
We are prototyping an application with Spark streaming and Kinesis. We use
kinesis to accept incoming txn data, and then process them using spark
streaming. So far we really liked both technologies, and we saw both
technologies are getting mature rapidly. We are almost settled to use these
two
Hi Wei,
On Tue, Aug 19, 2014 at 10:18 AM, Wei Liu wei@stellarloyalty.com
wrote:
Since our application cannot tolerate losing customer data, I am wondering
what is the best way for us to address this issue.
1) We are thinking writing application specific logic to address the data
loss. To
, still need
to improve at some points ☺.
Thanks
Jerry
From: Tobias Pfeiffer [mailto:t...@preferred.jp]
Sent: Tuesday, August 19, 2014 10:47 AM
To: Wei Liu
Cc: user
Subject: Re: Data loss - Spark streaming and network receiver
Hi Wei,
On Tue, Aug 19, 2014 at 10:18 AM, Wei Liu
wei
[mailto:t...@preferred.jp]
*Sent:* Tuesday, August 19, 2014 10:47 AM
*To:* Wei Liu
*Cc:* user
*Subject:* Re: Data loss - Spark streaming and network receiver
Hi Wei,
On Tue, Aug 19, 2014 at 10:18 AM, Wei Liu wei@stellarloyalty.com
wrote:
Since our application cannot tolerate losing
to be carefully considered.
So currently it is hard to make sure no data loss in Spark Streaming, still
need to improve at some points J.
Thanks
Jerry
*From:* Tobias Pfeiffer [mailto:t...@preferred.jp]
*Sent:* Tuesday, August 19, 2014 10:47 AM
*To:* Wei Liu
*Cc:* user
*Subject:* Re: Data loss
