I see now.
There are three steps in SparkStreaming + Kafka date processing
1.Receiving the data
2.Transforming the data
3.Pushing out the data
SparkStreaming + Kafka only provide an exactly-once guarantee on step 1 2
We need to ensure exactly once on step 3 by myself.
More details see base
Yes. More information in my talk -
https://www.youtube.com/watch?v=d5UJonrruHk
On Fri, Jul 17, 2015 at 1:15 AM, JoneZhang joyoungzh...@gmail.com wrote:
I see now.
There are three steps in SparkStreaming + Kafka date processing
1.Receiving the data
2.Transforming the data
3.Pushing out the
