Hi Bobby,

Thank you very much for the reply.

I have created a git repository with my code in [1].

`RepeatWordsSpout` in [2] is just keeps repeating the same set of words in
different batches.

In `RWEmitter`[3],  I use a hash map to keep track of the batches emitted
and remove a batch
from the map after the batch successfully gets processed.

Other code is just boiler plate.


[1] https://github.com/thilinarmtb/trident-demo
[2]
https://github.com/thilinarmtb/trident-demo/blob/master/src/main/java/trident/demo/spouts/RepeatWordsSpout.java
[3]
https://github.com/thilinarmtb/trident-demo/blob/master/src/main/java/trident/demo/spouts/RWEmitter.java



Regards,
Thilina

On Thu, Aug 6, 2015 at 4:48 PM, Thilina Rathnayake <[email protected]>
wrote:

> Hi All,
>
> I posted this question in user's mailing list as well. I am posting here
> because I
> am not sure whether this is a bug in trident or not.
>
> I am playing with a trident topology having a single spout. The topology
> simply
> counts the words emitted and stores it in redis [1]. I run this topology
> on 4 worker
> nodes.
>
> I deliberately shutdown one worker node and restart it and monitor the
> batch
> replay (I am logging the transaction id of the batches being emitted).
>
> I see the last batch which didn't complete before the shutdown gets
> re-emitted
> again and again without succeeding. Any idea why this happens?
> (I created the spout implementing `ITridentSpout`.)
>
> If I don't crash the server, the topology runs normally and finishes.
>
> Thanks in advance for any explanation about this.
>
> [1] http://redis.io/
>
> Regards,
> Thilina
>

Reply via email to