Storm benchmarks: UI stat updates

2018-04-20 Thread Alessio Pagliari
Hi everybody, I’m doing some benchmarking to check the behaviour of Storm over time, so I’m just retrieving each 10 seconds the total amount of tuples emitted per executor, via the UI APIs, and from that I compute the last 10 seconds value. I noticed that pretty regularly I obtain a peak in the

Re: Distinguish between failed and timed out tuples

2018-04-20 Thread Stig Rohde Døssing
1) No. Storm doesn't know whether a tuple failed due to fail() being called, or due to the timeout. If you want to try and build some mechanism to distinguish the cases, you should look at the Acker bolt https://github.com/apache/storm/blob/09e01231cc427004bab475c9c70f21fa79cfedef/storm-client/src/

Distinguish between failed and timed out tuples

2018-04-20 Thread Java Progarammer
Hi, I have few doubts regarding how retries work in storm 1) In spouts fail method I want to distinguish between the tuples that are failed because they timed out or they failed because one of the bolt called fail() on them. Does storm have some inbuilt mechanism for this ? 2) When calling fail