Re: Trident read from Kafka borkers, processes multiple times

2015-03-13 Thread Jake Dodd
Looks like you’re using OpaqueTridentKafkaSpout? topology.max.spout.pending, for a Trident spout, refers to the number of in-flight batches. When you set this number too high, OpaqueTridentKafkaSpout sort of freaks out and emits the same tuples in several batches. The batches aren’t failing;

Are metrics always sent at the time bucket interval?

2014-10-27 Thread Jake Dodd
Hi all, I have a bolt that registers a MultiCountMetric, with the time bucket set to 10 seconds. The metrics aren’t being sent until the bolt’s stream experiences a lull. For example, if I emit 10 tuples into the stream, and the bolt takes 8 seconds to process them, then the metrics will be