Too many errors in Kafka-Spout / Es-Bolt combination

Hi, I see an increasing number of tuple failures when increasing the number of Es-Bolt's parallelism beyond 20. One error I frequently see in the storm's worker logs is: 10:56:36.145 s.k.KafkaUtils [INFO] Task [4/6] assigned [Partition{host= kafka-broker01.xyz.com:9092, partition=3},

Re: Storm KafkaSpout Integration

Hey David, I would be interested in seeing what Kafka-Spouts you found online and why you found them better. Also, if you have your own Kafka-Spout opensourced in github, a link to that would be great too. Thanks Tid On Thu, Mar 31, 2016 at 2:21 AM, david kavanagh wrote:

RE: Storm KafkaSpout Integration

Hi Spico, I changed the parallelism as you suggested but it didn't work. Yesterday evening i gave up on using the KafkaSpout class that comes with storm. I found some Kafka consumer java classes online and wrote my own Kafka spout which is working fine. Thanks for the advice anyway.