Re: Need help with troubleshooting a worker not processing messages

2015-03-20 Thread Girish Joshi
Thanks Taylor for your response. In my case, I have seen that 4 of my 15 kafka executors do not process any data; I will check what the kafka # of partitions is but looks like it may be just 11 in which case I should reduce the number of kafka executors. around 50 of the 550 mapperBoltExecutors

Need help with troubleshooting a worker not processing messages

2015-03-19 Thread Girish Joshi
I am trying to troubleshoot an issue with our storm cluster where a worker process on one of the machines in the cluster does not perform any work. All the counts(emitted/transferred/executed) for all executors in that worker are 0 as shown below. Even if I restart the worker, storm supervisor

Re: Need help with troubleshooting a worker not processing messages

2015-03-19 Thread P. Taylor Goetz
More information about your topology would help, but.. I’ll assume you’re using a core API topology (spouts/bolts). On the kafka spout side, does the spout parallelism == the # of kafka partitions? (It should.) On the bolt side, are you using fields groupings at all, and if so, what does the