Re: Programmatic method of setting consumer groups offsets

2019-01-03 Thread Nimi Wariboko Jr
I’ll look into assign - I think the issue I am having is often I will want to do these offset resets after the my consumer group has crashed. I guess what may be happening is that kafka still thinks there are active consumers even though they have crashed. From

Re: Programmatic method of setting consumer groups offsets

2019-01-03 Thread Nimi Wariboko Jr
I’ll look into assign - I think the issue I am having is often I will want to do these offset resets after the my consumer group has crashed. I guess what may be happening is that kafka still thinks there are active consumers even though they have crashed. From

Re: Horizontally Scaling Kafka Consumers

2015-04-29 Thread Nimi Wariboko Jr
ill > > > become active. > > > > > > Kind regards, > > > Stevo Slavic. > > > > > > On Wed, Apr 29, 2015 at 2:25 PM, David Corley > > > wrote: > > > > > > > If the 100 partitions are all for the same topic, you can ha

Horizontally Scaling Kafka Consumers

2015-04-29 Thread Nimi Wariboko Jr
Hi, I was wondering what options there are/what other people are doing for horizontally scaling kafka consumers? Basically if I have 100 partitions and 10 consumers, and want to temporarily scale up to 50 consumers, what can I do? So far I've thought of just simply tracking consumer membership so

Horizontally Scaling Kafka Consumers

2015-04-29 Thread Nimi Wariboko Jr
Hi, I was wondering what options there are for horizontally scaling kafka consumers? Basically if I have 100 partitions and 10 consumers, and want to temporarily scale up to 50 consumers, what options do I have? So far I've thought of just simply tracking consumer membership somehow (either throu