Re: Programmatic method of setting consumer groups offsets

2019-01-03 Thread Nimi Wariboko Jr
tition. I suspect you are trying to > commit partitions that the consumer is not subscribed to. > > Ryanne > > On Thu, Jan 3, 2019, 6:13 PM Nimi Wariboko < > nimi.warib...@livereachmedia.com > wrote: > > > Hi, > > > > Is there a guide or API that is implem

Re: Programmatic method of setting consumer groups offsets

2019-01-03 Thread Nimi Wariboko Jr
tition. I suspect you are trying to > commit partitions that the consumer is not subscribed to. > > Ryanne > > On Thu, Jan 3, 2019, 6:13 PM Nimi Wariboko < > nimi.warib...@livereachmedia.com > wrote: > > > Hi, > > > > Is there a guide or API that is implem

Programmatic method of setting consumer groups offsets

2019-01-03 Thread Nimi Wariboko
Hi, Is there a guide or API that is implemented that can modify stored offsets in Kafka? For example, I'm looking to set a consumer groups stored offsets in Kafka to a specific value. I know there is the `kafka-consumer-groups` CLI command, but I'm looking for a way to do so from an

Re: Horizontally Scaling Kafka Consumers

2015-04-30 Thread Nimi Wariboko Jr
than there are partitions within a given consumer group. On 29 April 2015 at 08:41, Nimi Wariboko Jr n...@channelmeter.com wrote: Hi, I was wondering what options there are for horizontally scaling kafka consumers? Basically if I have 100 partitions and 10

Horizontally Scaling Kafka Consumers

2015-04-29 Thread Nimi Wariboko Jr
Hi, I was wondering what options there are for horizontally scaling kafka consumers? Basically if I have 100 partitions and 10 consumers, and want to temporarily scale up to 50 consumers, what options do I have? So far I've thought of just simply tracking consumer membership somehow (either

Horizontally Scaling Kafka Consumers

2015-04-29 Thread Nimi Wariboko Jr
Hi, I was wondering what options there are/what other people are doing for horizontally scaling kafka consumers? Basically if I have 100 partitions and 10 consumers, and want to temporarily scale up to 50 consumers, what can I do? So far I've thought of just simply tracking consumer membership