Re: Kafka consumers in cluster

2016-08-06 Thread sat
Thanks Kamal, >Yes, it gets called on every re-balance. >-- Kamal On Thu, Aug 4, 2016 at 10:54 AM, sat wrote: > Hi Kamal, > > Thanks for your prompt response. Does our custom partition assignor gets > called during every rebalancing. > > Thanks and Regards > A.SathishKumar > > > > >Implement

Re: Kafka consumers in cluster

2016-08-04 Thread Kamal C
Yes, it gets called on every re-balance. -- Kamal On Thu, Aug 4, 2016 at 11:24 PM, sat wrote: > Hi Kamal, > > Thanks for your prompt response. Does our custom partition assignor gets > called during every rebalancing. > > Thanks and Regards > A.SathishKumar > > > > >Implement your own custom >

Re: Kafka consumers in cluster

2016-08-04 Thread sat
Hi Kamal, Thanks for your prompt response. Does our custom partition assignor gets called during every rebalancing. Thanks and Regards A.SathishKumar >Implement your own custom >`org.apache.kafka.clients.consumer.internals.PartitionAssignor` >and assign all the subscribed partitions to the fir

Re: Kafka consumers in cluster

2016-08-03 Thread Kamal C
Implement your own custom `org.apache.kafka.clients.consumer.internals.PartitionAssignor` and assign all the subscribed partitions to the first consumer instance in the group. See 'partition.assignment.strategy' config in the consumer configs [1] [1]: http://kafka.apache.org/documentation.html#ne

Kafka consumers in cluster

2016-08-03 Thread sat
Hi, We have Kafka server/broker running in a seperate machine (say machine A), for now we are planning to have in one node. We have multiple topics and all topics have only 1 partition for now. We have our application which includes Kafka consumers installed in machine B and machine C. Our applic