Hey Edo, The background is here: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Client-side+Assignment+Proposal. Yes, it's more work for implementations, but it also opens the door for other use cases (e.g. Kafka Connect is using the same protocol). It also makes it easier for clients to provide their own partition assignor implementations since they don't need to hook into the broker.
Thanks, Jason On Thu, Apr 28, 2016 at 4:11 PM, Edoardo Comar <eco...@uk.ibm.com> wrote: > Hi > > why is the calculation of the partition assignments to group member being > executed by the client (leader of the group), > rather than server (eg by the group Coordinator) ? > > This question came up working with Vahid Hashemian on > https://issues.apache.org/jira/browse/KAFKA-2273 > We have implemented the propagation of the overall assignment solution of > every consumer to every consumers in a group > by using the userdata field in PartitionAssignor.Assignment. > This way, even if the leader dies, any other consumer on becoming the > leader has access to the last computed assignment for everyone. > > However the fact that these pluggable assignment strategies execute on the > client, makes the implementation of clients in other languages more > laborious. > If they were executing in the broker, every language would take advantage > of the available strategies. > > Would it be feasible to move the execution on the server? Is this worth a > new KIP? > > thanks, > Edo > -------------------------------------------------- > Edoardo Comar > MQ Cloud Technologies > eco...@uk.ibm.com > +44 (0)1962 81 5576 > IBM UK Ltd, Hursley Park, SO21 2JN > > IBM United Kingdom Limited Registered in England and Wales with number > 741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6 > 3AU > Unless stated otherwise above: > IBM United Kingdom Limited - Registered in England and Wales with number > 741598. > Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU > >
