Re: Kafka Streams leave group behaviour

2021-08-18 Thread Sophie Blee-Goldman
As Boyang mentioned, Kafka Streams intentionally does not send a LeaveGroup request when shutting down. This is because often the shutdown is not due to a scaling down event but instead some transient closure, such as during a rolling bounce. In cases where the instance is expected to start up agai

Re: Kafka Streams leave group behaviour

2021-08-12 Thread Boyang Chen
You are right Uwe, Kafka Streams won't leave group no matter dynamic or static membership. If you want to have fast scale down, consider trying static membership and use the admin command `removeMemberFromGroup` when you need to rescale. Boyang On Thu, Aug 12, 2021 at 4:37 PM Lerh Chuan Low wrot

Re: Kafka Streams leave group behaviour

2021-08-12 Thread Lerh Chuan Low
I think you may have stumbled upon this: https://issues.apache.org/jira/browse/KAFKA-4881. 1 thing that you could try is using static membership - we have yet to try that though so can't comment yet on how that might work out. On Thu, Aug 12, 2021 at 11:29 PM c...@uweeisele.eu wrote: > Hello all

Kafka Streams leave group behaviour

2021-08-12 Thread c...@uweeisele.eu
Hello all, I have a question about the Group Membership lifecycle of Kafka Streams, or more specific about when Kafka Streams does leave the consumer group (in case of dynamic membership). My expectation was, that a call to the method KafkaStreams.close() also sends a LeaveGroup request to the