Hello Avshalom,
I think the first question to answer is where are the new consumers coming
from. From your description they seem to be not expected (i.e. you did not
intentionally start up new instances), so looking at those VMs that
suddenly start new consumers would be my first shot.
Guozhang
ssage-
From: Avshalom Manevich
To: users
Sent: Sun, 8 Dec 2019 10:28
Subject: Re: Kafka consumer group keeps moving to PreparingRebalance and stops
consuming
Hi Boyang,
Thanks for your reply.
We looked into this direction, but since we didn't change max.poll.interval
from its default value,
Hi Boyang,
Thanks for your reply.
We looked into this direction, but since we didn't change max.poll.interval
from its default value, we're not sure if it's the case.
On Fri, 6 Dec 2019 at 17:42, Boyang Chen wrote:
> Hey Avshalom,
>
> the consumer instance is initiated per stream thread. You w
Hey Avshalom,
the consumer instance is initiated per stream thread. You will not be
creating new consumers so the root cause is definitely member timeout.
Have you changed the max.poll.interval by any chance? That config controls
how long you tolerate the interval between poll calls to make sure p
We have a Kafka Streams consumer group that keep moving to
PreparingRebalance state and stop consuming. The pattern is as follows:
1.
Consumer group is running and stable for around 20 minutes
2.
New consumers (members) start to appear in the group state without any
clear reason,
