Re: Consumer group suggestion: minimum consumer count

2017-07-10 Thread Greg Fodor
Apologies, just discovered KIP-134, which would address our specific problem directly via delaying consumer join. On Mon, Jul 10, 2017 at 4:53 PM, Greg Fodor wrote: > With Kafka Streams, it's common to spin up and shut down clusters of > consumers by performing a graceful shutdown and restart du

Consumer group suggestion: minimum consumer count

2017-07-10 Thread Greg Fodor
With Kafka Streams, it's common to spin up and shut down clusters of consumers by performing a graceful shutdown and restart during a deploy. One thing we've been running into is that during the startup and shutdown of a kafka streams clusters you often can have multiple rebalances as the consumer