Re: Few partitions stuck in under replication

2022-03-03 Thread Fares Oueslati
I don't know about the root cause, but if you're trying to solve the issue, restarting the controller broker pod should do the trick. Fares On Thu, Mar 3, 2022 at 8:38 AM Dhirendra Singh wrote: > Hi All, > > We have kafka cluster running in kubernetes. kafka version we are using is > 2.7.1. > E

Re: Few partitions stuck in under replication

2022-03-03 Thread Thomas Cooper
Hi Dhirenda, Firstly, I am interested in why are you restarting the ZK and Kafka cluster every night? Secondly, how are you doing the restarts. For example, in [Strimzi](https://strimzi.io/), when we roll the Kafka cluster we leave the designated controller broker until last. For each of the o

Is MirrorMaker 2 horizontally scalable?

2022-03-03 Thread Dmitri Pavlov
Hi, A quick question, maybe you can help? Trying to follow this article https://cwiki.apache.org/confluence/display/KAFKA/KIP-382%3A+MirrorMaker+2.0 -> "Walkthrough: Running MirrorMaker 2.0", and the last lines in the paragraph are == Second, launch one or more MirrorMaker cluster nodes: $

Re: Is MirrorMaker 2 horizontally scalable?

2022-03-03 Thread Chris Egerton
Hi Dmitri, There's at least one issue with MirrorMaker 2 that impacts horizontal scalability and has not yet been addressed: https://issues.apache.org/jira/browse/KAFKA-9981. There is some work in progress to fix it ( https://cwiki.apache.org/confluence/display/KAFKA/KIP-710%3A+Full+support+for+di

RE: Is MirrorMaker 2 horizontally scalable?

2022-03-03 Thread Dmitri Pavlov
Thank you very much Chris! -Original Message- From: Chris Egerton Sent: Thursday, March 3, 2022 5:30 PM To: users@kafka.apache.org Subject: Re: Is MirrorMaker 2 horizontally scalable? Hi Dmitri, There's at least one issue with MirrorMaker 2 that impacts horizontal scalability and has n

Re: Few partitions stuck in under replication

2022-03-03 Thread Dhirendra Singh
Hi Tom, Doing the nightly restart is the decision of the cluster admin. I have no control on it. We have implementation using stateful set. restart is triggered by updating a annotation in the pod. Issue is not triggered by kafka cluster restart but the zookeeper servers restart. Thanks, Dhirendra

Re: Few partitions stuck in under replication

2022-03-03 Thread Thomas Cooper
I suspect this nightly rolling will have something to do with your issues. If you are just rolling the stateful set in order, with no dependence on maintaining minISR and other Kafka considerations you are going to hit issues. If you are running on Kubernetes I would suggest using an Operator li

[VOTE] 3.0.1 RC0

2022-03-03 Thread Mickael Maison
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 3.0.1. Apache Kafka 3.0.1 is a bugfix release and 29 issues have been fixed since 3.0.0. Release notes for the 3.0.1 release: https://home.apache.org/~mimaison/kafka-3.0.1-rc0/RELEASE_NOT

Re: Few partitions stuck in under replication

2022-03-03 Thread Dhirendra Singh
Hi Tom, During the rolling restart we check for under replicated partition count to be zero in the readiness probe before restarting the next POD in order. This issue never occurred before. It started after we upgraded kafka version from 2.5.0 to 2.7.1. So i suspect some bug introduced in the versi