Guozhang, thanks for these links.
Hi Alexis, as Guozhang said, yours seems different from our case. We
deleted a topic but caused shrinking/expanding for other topics.
Yifan
On Tue, Apr 5, 2016 at 10:02 PM, Alexis Midon
wrote:
> I ran into the same issue today. In a production cluster, I notic
Alexis,
Hmm, yours seems a bug in Kafka brokers since your message relates to a
topic that has been deleted months ago, indicating that the topic was not
deleted cleanly. Could you file a JIRA with server logs for further
investigation?
Guozhang
On Tue, Apr 5, 2016 at 10:02 PM, Alexis Midon <
a
I ran into the same issue today. In a production cluster, I noticed the
"Shrinking ISR for partition" log messages for a topic deleted 2 months
ago.
Our staging cluster shows the same messages for all the topics deleted in
that cluster.
Both 0.8.2
Yifan, Guozhang, did you find a way to get rid of
It is possible, there are some discussions about a similar issue in KIP:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-53+-+Add+custom+policies+for+reconnect+attempts+to+NetworkdClient
mailing thread:
https://www.mail-archive.com/dev@kafka.apache.org/msg46868.html
Guozhang
On Tue, Ap
These configs are mainly dependent on your publish throughput, since the
replication throughput is higher bounded by the publish throughput. If the
publish throughput is not high, then setting a lower threshold values in
these two configs will cause churns in shrinking / expanding ISRs.
Guozhang
Yifan,
Are you on 0.8.0 or 0.8.1/2? There are some issues with zkVersion checking
in 0.8.0 that are fixed in later minor releases of 0.8.
Guozhang
On Fri, Apr 1, 2016 at 7:46 PM, Yifan Ying wrote:
> Hi All,
>
> We deleted a deprecated topic on Kafka cluster(0.8) and started observing
> constan
Hi All,
We deleted a deprecated topic on Kafka cluster(0.8) and started observing
constant 'Expanding ISR for partition' and 'Shrinking ISR for partition'
for other topics. As a result we saw a huge number of under replicated
partitions and very high request latency from Kafka. And it doesn't seem