Re: Kafka constant shrinking and expanding after deleting a topic

2016-04-06 Thread Yifan Ying
Guozhang, thanks for these links. Hi Alexis, as Guozhang said, yours seems different from our case. We deleted a topic but caused shrinking/expanding for other topics. Yifan On Tue, Apr 5, 2016 at 10:02 PM, Alexis Midon wrote: > I ran into the same issue today. In a production cluster, I notic

Re: Kafka constant shrinking and expanding after deleting a topic

2016-04-06 Thread Guozhang Wang
Alexis, Hmm, yours seems a bug in Kafka brokers since your message relates to a topic that has been deleted months ago, indicating that the topic was not deleted cleanly. Could you file a JIRA with server logs for further investigation? Guozhang On Tue, Apr 5, 2016 at 10:02 PM, Alexis Midon < a

Re: Kafka constant shrinking and expanding after deleting a topic

2016-04-05 Thread Alexis Midon
I ran into the same issue today. In a production cluster, I noticed the "Shrinking ISR for partition" log messages for a topic deleted 2 months ago. Our staging cluster shows the same messages for all the topics deleted in that cluster. Both 0.8.2 Yifan, Guozhang, did you find a way to get rid of

Re: Kafka constant shrinking and expanding after deleting a topic

2016-04-05 Thread Guozhang Wang
It is possible, there are some discussions about a similar issue in KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-53+-+Add+custom+policies+for+reconnect+attempts+to+NetworkdClient mailing thread: https://www.mail-archive.com/dev@kafka.apache.org/msg46868.html Guozhang On Tue, Ap

Re: Kafka constant shrinking and expanding after deleting a topic

2016-04-05 Thread Guozhang Wang
These configs are mainly dependent on your publish throughput, since the replication throughput is higher bounded by the publish throughput. If the publish throughput is not high, then setting a lower threshold values in these two configs will cause churns in shrinking / expanding ISRs. Guozhang

Re: Kafka constant shrinking and expanding after deleting a topic

2016-04-03 Thread Guozhang Wang
Yifan, Are you on 0.8.0 or 0.8.1/2? There are some issues with zkVersion checking in 0.8.0 that are fixed in later minor releases of 0.8. Guozhang On Fri, Apr 1, 2016 at 7:46 PM, Yifan Ying wrote: > Hi All, > > We deleted a deprecated topic on Kafka cluster(0.8) and started observing > constan

Kafka constant shrinking and expanding after deleting a topic

2016-04-01 Thread Yifan Ying
Hi All, We deleted a deprecated topic on Kafka cluster(0.8) and started observing constant 'Expanding ISR for partition' and 'Shrinking ISR for partition' for other topics. As a result we saw a huge number of under replicated partitions and very high request latency from Kafka. And it doesn't seem