Re: Kafka safe Rolling restart

2016-04-09 Thread Yashodhan Kocharekar
Hi Rob, thanks for detailed reply , let me share more info on this, unfortunately we are in production running traffic of ~ 25,000 message/sec on Kafka *0.8.1.1* cluster , now *controlled.shutdown.enable = false* this property enables controlled shutdown behaviour but it is set to false by d

Re: Kafka safe Rolling restart

2016-04-09 Thread Robert Christ
Hi Yashodhan, I do this quite frequently and if I understand your question correctly, it is the default behavior. If you issue a normal TERM signal to the kafka process (or call kafka-server-stop.sh) it will start controlled shutdown which will migrate leadership for all the partitions it is curr

Kafka safe Rolling restart

2016-04-08 Thread Yashodhan Kocharekar
hi i am trying write a script for safe rolling restart of kafka_2.9.2-0.8.1.1 cluster , high level workflow is for each broker do 1. move partition replica leadership from current_broker to others 2. broker restart 3. restore leadership borker now i have found a script to do 1. https://