Re: High delay during controlled shutdown and acks=-1

2015-11-02 Thread Becket Qin
Hi Federico, What is your replica.lag.time.max.ms? When acks=-1, the ProducerResponse won't return until all the broker in ISR get the message. During controlled shutdown, the shutting down broker is doing a lot of leader migration and could slow down on fetching data. The broker won't be kicked

High delay during controlled shutdown and acks=-1

2015-11-02 Thread Federico Giraud
Hi, I have few java async producers sending data to a 4-node Kafka cluster version 0.8.2, containing few thousand topics, all with replication factor 2. When i use acks=1 and trigger a controlled shutdown + restart on one broker, the producers will send data to the new leader, reporting a very low