Hi Mark, If a broker fails and you want to elect a new leader as quickly as possible, you could tweak zookeeper.session.timeout.ms in the kafka broker configuration. According to the documentation: "If the consumer fails to heartbeat to ZooKeeper for this period of time it is considered dead and a rebalance will occur."
https://kafka.apache.org/0101/documentation.html I think making zookeeper.session.timeout.ms smaller will result in faster detection of a dead node, but the downside is that a leader election might get triggered by network blips or other cases where your broker is not actually dead. Harper On Thu, Dec 6, 2018 at 9:11 AM Mark Anderson <manderso...@gmail.com> wrote: > Hi, > > I'm currently testing how Kafka reacts in cases of broker failure due to > process failure or network timeout. > > I'd like to have the election of a new leader for a topic partition happen > as quickly as possible but it is unclear from the documentation or broker > configuration what the key parameters are to tune to make this possible. > > Does anyone have any pointers? Or are there any guides online? > > Thanks, > Mark >
