Unfortunately, I think the only option (going forward) until you pick up KAFKA-1414 is to use a smaller segment size.
On Fri, Sep 26, 2014 at 02:04:33AM -0400, Otis Gospodnetic wrote: > Hi, > > Just got a lovely email a bunch of our EC2 instances will be rebooted in a > few days. Some of them run our Kafka 0.8.1 brokers with a few hundred GBs > of data in them. Last time Kafka brokers didn't shut down cleanly it took > them maaaany hours to recover. > > I just found https://issues.apache.org/jira/browse/KAFKA-1414 but I think > that's not in 0.8.1. > > So.... I'm wondering if there are any config settings we could change to > speed up segment recovery? > > Thanks, > Otis > -- > Monitoring * Alerting * Anomaly Detection * Centralized Log Management > Solr & Elasticsearch Support * http://sematext.com/
