Currently the index files will only be deleted on startup if there are any .swap file indicating the server crashed while opening the log segments. We should probably change this logic.
Guozhang On Fri, Nov 1, 2013 at 8:16 AM, Kane Kane <[email protected]> wrote: > Filed a bug meanwhile, https://issues.apache.org/jira/browse/KAFKA-1112 > > > On Fri, Nov 1, 2013 at 8:15 AM, Neha Narkhede <[email protected] > >wrote: > > > Jun, > > > > I've seen this happen in the latest code in trunk, need to remember how > to > > reproduce it. > > > > Thanks, > > Neha > > On Nov 1, 2013 7:59 AM, "Jun Rao" <[email protected]> wrote: > > > > > Are you using the latest code in the 0.8 branch? > > > > > > Thanks, > > > > > > Jun > > > > > > > > > On Fri, Nov 1, 2013 at 7:36 AM, Kane Kane <[email protected]> > wrote: > > > > > > > Neha, yes when i kill it with -9, sure I will file a bug. > > > > > > > > Thanks. > > > > > > > > > > > > On Fri, Nov 1, 2013 at 3:43 AM, Neha Narkhede < > [email protected] > > > > >wrote: > > > > > > > > > When you say the Kafka dies, did you mean a kill -9 or kill -15 ? I > > > agree > > > > > that Kafka should try and delete/rebuild index files, but in this > > case, > > > > it > > > > > sounds like a bug. Can you file a JIRA? > > > > > > > > > > Thanks, > > > > > Neha > > > > > > > > > > > > > > > On Fri, Nov 1, 2013 at 1:51 AM, Kane Kane <[email protected]> > > > wrote: > > > > > > > > > > > When machine with kafka dies, most often broker cannot start > itself > > > > with > > > > > > errors about index files being corrupt. After i delete them > > manually > > > > > broker > > > > > > usually can boot up successfully. Shouldn't kafka try to > > > delete/rebuild > > > > > > broken index files itself? > > > > > > > > > > > > Also this exception looks a bit weird: > > > > > > java.lang.IllegalArgumentException: requirement failed: Corrupt > > index > > > > > > found, index file > > > > > > (/disk1/kafka-logs/benchmark-2/00000000000000385258.index) has > > > non-zero > > > > > > size but the last offset is 385258 and the base offset is 385258 > > > > > > > > > > > > Thanks. > > > > > > > > > > > > > > > > > > > > > -- -- Guozhang
