[ https://issues.apache.org/jira/browse/KAFKA-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jun Rao updated KAFKA-3163: --------------------------- Attachment: 00000000000000113931.timeindex 00000000000000113931.log Also, I ran the following tool in the patch on the attached timeindex file and got a bunch of errors. kafka-run-class.sh kafka.tools.DumpLogSegments --files /tmp/kafka-logs/test-0/00000000000000113931.timeindex timestamp: 1468010788307(log timestamp: 1468010788303) offset: 113946(log offset: 113931) timestamp: 1468010788308(log timestamp: 1468010788303) offset: 113976(log offset: 113931) timestamp: 1468010788309(log timestamp: 1468010788303) offset: 114006(log offset: 113931) timestamp: 1468010788310(log timestamp: 1468010788303) offset: 114036(log offset: 113931) timestamp: 1468010788311(log timestamp: 1468010788303) offset: 114081(log offset: 113931) timestamp: 1468010788312(log timestamp: 1468010788303) offset: 114111(log offset: 113931) timestamp: 1468010788313(log timestamp: 1468010788303) offset: 114156(log offset: 113931) timestamp: 1468010788314(log timestamp: 1468010788303) offset: 114201(log offset: 113931) Found timestamp mismatch in :/tmp/kafka-logs/test-0/00000000000000113931.timeindex Index timestamp: 1468010788314, log timestamp: 1468010788303 Index timestamp: 1468010788313, log timestamp: 1468010788303 Index timestamp: 1468010788312, log timestamp: 1468010788303 Index timestamp: 1468010788311, log timestamp: 1468010788303 Index timestamp: 1468010788310, log timestamp: 1468010788303 Index timestamp: 1468010788309, log timestamp: 1468010788303 Index timestamp: 1468010788308, log timestamp: 1468010788303 Index timestamp: 1468010788307, log timestamp: 1468010788303 A few things: (1) The data is populated with the producer performance tool. So, the time index shouldn't be corrupted. (2) It's a bit hard to understand the output. It's not clear what's in the bracket really means and it's not clear that indicates an error. It's also a bit weird that the same error is print again later and in reverse timestamp order. > KIP-33 - Add a time based log index to Kafka > -------------------------------------------- > > Key: KAFKA-3163 > URL: https://issues.apache.org/jira/browse/KAFKA-3163 > Project: Kafka > Issue Type: Task > Components: core > Reporter: Jiangjie Qin > Assignee: Jiangjie Qin > Fix For: 0.10.1.0 > > Attachments: 00000000000000113931.log, 00000000000000113931.timeindex > > > This ticket is associated with KIP-33. > https://cwiki.apache.org/confluence/display/KAFKA/KIP-33+-+Add+a+time+based+log+index -- This message was sent by Atlassian JIRA (v6.3.4#6332)