[
https://issues.apache.org/jira/browse/KAFKA-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15686394#comment-15686394
]
Conor Hughes commented on KAFKA-4373:
-------------------------------------
Thanks for such a the quick reply!
After you mentioned log retention policy I went back through my kafka
configurations and noticed log.retention.hours was set back to the default 7
days (168 hours).
The trace files I was using were from over a month ago so messages were being
deleted every 5 minutes as the were older than 7 days. (Note: I'm using a
custom timestamp extractor)
> Kafka Consumer API jumping offsets
> ----------------------------------
>
> Key: KAFKA-4373
> URL: https://issues.apache.org/jira/browse/KAFKA-4373
> Project: Kafka
> Issue Type: Bug
> Components: consumer
> Reporter: Srinivasan Venkatraman
>
> Hi,
> I am using Kafka Version 0.10.0.1 and java consumer API to consume messages
> from a topic. We are using a single node kafka and zookeeper. It is sometimes
> observed that the consumer is losing a bulk of message. We are unable to find
> the exact reason to replicate the issue.
> The scenario is:
> Consumer polls the topic.
> Fetches the messages and gives it to a thread pool to handle the message.
> Waits for the threads to return and then commits the offsets.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
