ajay created KAFKA-1808:
---------------------------
Summary: SimpleConsumer not working as expected
Key: KAFKA-1808
URL: https://issues.apache.org/jira/browse/KAFKA-1808
Project: Kafka
Issue Type: Bug
Components: consumer
Affects Versions: 0.8.1.1
Environment: linux_x64
Reporter: ajay
Assignee: Neha Narkhede
I followed following link
https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example
The consumers are consuming messages from a specific partition. But the issue
is that when my consumer is running and I push messages to a specif partition
of a topic using a producer it consumes messages from that partition.
But if my consumer is not running at present and I push some messages to the
topic and again start the consumer it do not consume the messages which were
pushed by the producer but again it is ready to consume messages which will be
pushed now.
I am using LatestTime() instead of EarliestTime() as I want to consume only
unprocessed messages.
For example:
Case -1
Consumer is running :
Producer pushed M1, M2, M3 message to partition 1 of topic 1
result: consumer will consume all three messages.
Case - 2
Consumer is not running
producer now pushes m4, m5 m6 messgae to partition 1 of topic 1
consumer is invoked now
result : consumer do not consume messages m4, m5, m6.
But If I check the offset then it is set to 7. This means the producer has
advanced the offset to 7 while producing messages as a result the consumer will
consume messages from offset 7 now i.e. the consumer will not consume messages
m4,m5,m6.
Please help ideally when when consumer comes up again it should read messages
from m4. SimpleConsumer should have started reading messages from the point
where he has left last time once it comes up again.
I might have filed it in a wrong category as bug, but need help to just consume
unprocessed messages only. Please help with
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
