Vasudevan Karnan created KAFKA-5728:
---------------------------------------
Summary: Stopping consumer thread cause loosing message in the
partition
Key: KAFKA-5728
URL: https://issues.apache.org/jira/browse/KAFKA-5728
Project: Kafka
Issue Type: Bug
Components: clients
Affects Versions: 0.10.1.0
Reporter: Vasudevan Karnan
Currently using Spring boot Kafka listener thread to consume the message from
partition.
Having 10 partitions and concurrency to 10 in the consumer group.
In testing, I have 2 messages in the single partition (say for ex: partition
4). Created listener to read the message and post to service. During normal
days, read the message and post to service, and working as expected. No issues
on that.
Suppose if the service is down, then I am doing Spring Retry template to retry
to post the message to service (repeatedly) for number of retry and backoff
time in ms. If I stop the listener, then getting
org.springframework.retry.backoff.BackOffInterruptedException: Thread
interrupted while sleeping; nested exception is java.lang.InterruptedException:
sleep interrupted
at
org.springframework.retry.backoff.FixedBackOffPolicy.doBackOff(FixedBackOffPolicy.java:86)
~[spring-retry-1.1.4.RELEASE.jar:na]
at
org.springframework.retry.backoff.StatelessBackOffPolicy.backOff(StatelessBackOffPolicy.java:36)
~[spring-retry-1.1.4.RELEASE.jar:na]
After that I am loosing the message from particular partition (message that are
got retried is lost in the middle) and lag is reduced. (This is happening
during the end of stopping the listener).
Is there any way, we don't loose the message even I am getting the sleep
interrupted exception?
Suppose during stopping the server, if I dont face sleep interrupt exception,
in the next time listener startup, face the same issue and loosing the message
again.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
