Hi folks,
We have recently got a strange issue with kafka consumer.
Consumer thread was hanging infinitely.
Can someone advise how to approach this?
kafka version is 1.0.2.
we have found following error at broker side.
[2020-01-14 12:17:54,454] DEBUG [GroupMetadataManager brokerId=1002] Offset
commit Map(topic_name -> [OffsetMetadata[4387852,NO_METADATA],CommitTime
1579004269453,ExpirationTime 6763004269453]) from group group_name,
consumer consumer-1-3b77c87c-81d7-4d23-90c3-2f5243114b87 with generation
471 failed when appending to log due to
org.apache.kafka.common.errors.TimeoutException
here is also tread dump on consumer side
com.playtech.crossteam.boot.kafkaacceptorpatternchannel-pool-16-1"
java.lang.Thread.State: RUNNABLE
at [email protected]/sun.nio.ch.EPoll.wait(Native Method)
at [email protected]
/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
at [email protected]
/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
at [email protected]
/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
at
org.apache.kafka.common.network.Selector.select(Selector.java:674)
at
org.apache.kafka.common.network.Selector.poll(Selector.java:396)
at
org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:460)
at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:258)
at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:230)
at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:206)
at
org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:601)
at
org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1250)
Thanks in advance,
Roman