Hi folks, I was troubleshooting a program trying to receive a kafka message (local kafka, for development), and decided I needed to verify kafka itself was happy. So I created a topic named 'fubar' and started the consumer listening to it. Then I started the console producer in another terminal window and typed in foo<return> and it appeared nicely on the consumer terminal. Then I typed bar<return> and got this:
NS2-MacBook-Pro:kafka_2.13-3.7.0 gus$ bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic fubar --from-beginning foo [2024-05-29 11:56:07,183] ERROR Error processing message, terminating consumer process: (kafka.tools.ConsoleConsumer$) org.apache.kafka.common.protocol.types.SchemaException: Buffer underflow while parsing response for request with header RequestHeader(apiKey=FETCH, apiVersion=16, clientId=console-consumer, correlationId=608, headerVersion=2) at org.apache.kafka.clients.NetworkClient.parseResponse(NetworkClient.java:758) at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:929) at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:594) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:281) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:252) at org.apache.kafka.clients.consumer.internals.LegacyKafkaConsumer.pollForFetches(LegacyKafkaConsumer.java:686) at org.apache.kafka.clients.consumer.internals.LegacyKafkaConsumer.poll(LegacyKafkaConsumer.java:617) at org.apache.kafka.clients.consumer.internals.LegacyKafkaConsumer.poll(LegacyKafkaConsumer.java:590) at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:874) at kafka.tools.ConsoleConsumer$ConsumerWrapper.receive(ConsoleConsumer.scala:473) at kafka.tools.ConsoleConsumer$.process(ConsoleConsumer.scala:103) at kafka.tools.ConsoleConsumer$.run(ConsoleConsumer.scala:77) at kafka.tools.ConsoleConsumer$.main(ConsoleConsumer.scala:54) at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala) Caused by: java.nio.BufferUnderflowException at java.base/java.nio.Buffer.nextGetIndex(Buffer.java:651) at java.base/java.nio.HeapByteBuffer.getInt(HeapByteBuffer.java:402) at org.apache.kafka.common.protocol.ByteBufferAccessor.readInt(ByteBufferAccessor.java:43) at org.apache.kafka.common.message.ResponseHeaderData.read(ResponseHeaderData.java:90) at org.apache.kafka.common.message.ResponseHeaderData.<init>(ResponseHeaderData.java:66) at org.apache.kafka.common.requests.ResponseHeader.parse(ResponseHeader.java:100) at org.apache.kafka.common.requests.AbstractResponse.parseResponse(AbstractResponse.java:100) at org.apache.kafka.clients.NetworkClient.parseResponse(NetworkClient.java:756) ... 13 more [2024-05-29 11:56:07,183] ERROR [Consumer clientId=console-consumer, groupId=console-consumer-59661] Heartbeat thread failed due to unexpected error (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) java.lang.IllegalStateException: There are no in-flight requests for node 0 at org.apache.kafka.clients.InFlightRequests.requestQueue(InFlightRequests.java:62) at org.apache.kafka.clients.InFlightRequests.completeNext(InFlightRequests.java:70) at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:927) at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:594) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:281) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.pollNoWakeup(ConsumerNetworkClient.java:322) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$HeartbeatThread.run(AbstractCoordinator.java:1490) Processed a total of 1 messages NS2-MacBook-Pro:kafka_2.13-3.7.0 gus$ Any idea what's happening? Certainly doesn't look copacetic. Producer was started like this: NS2-MacBook-Pro:kafka_2.13-3.7.0 gus$ bin/kafka-topics.sh --list --bootstrap-server localhost:9092 __consumer_offsets fubar NS2-MacBook-Pro:kafka_2.13-3.7.0 gus$ bin/kafka-console-producer.sh --bootstrap-server localhost:9092 --topic fubar >foo >bar > -Gus Founder, Chief Architect, Needham Software LLC Commiter & PMC member Apache Solr & Apache Lucene 508-333-5312 https://www.needhamsoftware.com
