Good day,
We're currently in the process of implementing our application with kafka
compression type ZStandard (zstd).
However during the testing process the consumer encountered this error:
[ERROR] (consumer-1)
org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer
- Container exception
org.apache.kafka.common.KafkaException: Received exception when fetching
the next record from dp.-------------------. If needed, please seek past
the record to continue consumption.
at
org.apache.kafka.clients.consumer.internals.Fetcher$PartitionRecords.fetchRecords(Fetcher.java:1228)
at
org.apache.kafka.clients.consumer.internals.Fetcher$PartitionRecords.access$1400(Fetcher.java:1096)
at
org.apache.kafka.clients.consumer.internals.Fetcher.fetchRecords(Fetcher.java:544)
at
org.apache.kafka.clients.consumer.internals.Fetcher.fetchedRecords(Fetcher.java:505)
at
org.apache.kafka.clients.consumer.KafkaConsumer.pollForFetches(KafkaConsumer.java:1225)
at
org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1188)
at
org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1123)
at
org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.run(KafkaMessageListenerContainer.java:532)
at
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at
java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: org.apache.kafka.common.KafkaException:
java.lang.ExceptionInInitializerError: Cannot unpack libzstd-jni
*Here's the version for the producer and consumer:*
Producer Kafka Client Version (using ZStandard compression): 2.5.1
Consumer Kafka Client Version: 2.1.0
Could you help us identify what caused this error? Do we need to upgrade
the version on the consumer side?
Best Regards,
Loren Sion
