Hi guys, I'm trying to consume our Kafka topics using Kafkacat <https://github.com/edenhill/kafkacat>. We were able to successfully consume messages using the the default compression.type (producer, i.e without compression in our case). When we changed the compression type to either compression algorithm (gzip / snappy / lz4), the consumption fails immediately with a fatal error.
Here's the command: kafkacat -X api.version.request=true -b localhost -t <topic> -o end -C -c 1 -v -p 4 And the response received when consuming a topic configured with any of the compression algorithms: % Fatal error at consume_cb:407: % ERROR: Topic maxwell_with_request_site_sharded [4] error: Message at offset 733099 is too large to fetch, try increasing receive.message.max.bytes The response is the same for all offsets, in different partitions and all our topics. Please notice the messages size is quite small (smaller than the value of receive.message.max.bytes), I'm using the latest Kafka version (0.10.1). Please advise. Thanks, *Ofir Sharony* BackEnd Tech Lead Mobile: +972-54-7560277 <+972%2054-756-0277> | [email protected] | www.myheritage.com MyHeritage Ltd., 3 Ariel Sharon St., Or Yehuda 60250, Israel <http://www.myheritage.com/> <https://www.facebook.com/myheritage> <https://twitter.com/myheritage> <http://blog.myheritage.com/> <https://www.youtube.com/user/MyHeritageLtd>
