I can confirm that the message size check in the producer works on the
uncompressed size as of 0.11.0.1, as I had to investigate this internally.
:)
I've got a similar problem with messages that can occasionally exceed this
limit. We're taking the approach of enforcing a hard size limit when event
Hi all,
As far as I understand this Jira
https://issues.apache.org/jira/browse/KAFKA-4169, unfortunately
max.request.size works on *uncompressed* messages. Which means producer
won't be able to send messages larger than that limit, no matter
compression. The fragment above is still right though, be
Hello Eli,
This is from Kafka: Definitive Guide ( by Neha Narkhede , Gwen Shapira ,
and Todd Palino) , Chapter 2. Installing Kafka
"The Kafka broker limits the maximum size of a message that can be
produced, configured by the message.max.bytes parameter which defaults to
100, or 1 megabyte. A
Thanks for the reply Mayank. Do you know if this is documented somewhere? I
wasnt able to find mention of it.
Thanks
Eli
> On 22 Jun 2017, at 05:50, mayank rathi wrote:
>
> If you are compressing messages than size of "compressed" message should be
> less than what's specified in these paramet
If you are compressing messages than size of "compressed" message should be
less than what's specified in these parameters.
On Sat, Jun 17, 2017 at 7:46 PM, Eli Jordan
wrote:
> Hi
>
> max.message.bytes controls the maximum message size the kafka server will
> process
>
> message.max.bytes contro
Hi
max.message.bytes controls the maximum message size the kafka server will
process
message.max.bytes controls the maximum message size the consumer will process
max.request.size controls the maximum request size for the producer
Whats not clear to me (and I can't find documented anywhere) i
