If compression is turned on, the check is done on the compressed message size. The producer knows the compressed message size before it writes it on the network.
Thanks, Neha On Tue, Jan 28, 2014 at 7:42 AM, Philip O'Toole <phi...@loggly.com> wrote: > http://kafka.apache.org/07/configuration.html > > Hello -- I can look the at the code too, but how does this setting interact > with compression? After all, a Producer doing compression doesn't know the > size of a "message" on the wire it will send to a Kafka broker until after > it has been compressed. And after it has been compressed, what if it is > greater than the configured value? > > Or perhaps it applies to the "message" pre-compression? > > Thanks, > > Philip >