Lots of large messages will slow down throughput. From the client side you might want to have a client for large messages and one for the others so that they each have their own queue.
-Dave -----Original Message----- From: Ghosh, Achintya (Contractor) [mailto:[email protected]] Sent: Thursday, June 8, 2017 2:48 PM To: [email protected] Subject: Larger payload size Hi there, We observed if our payload size is larger we see "Failed to send; nested exception is org.apache.kafka.common.errors.RecordTooLargeException" execption so we changed the settings from 1 MB to 5 MB for both Producer and Consumer end. Server.properties: message.max.bytes=5242880 replica.fetch.max.bytes=5242880 Producer.properties max.request.size=5242880 and at application level we are passing max.partitions_fetch_bytes=5242880 As we made 1 MB to 5 MB, will be any performance impact or any other issue? Thanks This e-mail and any files transmitted with it are confidential, may contain sensitive information, and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this e-mail in error, please notify the sender by reply e-mail immediately and destroy all copies of the e-mail and any attachments.
