Thanks Anirudh! I didn't send a large message, so most likely an encoding issue, how to fix the encoding issue?
I googled, found one link: https://github.com/st23am/ExKafka/issues/4 But we are using Java, I couldn't see how to do this line: IO.iodata_to_binary(iodata) Thanks, Fang On Tue, Mar 1, 2016 at 5:40 PM, Anirudh P <panirudh2...@gmail.com> wrote: > Hello, > > What is the size of the message you are sending. If it is 1937006964 then > you should set message.max.bytes and replica.fetch.max.bytes to values > larger than the size of the message you are trying to send. > > If it isnt, then its most likely an encoding issue on your side. The kafka > message is size delimited. > > Make sure you are not sending a partial request(or a request with an > invalid size). The server might wrongly calculate the size of the next > request and you could see such an error. > > Thank you, > Anirudh > > On Wed, Mar 2, 2016 at 6:18 AM, Fang Wong <fw...@salesforce.com> wrote: > > > [2016-02-26 20:33:43,025] INFO Closing socket connection to /x due to > > invalid request: Request of length 1937006964 is not valid, it is larger > > than the maximum size of 104857600 bytes. (kafka.network.Processor) > > [2016-02-26 20:33:43,047] INFO Closing socket connection to /x due to > > invalid request: Request of length 1937006964 is not valid, it is larger > > than the maximum size of 104857600 bytes. (kafka.network.Processor) > > [2016-02-26 20:33:43,049] INFO Closing socket connection to /x due to > > invalid request: Request of length 1937006964 is not valid, it is larger > > than the maximum size of 104857600 bytes. (kafka.network.Processor) > > [2016-02-26 20:33:43,055] INFO Closing socket connection to /x due to > > invalid request: Request of length 1937006964 is not valid, it is larger > > than the maximum size of 104857600 bytes. (kafka.network.Processor) > > [2016-02-26 20:33:43,112] INFO Closing socket connection to /x due to > > invalid request: Request of length 1937006964 is not valid, it is larger > > than the maximum size of 104857600 bytes. (kafka.network.Processor) > > >
