Got the following error message with Kafka 0.8.2.1:
[2016-02-26 20:33:43,025] INFO Closing socket connection to /x due to
invalid request: Request of length 1937006964 is not valid, it is larger
than the maximum size of 104857600 bytes. (kafka.network.Processor)

Didn't send a large message at all, it seems like encoding issue or partial
request, any suggestion how to fix it?

The code is like below:

    ByteArrayOutputStream bos = new ByteArrayOutputStream();

    DataOutputStream dos = new DataOutputStream(bos);

    dos.writeLong(System.currentTimeMillis());

    OutputStreamWriter byteWriter = new OutputStreamWriter(bos,
com.force.commons.text.EncodingUtil.UTF_ENCODING);

    gson.toJson(obj, byteWriter);

    byte[] payload = bos.toByteArray();

    ProducerRecord<String, byte[]> data = new ProducerRecord<String,
byte[]>(“Topic”, 0, null, payload);

    kafkaProducer.send(data);

Reply via email to