Re: NiFi 1.3 - PublishKafka_0_10 - A message in the stream exceeds the maximum allowed message size of 1048576 bytes

2017-11-20 Thread mayank rathi
Thanks Koji for replying. After your email I looked into Kafka logs again and found out that message.max.bytes was setup to accept only 1 MB messages. I increased this to 10 MB and after that messages are now being pushed to Kafka. Thanks for helping !! On Sun, Nov 19, 2017 at 7:01 PM, Koji

Re: NiFi 1.3 - PublishKafka_0_10 - A message in the stream exceeds the maximum allowed message size of 1048576 bytes

2017-11-19 Thread Koji Kawamura
Hi Mayank, I've tried to reproduce the issue, but to no avail so far. PublishKafka_0_10 uses the specified Max Request Size as expected and I got the exception if incoming message size exceeds the configured size. And I was able to publish messages whose size is 2.08MB with 10MB Max Request Size.

NiFi 1.3 - PublishKafka_0_10 - A message in the stream exceeds the maximum allowed message size of 1048576 bytes

2017-11-17 Thread mayank rathi
Hello All, I am getting this error in PublishKafka_0_10 processor for a message of size 2.08 MB. I have updated Max Request Size to 10 MB in processor properties and max.request.size to 10 MB in Kafka's server.properties. After reboot Kafka Broker I can see that max.request.size = 10 MB in Kafka