Re: Too Many Open Files

2016-08-01 Thread Anirudh P
I agree with Steve. We had a similar problem where we set the ulimit to a certain value but it was getting overridden. It only worked when we set the ulimit after logging in as root. You might want to give that a try if you have not done so already - Anirudh On Mon, Aug 1, 2016 at 1:19 PM, Steve

Re: Consumer Question

2016-06-19 Thread Anirudh P
Hi Chris, We should also ensure that auto.create.topics.enable is set to true. Thank you, Anirudh Hi Chris, If the topic not exist, it will create a new topic with the name which you give. Thanks, Nicole On Sat, Jun 18, 2016 at 1:55 AM, Chris Barlock wrote: > If you have

Re: due to invalid request: Request of length

2016-03-01 Thread Anirudh P
Hello, What is the size of the message you are sending. If it is 1937006964 then you should set message.max.bytes and replica.fetch.max.bytes to values larger than the size of the message you are trying to send. If it isnt, then its most likely an encoding issue on your side. The kafka message

Fwd: Re: Kafka SSL Configuration Problems

2016-02-01 Thread Anirudh P
Hello Nazario, Could you try it by creating a new topic? Thank you, Anirudh That works. At least it is saying that it is registering now with the SSL side. [2016-02-01 12:29:40,184] INFO Registered broker 0 at path /brokers/ids/0 with addresses: PLAINTEXT ->

Question on Using many producers simultaneously

2016-01-27 Thread Anirudh P
Hello, We have a scenario where we will be having a large number of producers( ~50k instances - 1 Producer per instance) which will be sending data to a kafka topic. The producers could be inactive for a long time and then be asked to send a message(all at the same time) and as quickly as