Kafka - Is it possible to achieve low latency (below 5ms?)

2018-06-02 Thread Pritam Kadam
Hi, I have been playing around with different kafka configurations at producer, broker and consumer side. But could not figure out a way to get predictable low latency below 5 to 10 ms. *Use Case:* - Application has 100-200 producers, each producer is producing messages at different rates

[Production Guideline] Is it good idea to provide limited number of brokers(3 brokers) in kafka client in large cluster

2018-01-17 Thread Pritam Kadam
Hi, I have a use case where my kafka cluster will have 1000 brokers and I am writing kafka client. In order to write client, i need to provide brokers list. Question is, what are the recommended guidelines to provide brokers list in client? *Is there any proxy like service available in kafka whi

[HELP] Guidelines/tools to test kafka performance with application layer involved

2018-01-16 Thread Pritam Kadam
helpful? Thanks, Pritam Kadam