Re: Producer performance is awful when acks=all

2017-10-27 Thread Colin McCabe
Hi Vijay, It is surprising to see such a large drop. The first thing that it suggests to me is that perhaps there is a network bottleneck that is being glossed over in the acks=1 case, but not in the acks=all case. In the acks=1 case, is the broker co-located on the same machine as the producer,

Producer performance is awful when acks=all

2017-10-27 Thread Vijay Prakash
Hey all, I'm currently running Kafka 0.10.1 on Windows and am doing some perf testing. I tried out the perf test setup described in this blog post: https://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-writes-second-three-cheap-machines. When I try "single producer thread,