Re: More Kafka Benchmarking Goodness

2013-05-23 Thread Neha Narkhede
Thanks for sharing this, Jason. I had performed similar benchmarks back in 2011 (Results are on slide 27 here - https://cwiki.apache.org/confluence/download/attachments/2786/F_1330_Narkhede_Kafka+%281%29.pptx?version=1&modificationDate=1358352559000). My tests saturated the 1Gb network link bet

Re: More Kafka Benchmarking Goodness

2013-05-23 Thread Oleg Ruchovets
Can you please share Kafka version you've used for the tests? On Thu, May 23, 2013 at 8:57 PM, Jason Weiss wrote: > Folks, > > As I posted to the group here yesterday, my 3 server test in AWS produced > an average of 273,132 events per second with a fixed-size 2K message > payload. (Please see

More Kafka Benchmarking Goodness

2013-05-23 Thread Jason Weiss
Folks, As I posted to the group here yesterday, my 3 server test in AWS produced an average of 273,132 events per second with a fixed-size 2K message payload. (Please see that thread for details.) In order to determine the horizontal scalability, I added an additional server and MORE producer c