Jun,
let me see if I can fix first and then will submit back.
Daniel,
I was looking at the code some more and was thinking this might work
https://github.com/apache/kafka/blob/0.8.1/perf/src/main/scala/kafka/perf/ProducerPerformance.scala
on line 246 instead of looping to create messages I co
Hi Bert
What you are describing could be done partially with the console producer. It
will read from a file and send each line to the Kafka broker. You could make a
really big file or alter that code to repeat a certain number of times. The
source is pretty readable, I think that might be an ea
Yes, this is a problem and will indeed affect the producer performance when
compression is turned on. Perhaps we should fill in the values with some
randomized bytes. Could you file a jira for this?
Thanks,
Jun
On Sun, Jun 29, 2014 at 11:24 PM, Daniel Compton
wrote:
> Hi folks
>
> I was doing
Daniel,
We have the same question. We noticed that the compression tests we ran
using the built in performance tester was not realistic. I think on disk
compression was 200:1. (yes that is two hundred to one) I had planned to
try and edit the producer performance tester source and do the foll
Hi folks
I was doing some performance testing using the built in Kafka performance
tester and it seems like it sends messages of size n bytes but with all bytes
having the value 0x0. Is that correct? Reading the source seemed to indicate
that too but I'm not a Scala developer so I could be wron
