Thanks. The results make sense. Higher consistency (ack=-1 and ack=2)
typically means longer latency.
Do those number match our java producers?
Thanks,
Jun
On Mon, Nov 25, 2013 at 1:16 PM, Magnus Edenhill wrote:
> Producing to one partition, no replication, required.acks = 0:
> % 100 mes
Producing to one partition, no replication, required.acks = 0:
% 100 messages and 1 bytes produced in 1215ms: 822383 msgs/s
and 82.24 Mb/s, 0 messages failed, no compression
Producing to one partition, no replication, required.acks = -1:
% 100 messages and 1 bytes produced
Thanks for sharing the results. Was the topic created with replication
factor of 2? Could you test acks=-1 as well?
Thanks,
Jun
On Mon, Nov 25, 2013 at 4:30 AM, Magnus Edenhill wrote:
> The following tests were using a single producer application
> (examples/rdkafka_performance):
>
> * Test1:
The following tests were using a single producer application
(examples/rdkafka_performance):
* Test1: 2 brokers, 2 partitions, required.acks=2, 100 byte messages:
85 messages/second, 85 MB/second
* Test2: 1 broker, 1 partition, required.acks=0, 100 byte messages: 71
messages/second, 71 MB
So, a single producer'a throughput is 80 MB/s? That seems pretty high. What
was the number of acks setting? Thanks for sharing these numbers.
On Sunday, November 24, 2013, Magnus Edenhill wrote:
> Hi Neha,
>
> these tests were done using 100 byte messages. More information about the
> producer pe
Hi Neha,
these tests were done using 100 byte messages. More information about the
producer performance tests can be found here:
https://github.com/edenhill/librdkafka/blob/master/INTRODUCTION.md#performance-numbers
The tests are indicative at best and in no way scientific, but I must say
that th
Thanks for sharing this! What is the message size for the throughput
numbers stated below?
Thanks,
Neha
On Nov 22, 2013 6:59 AM, "Magnus Edenhill" wrote:
> This announces the 0.8.0 release of librdkafka - The Apache Kafka client C
> library - now with 0.8 protocol support.
>
> Features:
> * Prod
This announces the 0.8.0 release of librdkafka - The Apache Kafka client C
library - now with 0.8 protocol support.
Features:
* Producer (~800K msgs/s)
* Consumer (~3M msgs/s)
* Compression (Snappy, gzip)
* Proper failover and leader re-election support - no message is ever lost.
* Configuration
