[
https://issues.apache.org/jira/browse/KAFKA-171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13136223#comment-13136223
]
Jay Kreps commented on KAFKA-171:
---------------------------------
Moving off localhost between my mac laptop and dev workstation (linux) I see
similar results:
TRUNK:
jkreps-mn:kafka-git jkreps$ bin/kafka-producer-perf-test.sh --topic test
--brokerinfo zk.connect=jkreps-ld:2181 --messages 500000 --message-size 10
--batch-size 1 --threads 1
[2011-10-26 11:59:51,795] INFO Total Num Messages: 500000 bytes: 5000000 in
13.046 secs (kafka.tools.ProducerPerformance$)
[2011-10-26 11:59:51,795] INFO Messages/sec: 38325.9237
(kafka.tools.ProducerPerformance$)
[2011-10-26 11:59:51,795] INFO MB/sec: 0.3655 (kafka.tools.ProducerPerformance$)
PATCHED:
jkreps-mn:kafka-git jkreps$ bin/kafka-producer-perf-test.sh --topic test
--brokerinfo zk.connect=jkreps-ld:2181 --messages 500000 --message-size 10
--batch-size 1 --threads 1
[2011-10-26 11:58:42,335] INFO Total Num Messages: 500000 bytes: 5000000 in
13.125 secs (kafka.tools.ProducerPerformance$)
[2011-10-26 11:58:42,335] INFO Messages/sec: 38095.2381
(kafka.tools.ProducerPerformance$)
[2011-10-26 11:58:42,335] INFO MB/sec: 0.3633 (kafka.tools.ProducerPerformance$)
> Kafka producer should do a single write to send message sets
> ------------------------------------------------------------
>
> Key: KAFKA-171
> URL: https://issues.apache.org/jira/browse/KAFKA-171
> Project: Kafka
> Issue Type: Bug
> Components: core
> Affects Versions: 0.7, 0.8
> Reporter: Jay Kreps
> Assignee: Jay Kreps
> Fix For: 0.8
>
> Attachments: KAFKA-171-draft.patch
>
>
> From email thread:
> http://mail-archives.apache.org/mod_mbox/incubator-kafka-dev/201110.mbox/%3ccafbh0q1pyuj32thbayq29e6j4wt_mrg5suusfdegwj6rmex...@mail.gmail.com%3e
> > Before sending an actual message, kafka producer do send a (control)
> > message of 4 bytes to the server. Kafka producer always does this action
> > before send some message to the server.
> I think this is because in BoundedByteBufferSend.scala we do essentially
> channel.write(sizeBuffer)
> channel.write(dataBuffer)
> The correct solution is to use vector I/O and instead do
> channel.write(Array(sizeBuffer, dataBuffer))
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
