[ https://issues.apache.org/jira/browse/GEARPUMP-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15313788#comment-15313788 ]
Manu Zhang commented on GEARPUMP-40: ------------------------------------ I don't expect much performance improvement (which is the next step) since it's mainly interface changes. I'll follow up on the test anyway. > KafkaSource poor performance > ---------------------------- > > Key: GEARPUMP-40 > URL: https://issues.apache.org/jira/browse/GEARPUMP-40 > Project: Apache Gearpump > Issue Type: Improvement > Components: kafka > Affects Versions: 0.8.0 > Reporter: Manu Zhang > Assignee: Manu Zhang > > As per > [https://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-writes-second-three-cheap-machines], > a single thread Kafka consumer could consume at 89.7MB/s from 6x partition > 3x replica topic whose data are evenly distributed on a 3-node GbE cluster. I > carried out a similar experiment with KafkaSource and found that the > throughput is only at 10MB/s. -- This message was sent by Atlassian JIRA (v6.3.4#6332)