[ https://issues.apache.org/jira/browse/STORM-814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rajesh Kucharlapati updated STORM-814: -------------------------------------- Comment: was deleted (was: Here is the bolt latency information bol2 32 32 2123660 2123660 0.035 1.081 2123620 1.069 2123520 0 bolt3 8 8 2120980 0 0.095 0.906 2121280 0.908 2121280 0 bolt1 8 8 2124180 2124180 0.090 0.957 2125860 0.950 2125840 0 Kafka spout information Spouts (All time) kafkaspout 8 8 2125680 2125680 2050.919 2116780 0 Its simple topology with total execution less than 3 ms. I am running this topology with 4 supervisors with one worker node each. There are no specific config info set on kafka spout. ) > Kafka Spout performance > ----------------------- > > Key: STORM-814 > URL: https://issues.apache.org/jira/browse/STORM-814 > Project: Apache Storm > Issue Type: Bug > Components: storm-kafka > Affects Versions: 0.9.3 > Environment: Centos, AWS , M3.2xlarge instances > Reporter: Rajesh Kucharlapati > > I am running few test for storm topology with kafka. > Created a topic with 16 partitions and emitted 10k messages/sec with each > message 1k size. > When I set the kafka spout parallelism to 1, I am getting latency of 8.9 ms > but when i increase the parallelism to 8, I am getting latency of 1.2 sec. > Settings : > MAX_SPOUT SPENDING set to 1000-5000 > String zkConnString = "zookeeper1:2181"; > String kafkaTopic = "messages"; > String zkRootPath = "/kafkaStorm"; > String zkOffSetID = "kafka"; -- This message was sent by Atlassian JIRA (v6.3.4#6332)