Re: Suggestions on load testing a system that uses kafka as underlying message bus?

2015-09-20 Thread David Luu
Thanks, Otis, I'll review the info there. Also, after posting the original message, I came across some kafka extensions to popular industry (OSS) load test tools: https://github.com/BrightTag/kafkameter https://github.com/mnogu/gatling-kafka they might be useful for tests that require customiza

Re: Suggestions on load testing a system that uses kafka as underlying message bus?

2015-09-20 Thread Otis Gospodnetić
Hi, A few pointers are in this Kafka user ML thread: http://search-hadoop.com/m/uyzND177HP92xnm4e Otis -- Monitoring * Alerting * Anomaly Detection * Centralized Log Management Solr & Elasticsearch Support * http://sematext.com/ On Sun, Sep 20, 2015 at 1:14 AM, David Luu wrote: > I'd like to

Suggestions on load testing a system that uses kafka as underlying message bus?

2015-09-19 Thread David Luu
I'd like to generate load against a system we have that uses kafka as the message bus. We have a custom JSON message format, and to properly load test the system, each set of messages for a particular scenario (i.e. user) needs to have a unique identifier, which it normally does. I think of using