Hi Dayo, the rdkafka_performance tool from librdkafka is useful for performance measurements / stress testing. https://github.com/edenhill/librdkafka
It resides in the examples/ directory. https://github.com/edenhill/librdkafka/blob/master/INTRODUCTION.md#test-details Regards, Magnus 2014-07-21 23:06 GMT+02:00 Dayo Oliyide <dayo.oliy...@gmail.com>: > Thanks for the pointers guys, I will look into them. > > --Dayo > > > On Sat, Jul 19, 2014 at 9:07 PM, Steve Morin <st...@stevemorin.com> wrote: > > > Otis, > > Yes this would work for Kafka because it's using to launch containers > to > > generate load for performance testing. It also works in standalone mode > to > > run on a single machine. We currently are updating it to make it easier > to > > use and upgrading it's ability to collect statistics in distributed mode. > > > > The load tests are configurable using Javascript. > > > > -Steve > > > > > > On Sat, Jul 19, 2014 at 9:48 AM, Otis Gospodnetic < > > otis.gospodne...@gmail.com> wrote: > > > > > Would this work for Kafka, Steve, considering Kafka doesn't use Yarn? > > > > > > Dayo - we developed https://github.com/sematext/ActionGenerator to > feed > > > events to things like Elasticsearch, Solr, and MongoDB. We'd gladly > > take a > > > pull request for Kafka. SPM for Kafka > > > < > > > > > > http://blog.sematext.com/2013/10/16/announcement-spm-performance-monitoring-for-kafka/ > > > > > > > may be handy for observing various Kafka metrics while you run your > > > performance tests. > > > > > > Otis > > > -- > > > Performance Monitoring * Log Analytics * Search Analytics > > > Solr & Elasticsearch Support * http://sematext.com/ > > > > > > > > > > > > > > > On Wed, Jul 16, 2014 at 1:07 PM, Steve Morin <st...@stevemorin.com> > > wrote: > > > > > > > We are working on this Yarn based tool , but it's still in alpha > > > > https://github.com/DemandCube/DemandSpike > > > > > > > > > > > > On Wed, Jul 16, 2014 at 11:30 AM, Dayo Oliyide < > dayo.oliy...@gmail.com > > > > > > > wrote: > > > > > > > > > Hi, > > > > > > > > > > I'm setting up a Kafka Cluster and would like to carry out some > > > > > performance/stress tests on different configurations. > > > > > > > > > > Other than the performance testing scripts that come with Kafka, > are > > > > there > > > > > any other tools that anyone would recommend? > > > > > > > > > > Regards, > > > > > Dayo > > > > > > > > > > > > > > >
