Storm performance testing

2014-08-29 Thread Vincent Russell
Hello, Are there any preferred methods for performance testing storm in a real cluster. Is there a way to tell when the last bolt in a topology is "done" processing tuples in order to tell how long that processing took? Thanks in advance, Vincent

Re: Storm performance testing

2014-08-30 Thread Amila Suriarachchi
Depending on your requirements you can use different techniques. Here[1] is a performance bench mark I found in the net. And here[2] is a benchmark I attempted to write. In my case I tried to measure the throughput and scalability rather than the latency. For that you can use a counter at the fin

Re: Storm performance testing

2014-09-06 Thread Vincent Russell
Thank you for your response Amila. I ended up writing my own custom metrics consumer which writes to a centrailzed data store. That appears to be working well. On Sat, Aug 30, 2014 at 9:33 AM, Amila Suriarachchi < amilasuriarach...@gmail.com> wrote: > Depending on your requirements you can use