Github user HeartSaVioR commented on the issue:
https://github.com/apache/storm/pull/2203
OK. While I understand what you're saying, that's not easy for individual
to get it, cause we individual don't want to afford completely idle machine and
use for only performance test. I have been spining up AWS VM with "dedicated"
option to set up clear env. and install mandatory services, and go ahead.
Unfortunately I used all of my AWS coupons and have to rely on my PC which is
closely idle. ;)
One approach is running performance tests several times, and drop outliers
and take average or just see trends. If the performance of A is always or most
of the times greater/lower than B with enough trials, I'd rather believe the
result. (would 5 times be sufficient?)
---
