Jon, It's hard to tell. Would you be willing to run a simple benchmark and report back the numbers? The benchmark is called SimpleBenchmark.java, it's included with the source, and it will start a couple of streams apps. It requires a ZK and a broker to be up. Then you run it: org.apache.kafka.streams.perf.SimpleBenchmark <zookeeperHostPortString> <brokerHostPortString>.
Thanks Eno > On 16 Dec 2016, at 20:00, Jon Yeargers <jon.yearg...@cedexis.com> wrote: > > Looking for reasons why my installations seem to be generating so many > issues: > > Starting an app which is > > stream->aggregate->filter->foreach > > While it's running the system in question (AWS) averages >10% IOWait with > spikes to 60-70%. The CPU load is in the range of 3/2/1 (8 core machine w/ > 16G RAM) > > Could this IO delay be causing problems? The 'kafka-streams' folder is on a > separate EBS optimized volume with 2500 dedicated IOPs.
