High disk read with Kafka streams

2021-08-10 Thread mangat rai
Hey All, We are using the low level processor API to create kafka stream applications. Each app has 1 or more in-memory state stores with caching disabled and changelog enabled. Some of the apps also have global stores. We noticed from the node metrics (kubernetes) that the stream applications are

Re: High disk read with Kafka streams

2021-08-17 Thread Guozhang Wang
Hello Magnat, Thanks for reporting your observations. I have some questions: 1) Are your global state stores also in-memory or persisted on disks? 2) Are your Kafka and KStreams colocated? Guozhang On Tue, Aug 10, 2021 at 6:10 AM mangat rai wrote: > Hey All, > > We are using the low level pr