Re: Setting Memory Bound RocksDB Config

2021-11-18 Thread Luke Chen
Hi Gray, Answering your question below: > If we set TOTAL_OFF_HEAP_MEMORY, to, say, 1GB, does that mean the app should only use 1GB for the whole application, or is it per store (so 3GB total)? Or perhaps per store and per task (3GB * num tasks)? The TOTAL_OFF_HEAP_MEMORY setting limits the memor

Setting Memory Bound RocksDB Config

2021-11-18 Thread Gray, John
Hello! We are currently trying our best to limit the amount of memory RocksDB uses. We have implemented the config setter prescribed in the RocksDB section of this page: https://kafka.apache.org/30/documentation/streams/developer-guide/memory-mgmt.html#id3, but are still hitting OOMs. My quest