Re: Memory usage UI

2021-07-01 Thread Sudharsan R
Hi Xintong, Thanks very much for the response. Let me check out the new UI on flink 1.12. The reason I asked this question is because our flink cluster on k8s shows a container_working_set_bytes(used by OOMkiller) to be > 3Gb. I assume that the used(heap, non-heap) values on the UI are correct.

Re: Memory usage UI

2021-07-01 Thread Xintong Song
Hi Sudharsan, The non-heap max is decided by JVM automatically and is not controlled by Flink. Moreover, it doesn't mean Flink will use up to that size of non-heap memory. These metrics are fetched directly from JVM and do not correspond well with Flink's memory configurations, which very often

Memory usage UI

2021-07-01 Thread Sudharsan R
Hi, On my flink setup, I have taskmanager.memory.process.size set to 2536M. I expect all the memory components shown on the UI to add up to this number. However, I don't see this. I have flink managed memory: 811Mb JVM heap max: 886Mb JVM non-heap max: 744Mb Direct memory: 204Mb This adds