Running into memory issues while running on Yarn

Hey! I'm running locally under this configuration(copied from nodemanager logs): physical-memory=8192 virtual-memory=17204 virtual-cores=8 Before starting a flink deployment, memory usage stats show 3.7 GB used on system, indicating lots of free memory for flink containers. However, after I submi

Re: Running into memory issues while running on Yarn

Hi, You containers got killed by YARN for exceeding virtual memory limits. For some reason your container intensively allocate virtual memory while having free physical memory. There are some gotchas regarding such issue on CentOS, caused by OS-specific aggressive virtual memory allocation: [1],