Re: State size increasing exponentially in Flink v1.9

2021-03-26 Thread Yun Tang
Subject: Re: State size increasing exponentially in Flink v1.9 Could you show us how you interact with the map state (ideally the full code of your function that accesses the state)? On 3/25/2021 1:13 AM, Almeida, Julius wrote: Hey, Hope you all are doing well! I am using flink v1.9 with

Re: State size increasing exponentially in Flink v1.9

2021-03-26 Thread Chesnay Schepler
Could you show us how you interact with the map state (ideally the full code of your function that accesses the state)? On 3/25/2021 1:13 AM, Almeida, Julius wrote: Hey, Hope you all are doing well! I am using flink v1.9 with RocksDBStateBackend, but over time the state size is increasing e

State size increasing exponentially in Flink v1.9

2021-03-24 Thread Almeida, Julius
Hey, Hope you all are doing well! I am using flink v1.9 with RocksDBStateBackend, but over time the state size is increasing exponentially. I am using MapState in my project & seeing memory spike, after looking at heap dump I see duplicates in it. I also have logic added to remove expired even