Regarding java.lang.IllegalStateException

2024-04-23 Thread prashant parbhane
Hello, We have been facing this weird issue, where we are getting below exception and the job is getting restarted with new task managers. We are using flink 1.17. Same job works fine with lower number of task managers. (<10) java.lang.IllegalStateException: The library registration references a

Re: Flink job unable to restore from savepoint

2024-03-27 Thread prashant parbhane
configurations ? If yes, Could you > share changed things ? > > On Wed, Mar 27, 2024 at 3:37 PM prashant parbhane > wrote: > >> Hello, >> >> We have been facing this weird issue of not being able to restore from >> sav

Flink job unable to restore from savepoint

2024-03-26 Thread prashant parbhane
Hello, We have been facing this weird issue of not being able to restore from savepoint, when we have a significant load on flink jobs. " *org.apache.flink.util.FlinkRuntimeException: Error while deserializing the user key.* *at org.apache.flink.contrib.streaming.state.RocksDBMapState$RocksD

Re: 回复: oomkill issue

2023-12-04 Thread prashant parbhane
emory. > Here is the command for you. > ``` > jmap -dump:live,format=b,file=/tmp/heap.hprof > ``` > > [1] Using jemalloc to Optimize Memory Allocation — Sentieon Appnotes > 202308.01 documentation <https://support.sentieon.com/appnotes/jemalloc/> > > Best, > Yu Chen &

oomkill issue

2023-11-27 Thread prashant parbhane
Hello, We have been facing this oomkill issue, where task managers are getting restarted with this error. I am seeing memory consumption increasing in a linear manner, i have given memory and CPU as high as possible but still facing the same issue. We are using rocksdb for the state backend, is t