Re: Task Manager restart and RocksDB incremental checkpoints issue.

Hi Vidya, Thanks for sharing your setups. > *What do you think about the older files that are pulled from the hostpath to mount path should be deleted first and then create the new instanceBasepath?* I think that deleting the old instance path after restarting is hard to achieve with the current i

Re: Task Manager restart and RocksDB incremental checkpoints issue.

Hi Vidya, It is, until Flink 1.17 is released beginning of next year. While that code might not have been changed, there can be other changes that have impact. See for example this blog https://flink.apache.org/2022/05/06/restore-modes.html Best regards, Martijn Op ma 14 nov. 2022 om 17:45 schr

Re: Task Manager restart and RocksDB incremental checkpoints issue.

Hi Martjin, Thanks for the info. We are in the process of moving to 1.15. Is this version actively supported by community? And coming to my original and follow up questions, I checked the RocksDbStatebackend code from 1.11 and 1.15, it is same. Given K8s configuration with Volume and mounth path

Re: Task Manager restart and RocksDB incremental checkpoints issue.

Hi Vidya, Given that you are still on Flink 1.11 which was released in July 2020 and no longer supported by the community, I would recommend first upgrading to a later, supported version like Flink 1.16. Best regards, Martijn On Sat, Nov 12, 2022 at 8:07 PM Vidya Sagar Mula wrote: > Hi Yanfei

Re: Task Manager restart and RocksDB incremental checkpoints issue.

Hi Yanfei, Thank you for the response. I have follow up answer and questions. I have two set ups. One is on the local environment and the other one is a deployment scenario that is on K8s. - In K8s set up, I have Volume on the cluster node and mount path is specified for the RockDB checkpoints l

Re: Task Manager restart and RocksDB incremental checkpoints issue.

Hi Vidya Sagar, Could you please share the reason for TaskManager restart? If the machine or JVM process of TaskManager crashes, the `RocksDBKeyedStateBackend` can't be disposed/closed normally, so the existing rocksdb instance directory would remain. BTW, if you use Application Mode on k8s, if

Task Manager restart and RocksDB incremental checkpoints issue.

Hi, I am using RocksDB state backend for incremental checkpointing with Flink 1.11 version. Question: -- For a given Job ID, Intermediate RocksDB checkpoints are stored under the path defined with "" The files are stored with "_jobID+ radom UUID" prefixed to the location. Case : 1 -