Re:Re: Checkpoints and windows size

2024-06-19 Thread Feifan Wang
se. Maybe someone with more experience can give more valuable advice. > How can I find idle check point size of my project, I found below link but it > is not talking about parallelism. What do you mean "idle checkpoint size" ? —————— Best regards, Feifan Wang 在

Re:Checkpoints and windows size

2024-06-19 Thread Feifan Wang
overhead, so this is a trade-off. My personal suggestion is to set the checkpoint interval to 5 minutes when using rocksdb incremental checkpoint. You can also make your own choice based on the impacts mentioned above. —— Best regards, Feifan Wang At 2024-06-19 12:08:57, "

Re:Understanding checkpoint/savepoint storage requirements

2024-03-27 Thread Feifan Wang
Hi Robert : Your understanding are right ! Add some more information : JobManager not only responsible for cleaning old checkpoints, but also needs to write metadata file to checkpoint storage after all taskmanagers have taken snapshots. --- Best Feifan Wang