se. Maybe someone with more
experience can give more valuable advice.
> How can I find idle check point size of my project, I found below link but it
> is not talking about parallelism.
What do you mean "idle checkpoint size" ?
——————
Best regards,
Feifan Wang
在
overhead, so this is a trade-off.
My personal suggestion is to set the checkpoint interval to 5 minutes when
using rocksdb incremental checkpoint. You can also make your own choice based
on the impacts mentioned above.
——
Best regards,
Feifan Wang
At 2024-06-19 12:08:57, "
Hi Robert :
Your understanding are right !
Add some more information : JobManager not only responsible for cleaning old
checkpoints, but also needs to write metadata file to checkpoint storage after
all taskmanagers have taken snapshots.
---
Best
Feifan Wang