Re: Questions about checkpoint retention

2022-02-05 Thread 陳昌倬
On Fri, Jan 28, 2022 at 02:43:11PM +0800, Caizhi Weng wrote: > Chen-Che Huang 于2022年1月27日周四 11:10写道: > > We have two questions for checkpoint retention. > > > >1. When our cron job creates a savepoint called SP, it seems those > >checkpoints created earlier SP still cannot be deleted. We

Re: Questions about checkpoint retention

2022-01-27 Thread Caizhi Weng
Hi! So you'd like to remove all checkpoints after a savepoint is completed? Could you elaborate more on why you'd like to retain 10 checkpoints? For most of the cases retaining one checkpoint is enough. Also you mentioned that you're keeping 10 checkpoints for each version of your app. For each

Questions about checkpoint retention

2022-01-26 Thread Chen-Che Huang
Hi all, To minimize the recovery time from failure, we employ incremental, retained checkpoint with `state.checkpoints.num-retained as 10` in our Flink apps. With this setting, Flink automatically creates new checkpoints regularly and keeps only the latest 10 checkpoints. Besides, for app