Re: Cron style for checkpoint

2019-11-21 Thread Congxian Qiu
m mechanism. > Savepoint, on the other hand, is not incremental update, trigger a > savepoint every 10 mins will waste a lot of disk and another script is > required to remove outdated savepoint. I suppose savepoint is being used in > upgrade/restart scenario. > A cron style checkpoint tim

Re: Cron style for checkpoint

2019-11-21 Thread shuwen zhou
suppose savepoint is being used in upgrade/restart scenario. A cron style checkpoint time config will provide a lot flexibility. Thanks. On Thu, 21 Nov 2019 at 16:28, Yun Tang wrote: > Hi Shuwen > > > > Conceptually, checkpoints in Flink behaves more like a system mechanism to

Re: Cron style for checkpoint

2019-11-21 Thread Yun Tang
: Congxian Qiu Date: Thursday, November 21, 2019 at 2:27 PM To: shuwen zhou Cc: Jiayi Liao , dev , user Subject: Re: Cron style for checkpoint Hi Currently, Flink does not support such feature, from what you describe, does set an appropriate timeout for checkpoint can solve your problem? Best

Re: Cron style for checkpoint

2019-11-20 Thread Congxian Qiu
ng about this :) >> >> >> >> Best, >> >> Jiayi Liao >> >> >> At 2019-11-21 10:20:47, "shuwen zhou" wrote: >> >Hi Community, >> >I would like to know if there is a existing function to support cron style >> >checkp

Re: Cron style for checkpoint

2019-11-20 Thread shuwen zhou
> > Best, > > Jiayi Liao > > > At 2019-11-21 10:20:47, "shuwen zhou" wrote: > >Hi Community, > >I would like to know if there is a existing function to support cron style > >checkpoint? > >The case is, our data traffic is huge on HH:30 for

Cron style for checkpoint

2019-11-20 Thread shuwen zhou
Hi Community, I would like to know if there is a existing function to support cron style checkpoint? The case is, our data traffic is huge on HH:30 for each hour. We don't wont checkpoint to fall in that range of time. A cron like 15,45 * * * * to set for checkpoint would be nice. If a checkpoint