Hi Boris
For the configure you gave, you can try to reduce the parallelism of the
operator which contains states.
Best,
Congxian
Boris Lublinsky <boris.lublin...@lightbend.com> 于2019年6月10日周一 下午9:43写道：
> Here is code enabling checkpointing
>
> // Enable checkpointing
> env.enableCheckpointing(60000 ) // 1 min
> env.getCheckpointConfig.setCheckpointingMode(CheckpointingMode.EXACTLY_ONCE)
> env.getCheckpointConfig.setMaxConcurrentCheckpoints(1)
> env.getCheckpointConfig.enableExternalizedCheckpoints(ExternalizedCheckpointCleanup.RETAIN_ON_CANCELLATION)
> val checkpointingBackend = new FsStateBackend("file:///flink/checkpoints",
> true)
> env.setStateBackend(checkpointingBackend)
>
>
>
> Boris Lublinsky
> FDP Architect
> boris.lublin...@lightbend.com
> https://www.lightbend.com/
>
> On Jun 10, 2019, at 1:07 AM, Congxian Qiu <qcx978132...@gmail.com> wrote:
>
> Hi
>
> Which state backed(Heap or RocksDB) and checkpoint mode (fullsnapshot or
> increment) do you use?
>
> Best,
> Congxian
>
>
> Boris Lublinsky <boris.lublin...@lightbend.com> 于2019年6月4日周二 上午6:45写道：
>
>> Is there a way to limit the amount of checkpoint file?
>> The parameter that I set : state.checkpoints.num-retained: 5
>> does not seem to have any effect. Is there anything else I can set to
>> prevent infinite growth of checkpointing info?
>>
>> Boris Lublinsky
>> FDP Architect
>> boris.lublin...@lightbend.com
>> https://www.lightbend.com/
>>
>>
>
