hich happens when you enable incremental
> checkpointing[1].
> > > Therefore, it’s reasonable that the size keeps growing if you set
> > > “state.checkpoint.num-retained” to be a big value.
> > >
> > >
> > > [1]
> > >
> >
>
amp;sdata=yccGSr%2BNrrCuUse1lYJ%2FFgHInx9oXwtfkhnN1KuhDf8%3D&reserved=0>
> >
> >
> > Best,
> > Jiayi Liao
> >
> >
> > Original Message
> > Sender: shuwen zhoumailto:jaco...@gmail.com>>
> > Recipie
> checkpoints, which happens when you enable incremental
> checkpointing[1].
> > > Therefore, it’s reasonable that the size keeps growing if you set
> > > “state.checkpoint.num-retained” to be a big value.
> > >
> > >
> > >
heckpoint.num-retained” to be a big value.
> >
> >
> > [1]
> >
>
https://flink.apache.org/features/2018/01/30/incremental-checkpointing.html
> >
> >
> > Best,
> > Jiayi Liao
> >
&
gt; >
> >
> > Best,
> > Jiayi Liao
> >
> >
> > Original Message
> > Sender: shuwen zhou
> > Recipient: dev
> > Date: Tuesday, Nov 5, 2019 17:59
> > Subject: RocksDB state on HDFS seems not being cleanned up
> >
>
> Original Message
> Sender: shuwen zhou
> Recipient: dev
> Date: Tuesday, Nov 5, 2019 17:59
> Subject: RocksDB state on HDFS seems not being cleanned up
>
>
> Hi Community, I have a job running on Flink1.9.0 on YARN with rocksDB on
> HDFS with incremental checkpoint
://flink.apache.org/features/2018/01/30/incremental-checkpointing.html
Best,
Jiayi Liao
Original Message
Sender: shuwen zhou
Recipient: dev
Date: Tuesday, Nov 5, 2019 17:59
Subject: RocksDB state on HDFS seems not being cleanned up
Hi Community, I have a job running on Flink1.9.0 on YARN with rocksDB on
Hi Community,
I have a job running on Flink1.9.0 on YARN with rocksDB on HDFS with
incremental checkpoint enabled. I have some MapState in code with following
config:
val ttlConfig = StateTtlConfig
.newBuilder(Time.minutes(30)
.updateTtlOnCreateAndWrite()
.cleanupInBackground()
.cleanupFul
