Fwd: Why is the size of each checkpoint increasing?

2019-07-30 Thread Darling
? > 日期: 2019年7月29日 GMT+8 下午8:58:44 > 收件人: 陈Darling mailto:chendonglin...@gmail.com>> > 抄送: user@flink.apache.org <mailto:user@flink.apache.org> > > I think the size of the checkpoint strongly depends on the data you are > feeding into this function. Depending on the a

Fwd: Why is the size of each checkpoint increasing?

2019-07-30 Thread Darling
; > Cheers, > Till > > On Mon, Jul 29, 2019 at 11:09 AM 陈Darling <mailto:chendonglin...@gmail.com>> wrote: > > Flink version is 1.81 > The eaxmple is adapted according to TopSpeedWindowing > DataStream> topSpeeds = carData > .assignTimestampsAndWat

Why is the size of each checkpoint increasing?

2019-07-29 Thread Darling
Flink version is 1.81 The eaxmple is adapted according to TopSpeedWindowing DataStream> topSpeeds = carData .assignTimestampsAndWatermarks(new CarTimestamp()).setParallelism(parallelism) .keyBy(0) .countWindow(countSize, slideSize) .trigger(DeltaTrigger.of(triggerM

Fwd: FsStateBackend,hdfs rpc api too much,FileCreated and FileDeleted is for what?

2019-07-25 Thread Darling
Yes,that’s the point , FilesCreated = CreateFileOps + FsDirMkdirOp All I can say is  --thanksDarling Andrew D.Lin下面是被转发的邮件:发件人: Yun Tang <myas...@live.com>主题: 回复: FsStateBackend,hdfs rpc api too much,FileCreated and FileDeleted is for what?日期: 2019年7月23日 GMT+8 下午4:05:42收件人: 陈Darling <ch

Fwd: FsStateBackend,hdfs rpc api too much,FileCreated and FileDeleted is for what?

2019-07-22 Thread Darling
there is any possibility of re-optimization,Thank you very much for your patience and help.  Darling Andrew D.Lin 下面是被转发的邮件:发件人: Congxian Qiu <qcx978132...@gmail.com>主题: 回复: FsStateBackend,hdfs rpc api too much,FileCreated and FileDeleted is for what?日期: 2019年7月23日 GMT+8 上午9:48:05收件

Fwd: FsStateBackend,hdfs rpc api too much,FileCreated and FileDeleted is for what?

2019-07-22 Thread Darling
there is any possibility of re-optimization,Thank you very much for your patience and help.  Darling Andrew D.Lin 下面是被转发的邮件:发件人: Congxian Qiu <qcx978132...@gmail.com>主题: 回复: FsStateBackend,hdfs rpc api too much,FileCreated and FileDeleted is for what?日期: 2019年7月23日 GMT+8 上午9:48:05收件

Fwd: FsStateBackend,hdfs rpc api too much,FileCreated and FileDeleted is for what?

2019-07-22 Thread Darling
8:05收件人: 陈Darling <chendonglin...@gmail.com>抄送: user <user@flink.apache.org>Hi AndrewThese API calls are for checkpoint file created/deleted, and there is an ongoing issue[1] which want to reduce the number.[1] https://issues.apache.org/jira/browse/FLINK-11696Best,Congxian陈Da

Fwd: FLink checkpoint,How to calculcate the number of files below the chk folder

2019-07-18 Thread Darling
Darling Andrew D.Lin > 下面是被转发的邮件: > > 发件人: 陈Darling > 主题: FLink checkpoint,How to calculcate the number of files below the chk > folder > 日期: 2019年7月18日 GMT+8 下午4:02:11 > 收件人: user@flink.apache.org > > Hello > > state_checkpoints_dir/2d93ffacbddcf363b