Re: What is "Processed (persisted) in-flight data"

2021-01-31 Thread Rex Fenley
Oh, nvm, that's the "Persisted" part which is documented as "*Persisted in-flight data*: The number of bytes persisted during the alignment (time between receiving the first and the last checkpoint barrier) over all acknowledged subtasks. This is > 0 only if the unaligned checkpoints are enabled."

Re: What is "Processed (persisted) in-flight data"

2021-01-31 Thread Rex Fenley
Got it, thanks! What is the 0 B part of that? On Sun, Jan 31, 2021 at 3:43 AM Arvid Heise wrote: > Processed in-flight data is the size of data that is processed between the > first and last checkpoint barrier in aligned checkpointing. [1] > > [1] >

Re: What is "Processed (persisted) in-flight data"

2021-01-31 Thread Arvid Heise
Processed in-flight data is the size of data that is processed between the first and last checkpoint barrier in aligned checkpointing. [1] [1] https://ci.apache.org/projects/flink/flink-docs-stable/ops/monitoring/checkpoint_monitoring.html#history-tab On Sun, Jan 31, 2021 at 7:45 AM Rex Fenley

What is "Processed (persisted) in-flight data"

2021-01-30 Thread Rex Fenley
Hello, In the latest version I now see two byte measures on checkpoints. There's *Checkpointed Data Size* *9.05 GB* Which I'm assuming means 9.05 GB were written in this incremental checkpoint. But now there is also *Processed (persisted) in-flight data* *152 MB (0 B)* What is that? Thanks! --