It looks to me, Hans-Peter's question was not about Beam but Flink. The
provided link should answer his question regarding setting the
checkpoint interval.
-Max
On 27.01.22 11:21, Matt Casters wrote:
It can happen that we lag a bit behind when Apache Beam adds options for
specific runners.
So always let us know if there's an option that's not available.
In fact, if the option is not available in Beam either we can create a
change against Apache Beam itself.
Cheers,
Matt
On Thu, Jan 27, 2022 at 10:50 AM Maximilian Michels <[email protected]
<mailto:[email protected]>> wrote:
Hi Hans-Peter,
Checkpoints are internal to Flink. Hop does not have any business with
it, other than configuring the checkpoint options. Those can also be
configured via the Flink config file.
I see that Hop has checkpointing options listed here:
https://hop.apache.org/manual/latest/pipeline/pipeline-run-configurations/beam-flink-pipeline-engine.html#_options
<https://hop.apache.org/manual/latest/pipeline/pipeline-run-configurations/beam-flink-pipeline-engine.html#_options>
Cheers,
-Max
On 23.01.22 19:03, HG wrote:
> Hi,
>
> Perhaps a dumb question.
> How is checkpointing implemented when the final framework is Flink?
> With Flink checkpoint barriers are inserted.
> Can such an interval also be configured with HOP?
>
> Regards Hans-Peter
