Re: University of Innsbruck - Apache Beam options

2024-06-06 Thread Jan Lukavský
Hi Stefan, the settings in the runner works differently than how you might expect. According to the Beam model, a "bundle" is a unit of work, that either completes successfully as a whole or is restarted from scratch (i.e. it is perfectly fine for the bundle to be processed to the middle,

Re: University of Innsbruck - Apache Beam options

2024-06-06 Thread Ahmet Altay via dev
I sent you an invite for Slack. Welcome to the Beam community. On Thu, Jun 6, 2024 at 10:47 AM Pedratscher Stefan < stefan.pedratsc...@student.uibk.ac.at> wrote: > Dear Apache Beam Team, > > I am a student at the University of Innsbruck, currently using Apache > Beam for my research. > > I am

University of Innsbruck - Apache Beam options

2024-06-06 Thread Pedratscher Stefan
Dear Apache Beam Team, I am a student at the University of Innsbruck, currently using Apache Beam for my research. I am using Flink v1.19 and the Flink runner (https://beam.apache.org/documentation/runners/flink/) to execute pipelines. I managed to run the pipeline with several options:

Beam High Priority Issue Report (58)

2024-06-06 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31432 The PreCommit Java