Getting started with Apache Beam Quest

2024-05-30 Thread Ronobir Das
Hey All, Are you guys still running the Apache Beam Quest promotion for a free access code? I'm just starting to learn about Dataflow and Beam and while taking the Coursera course series on Dataflow I was looking at Youtube materials on Apache Beam. I saw the Apache Beam youtube channel and the

Re: Question: Java Apache Beam, mock external Clients initialized in Setup

2024-05-30 Thread Steven van Rossum via dev
A recurring pattern, although not uniformly named, for I/O connectors is to provide a method on the PTransform named something along the lines of withClient, withClientFactory, withClientBuilderFactory, withClientProvider, etc. which stores the configuration the client is to be instantiated with

Beam High Priority Issue Report (59)

2024-05-30 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31432 The PreCommit Java

Re: design docs that get deleted, etc

2024-05-30 Thread Jan Lukavský
Yes, I think that the discoverability and durability would be part of some "process". There could be "informal" part, where the design can take place virtually anywhere and the document can be owned by anyone (as we do today), then it would be copied to a durable store (asf wiki?) and a