Re: [question] Good Course to learn beam

2022-08-30 Thread Evan Galpin
+dev for additional visibility/input On Mon, Aug 29, 2022 at 11:10 AM Leandro Nahabedian via user < u...@beam.apache.org> wrote: > Hi community! > > I'm looking for a good course to learn apache beam and I saw this one >

Re: [idea] A new IO connector named DataLakeIO, which support to connect Beam and data lake, such as Delta Lake, Apache Hudi, Apache iceberg.

2022-08-30 Thread Sachin Agarwal via dev
I would posit that something is better than nothing - did we ever see that generic implementation? On Tue, Aug 30, 2022 at 10:22 AM Austin Bennett wrote: > Is there enough commonality across Delta, Hudi, Iceberg for this generic > solution? I imagined we'd potentially have individual IOs for

Re: [idea] A new IO connector named DataLakeIO, which support to connect Beam and data lake, such as Delta Lake, Apache Hudi, Apache iceberg.

2022-08-30 Thread Austin Bennett
Is there enough commonality across Delta, Hudi, Iceberg for this generic solution? I imagined we'd potentially have individual IOs for each. A generic one seems possible, but certainly would like to learn more. Also, are others in the community working on connectors for ANY of those Delta Lake,

Beam High Priority Issue Report (69)

2022-08-30 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/22913 [Bug]: