Re: Tour of Beam - an interactive Apache Beam learning guide

2023-06-12 Thread Kerry Donny-Clark via user
Some of you may not know this, but this is my personal dream project. Soon after joining Google I thought "beam is hard to learn." I had learned Go through the excellent "A tour of Go ", and I wished there was something like that for Beam. A series of clear

Re: [Proposal] Kaskada DSL and FnHarness for Temporal Queries

2023-06-12 Thread Ben Chambers
Hey Daniel -- Great question! Kaskada was designed to be similar to SQL but with a few differences. The most significant is the assumption of both ordering and grouping. Kaskada uses this to automatically merge multiple input collections, and to allow data-dependent windows that identify a range

Re: [Proposal] Kaskada DSL and FnHarness for Temporal Queries

2023-06-12 Thread Ryan Michael
Hello, Beam (also)! Just introducing myself - I'm Ryan and I've been working with Ben on the Kaskada project for the past few years. As Ben mentioned, I think there's a great opportunity to bring together some of the work we've done to make time-based computation easier to reason about with the

[Proposal] Kaskada DSL and FnHarness for Temporal Queries

2023-06-12 Thread Ben Chambers
Hello Beam! Kaskada has created a query language for expressing temporal queries, making it easy to work with multiple streams and perform temporally correct joins. We’re looking at taking our native, columnar execution engine and making it available as a PTransform and FnHarness for use with

Tour of Beam - an interactive Apache Beam learning guide

2023-06-12 Thread Alex Panin
Hi Beam community! We invite you to try the Tour Of Beam [1] - an interactive Apache Beam learning guide. Please share your feedback [2] ! Key