Re: [Proposal] Kaskada DSL and FnHarness for Temporal Queries

2023-06-12 Thread Ben Chambers
Hey Daniel -- Great question! Kaskada was designed to be similar to SQL but with a few differences. The most significant is the assumption of both ordering and grouping. Kaskada uses this to automatically merge multiple input collections, and to allow data-dependent windows that identify a range o

Re: [Proposal] Kaskada DSL and FnHarness for Temporal Queries

2023-06-12 Thread Ryan Michael
Hello, Beam (also)! Just introducing myself - I'm Ryan and I've been working with Ben on the Kaskada project for the past few years. As Ben mentioned, I think there's a great opportunity to bring together some of the work we've done to make time-based computation easier to reason about with the Be

[Proposal] Kaskada DSL and FnHarness for Temporal Queries

2023-06-12 Thread Ben Chambers
Hello Beam! Kaskada has created a query language for expressing temporal queries, making it easy to work with multiple streams and perform temporally correct joins. We’re looking at taking our native, columnar execution engine and making it available as a PTransform and FnHarness for use with Apac