Hello, Beam (also)! Just introducing myself - I'm Ryan and I've been working with Ben on the Kaskada project for the past few years. As Ben mentioned, I think there's a great opportunity to bring together some of the work we've done to make time-based computation easier to reason about with the Beam community's work on scalable streaming computation.
I'll be at the Beam Summit in NYC starting Wednesday and presenting a short overview of how we see Kaskada fitting into the Generative AI world at the "Generative AI Meetup" Wednesday afternoon - if the doc Ben linked to (or GenAI) is interesting to you and you'll be at the conference I'd love to touch base in person! -Ryan On Mon, Jun 12, 2023 at 2:51 PM Ben Chambers <[email protected]> wrote: > Hello Beam! > > Kaskada has created a query language for expressing temporal queries, > making it easy to work with multiple streams and perform temporally > correct joins. We’re looking at taking our native, columnar execution > engine and making it available as a PTransform and FnHarness for use > with Apache Beam. > > We’ve drafted a [short document][proposal] outlining our planned > approach and the potential benefits to Kaskada and Beam users. It > would be super helpful to get some feedback on this approach and any > ways that it could be improved / better integrated with Beam to > provide more value! > > Could you see yourself using (or contributing) to this work? Let us know! > > Thanks! > > Ben > > [proposal]: > https://docs.google.com/document/d/1w6DYpYCi1c521AOh83JN3CB3C9pZwBPruUbawqH-NsA/edit > -- *Ryan Michael * [email protected] | 512.466.3662 | github <https://github.com/kerinin> | linkedin <http://www.linkedin.com/pub/ryan-michael/21/41/a29>
