Re: Non-trivial joins examples

2020-05-03 Thread Reza Ardeshir Rokni
A couple of things that are really nice here, 1- Domain specific (CTR in your example). We may find that eventually it's not possible / practical to build out generic joins for all situations. But with the primitives available in Beam and good 'patterns' domain specific joins could be added for

Re: Jacek's new Apache Beam Internals Project

2020-05-03 Thread Rion Williams
Yeah, I’m in hopes that gets fleshed out a bit more. I just opened it up and didn’t realize it was a work in progress :) > On May 3, 2020, at 5:17 PM, Rion Williams wrote: > > Thanks so much Holden! I’ve been looking for something that dives a bit > deeper into the internals of Beam, so this

Re: Jacek's new Apache Beam Internals Project

2020-05-03 Thread Rion Williams
Thanks so much Holden! I’ve been looking for something that dives a bit deeper into the internals of Beam, so this is perfect! Just purchased - looking forward to digging into it! > On Apr 28, 2020, at 1:04 PM, Holden Karau wrote: > >  > Hi Folks, > > I just saw Jacek's tweet about his new

Re: Jacek's new Apache Beam Internals Project

2020-05-03 Thread Holden Karau
That's my understanding. I believe he's starting to explore Beam & Kafka in the same way he did with Spark which is exciting to me. On Thu, Apr 30, 2020 at 10:17 AM Reuven Lax wrote: > I took a look at the book - there's not really much there. Maybe he's > planning on adding more over time? > >