Interesting talk, I’ve had a chance to see this in person. Many thanks to Ismael and Eugene!
> On 27 Sep 2018, at 21:34, Eugene Kirpichov <kirpic...@google.com> wrote: > > Thanks Ismael and everyone else! Unfortunately I do not believe that this > session was recorded on video :( > Juan - yes, this is some of the important future work, and I think it's not > hard to add to many connectors; contributions would be welcome. > In terms of a "per-key" Wait transform, yeah, that definitely needs to be > figured out too. The presentation considers only the non-per-key case but I > think it should not be hard to add a per-key one. If you need to do something > directly with the results, you can use Combine.perKey(). > > On Thu, Sep 27, 2018 at 10:10 AM Pablo Estrada <pabl...@google.com > <mailto:pabl...@google.com>> wrote: > I'll take this chance to plug in my little directory of Beam tools/materials: > https://github.com/pabloem/awesome-beam > <https://github.com/pabloem/awesome-beam> > > Please feel free to send PRs : ) > > > On Wed, Sep 26, 2018 at 10:29 PM Ankur Goenka <goe...@google.com > <mailto:goe...@google.com>> wrote: > Thanks for sharing. Great slides and looking for the recorded session. > > Do we have a central location where we link all the beam presentations for > discoverability? > > On Wed, Sep 26, 2018 at 9:35 PM Thomas Weise <t...@apache.org > <mailto:t...@apache.org>> wrote: > Thanks for sharing. I'm looking forward to see the recording of the talk > (hopefully!). > > This will be very helpful for Beam users. IO still is typically the > unexpectedly hard and time consuming part of authoring pipelines. > > > On Wed, Sep 26, 2018 at 2:48 PM Alan Myrvold <amyrv...@google.com > <mailto:amyrv...@google.com>> wrote: > Thanks for the slides. > Really enjoyed the talk in person, especially the concept that IO is a > transformation, and a source or sink are not special and the splittable DoFn > explanation. > > On Wed, Sep 26, 2018 at 2:17 PM Ismaël Mejía <ieme...@gmail.com > <mailto:ieme...@gmail.com>> wrote: > Hello, today Eugene and me did a talk about about modular APIs for IO > at ApacheCon. This talk introduces some common patterns that we have > found while creating IO connectors and also presents recent ideas like > dynamic destinations, sequential writes among others using FileIO as a > use case. > > In case you guys want to take a look, here is a copy of the slides, we > will probably add this to the IO authoring documentation too. > > https://s.apache.org/beam-modular-io-talk > <https://s.apache.org/beam-modular-io-talk>
