Thanks for sharing. I'm looking forward to see the recording of the talk (hopefully!).
This will be very helpful for Beam users. IO still is typically the unexpectedly hard and time consuming part of authoring pipelines. On Wed, Sep 26, 2018 at 2:48 PM Alan Myrvold <amyrv...@google.com> wrote: > Thanks for the slides. > Really enjoyed the talk in person, especially the concept that IO is a > transformation, and a source or sink are not special and the splittable > DoFn explanation. > > On Wed, Sep 26, 2018 at 2:17 PM Ismaël Mejía <ieme...@gmail.com> wrote: > >> Hello, today Eugene and me did a talk about about modular APIs for IO >> at ApacheCon. This talk introduces some common patterns that we have >> found while creating IO connectors and also presents recent ideas like >> dynamic destinations, sequential writes among others using FileIO as a >> use case. >> >> In case you guys want to take a look, here is a copy of the slides, we >> will probably add this to the IO authoring documentation too. >> >> https://s.apache.org/beam-modular-io-talk >> >
