Thanks, it was a great talk. Modular and composable IO FTW! On Thu, Sep 27, 2018 at 1:30 AM Juan Carlos Garcia <[email protected]> wrote:
> Im really looking forward for a way to monitor the results(like which > batch of elements were written per destination if possible 🙆 ) of an IO > Module in a consistent way. > > Nice presentation. > > Thomas Weise <[email protected]> schrieb am Do., 27. Sep. 2018, 06:35: > >> Thanks for sharing. I'm looking forward to see the recording of the talk >> (hopefully!). >> >> This will be very helpful for Beam users. IO still is typically the >> unexpectedly hard and time consuming part of authoring pipelines. >> >> >> On Wed, Sep 26, 2018 at 2:48 PM Alan Myrvold <[email protected]> wrote: >> >>> Thanks for the slides. >>> Really enjoyed the talk in person, especially the concept that IO is a >>> transformation, and a source or sink are not special and the splittable >>> DoFn explanation. >>> >>> On Wed, Sep 26, 2018 at 2:17 PM Ismaël MejÃa <[email protected]> wrote: >>> >>>> Hello, today Eugene and me did a talk about about modular APIs for IO >>>> at ApacheCon. This talk introduces some common patterns that we have >>>> found while creating IO connectors and also presents recent ideas like >>>> dynamic destinations, sequential writes among others using FileIO as a >>>> use case. >>>> >>>> In case you guys want to take a look, here is a copy of the slides, we >>>> will probably add this to the IO authoring documentation too. >>>> >>>> https://s.apache.org/beam-modular-io-talk >>>> >>>
