Im really looking forward for a way to monitor the results(like which batch of elements were written per destination if possible 🙆 ) of an IO Module in a consistent way.
Nice presentation. Thomas Weise <[email protected]> schrieb am Do., 27. Sep. 2018, 06:35: > Thanks for sharing. I'm looking forward to see the recording of the talk > (hopefully!). > > This will be very helpful for Beam users. IO still is typically the > unexpectedly hard and time consuming part of authoring pipelines. > > > On Wed, Sep 26, 2018 at 2:48 PM Alan Myrvold <[email protected]> wrote: > >> Thanks for the slides. >> Really enjoyed the talk in person, especially the concept that IO is a >> transformation, and a source or sink are not special and the splittable >> DoFn explanation. >> >> On Wed, Sep 26, 2018 at 2:17 PM Ismaël MejÃa <[email protected]> wrote: >> >>> Hello, today Eugene and me did a talk about about modular APIs for IO >>> at ApacheCon. This talk introduces some common patterns that we have >>> found while creating IO connectors and also presents recent ideas like >>> dynamic destinations, sequential writes among others using FileIO as a >>> use case. >>> >>> In case you guys want to take a look, here is a copy of the slides, we >>> will probably add this to the IO authoring documentation too. >>> >>> https://s.apache.org/beam-modular-io-talk >>> >>
