This is great. Thanks Pablo and all I've seen several folk struggle with writing avro to dynamic locations which I think might be a good addition. If you agree I'll offer a PR unless someone gets there first - I have an example here:
https://github.com/gbif/pipelines/blob/master/pipelines/export-gbif-hbase/src/main/java/org/gbif/pipelines/hbase/beam/ExportHBase.java#L81 On Fri, Jun 7, 2019 at 10:52 PM Pablo Estrada <pabl...@google.com> wrote: > Hello everyone, > A group of community members has been working on gathering and providing > common pipeline patterns for pipelines in Beam. These are examples on how > to perform certain operations, and useful ways of using Beam in your > pipelines. Some of them relate to processing of files, use of side inputs, > sate/timers, etc. Check them out[1]. > > These initial patterns have been chosen based on evidence gathered from > StackOverflow, and from talking to users of Beam. > > It would be great if this section could grow, and be useful to many Beam > users. For that reason, we invite anyone to share patterns, and pipeline > examples that they have used in the past. If you are interested in > contributing, please submit a pull request, or get in touch with Cyrus > Maden, Reza Rokni, Melissa Pashniak or myself. > > Thanks! > Best > -P. > > [1] https://beam.apache.org/documentation/patterns/overview/ >
