Re: Design proposal for Beam YAML templates

2024-04-02 Thread Robert Bradshaw via dev
It looks like we're converging on an optional jinja preprocessing phase to handle this. I'm in favor of this solution. On Wed, Mar 20, 2024 at 9:23 AM Robert Bradshaw wrote: > Thanks. I think this will be a very powerful feature. Left some comments > on the doc. > > On Tue, Mar 19, 2024 at 11:53

Re: Design proposal for Beam YAML templates

2024-03-20 Thread Robert Bradshaw via dev
Thanks. I think this will be a very powerful feature. Left some comments on the doc. On Tue, Mar 19, 2024 at 11:53 AM Jeff Kinard wrote: > Hi all, > > I have another quick design doc discussing the syntax for Beam YAML > templates. This feature would allow a user to create a template pipelines >

Design proposal for Beam YAML templates

2024-03-19 Thread Jeff Kinard
Hi all, I have another quick design doc discussing the syntax for Beam YAML templates. This feature would allow a user to create a template pipelines similar to what is done in https://github.com/GoogleCloudPlatform/DataflowTemplates that are configurable and therefore more reusable than static YA