Re: RFC: Assigning environments to transforms in a pipeline

2019-10-17 Thread Chamikara Jayalath
Sounds great. One thing we probably should address is identifying environments that are incompatible with runners and trying to fail pipelines early when such incompatibilities are detected. I think currently we assign environments to transforms in following well defined locations. (1) for

Re: RFC: Assigning environments to transforms in a pipeline

2019-10-16 Thread Chad Dombrova
Hi Robert, > Sounds nice. Is there a design doc (or, perhaps, you could just give an > example of what this would look like in this thread)? > I'll follow up shortly with something. The good news is that this first PR is quite straightforward and (I think) is independent of the semantics of how

Re: RFC: Assigning environments to transforms in a pipeline

2019-10-16 Thread Robert Bradshaw
Sounds nice. Is there a design doc (or, perhaps, you could just give an example of what this would look like in this thread)? On Wed, Oct 16, 2019 at 5:51 PM Chad Dombrova wrote: > Hi all, > One of our goals for the portability framework is to be able to assign > different environments to