Re: New operator emr_cluster_name_to_id viability

2019-11-24 Thread Aviem Zur
Created JIRA issue and PR: https://issues.apache.org/jira/browse/AIRFLOW-6056 https://github.com/apache/airflow/pull/6655 On Tue, Nov 19, 2019 at 9:30 AM Aviem Zur wrote: > Would this change to EmrAddStepsOperator make sense? If so I can go ahead > and create a ticket and a PR > >

Re: New operator emr_cluster_name_to_id viability

2019-11-18 Thread Aviem Zur
Would this change to EmrAddStepsOperator make sense? If so I can go ahead and create a ticket and a PR On Wed, Nov 13, 2019 at 8:11 PM Aviem Zur wrote: > Sure. > > While most EMR clusters are ephemeral, some of our use cases required > persistent EMR clusters since the apps they r

Re: New operator emr_cluster_name_to_id viability

2019-11-13 Thread Aviem Zur
t; > Could you describe in a little bit more detail how you use it? > > -a > > > On 13 Nov 2019, at 15:40, Aviem Zur wrote: > > > > Hi, > > > > I've created a new operator and want to check viability to contribute it > to > > airflow/contrib &

New operator emr_cluster_name_to_id viability

2019-11-13 Thread Aviem Zur
Hi, I've created a new operator and want to check viability to contribute it to airflow/contrib The operator is called: emr_cluster_name_to_id Given an EMR cluster name will return id of the first live cluster found with a matching name. This is useful for users with persistent EMR clusters they