ShortCircuitIfNotCurrentOperator

2016-08-17 Thread siddharth anand
night, but doesn't need to "backfill" the days missed. We had originally envisioned building this into the scheduler, but that is unnecessarily complex. Instead, we have had the ShortCircuitOperator around for a while. I plan to extend this to make a ShortCircuitIfNotCurrentOper

Re: ShortCircuitIfNotCurrentOperator

2016-08-17 Thread Felix Cheung
r, but that is unnecessarily complex. Instead, we have had the ShortCircuitOperator around for a while. I plan to extend this to make a ShortCircuitIfNotCurrentOperator. This will skip downstream for dag runs that are not current. https://issues.apache.org/jira/browse/AIRFLOW-198 FYI.. alternate names for this operator are welcome. -s

Re: ShortCircuitIfNotCurrentOperator

2016-08-17 Thread siddharth anand
arily complex. Instead, we have had the ShortCircuitOperator around > for a while. I plan to extend this to make a > ShortCircuitIfNotCurrentOperator. This will skip downstream for dag runs > that are not current. > > https://issues.apache.org/jira/browse/AIRFLOW-198 > > FYI.. alternate names for this operator are welcome. > -s >

Re: ShortCircuitIfNotCurrentOperator

2016-08-17 Thread Felix Cheung
mailto:san...@apache.org>> Sent: Wednesday, August 17, 2016 5:39 PM Subject: Re: ShortCircuitIfNotCurrentOperator To: mailto:dev@airflow.incubator.apache.org>> Hmn... none that I know of, but it seems pretty useful for us! On Wed, Aug 17, 2016 at 4:43 PM, Felix Cheung mailt

Re: ShortCircuitIfNotCurrentOperator

2016-08-17 Thread siddharth anand
> html#a6.3._Synchronous_Coordinator_Application_Definition > > > _ > From: siddharth anand mailto:san...@apache.org>> > Sent: Wednesday, August 17, 2016 5:39 PM > Subject: Re: ShortCircuitIfNotCurrentOperator > To: mailto:dev@airflow. > incubator.apache.o

Re: ShortCircuitIfNotCurrentOperator

2016-08-17 Thread Felix Cheung
In fact, NONE in Oozie is also very useful - it means just skip it if missed (expect the next coming up to catch up) _ From: Felix Cheung mailto:felixcheun...@hotmail.com>> Sent: Wednesday, August 17, 2016 5:55 PM Subject: Re: ShortCircuitIfNotCurrentOpera