Re: Airflow 1.8.2 released

Woohoo! On Tue, Sep 5, 2017 at 11:12 AM, Dan Davydov wrote: > +1, this was a lot more work than anticipated. > > On Tue, Sep 5, 2017 at 10:10 AM Chris Riccomini > wrote: > > > Thanks so much for slogging through this! > > > > On Mon, Sep 4, 2017 at 10:26 AM, Sumit Maheshwari < > sumeet.ma...@gm

Re: Operators that poll vs Sensors

Thanks, that makes sense. For future reference: https://github.com/apache/incubator-airflow/blob/ff45d8f2218a8da9328161aa66d004c3db3b367e/airflow/operators/sensors.py#L71 On Tue, Sep 5, 2017 at 11:35 AM, Ash Berlin-Taylor < ash_airflowl...@firemirror.com> wrote: > The primary difference betwee

Re: Airflow 1.8.2 released

https://cwiki.apache.org/confluence/display/AIRFLOW/Announcements#Announcements-Sept6,2017 & https://twitter.com/ApacheAirflow/status/905496835380453376 -s On Wed, Sep 6, 2017 at 11:13 AM, Sid Anand wrote: > Woohoo! > > On Tue, Sep 5, 2017 at 11:12 AM, Dan Davydov invalid> wrote: > >> +1, this

Terminate task process through UI

Hello, Is there a way to trigger the on_kill() method of an operator through the UI? I tried changing the state of a running task and deleting it, but neither approach triggered the on_kill() method and so the process was still running. Similar question was asked on SO: https://stackoverflow.com/

Re: Airflow + Kubernetes update meeting

Hey guys! @Dan & @Chris: Great! @Marc: My pleasure :). So everything is all set for tomorrow at 10AM PST at zoom.us/my/sig.big.data. Main points will be to update on the what we've been working on and create a final roadmap for merging the PR. Looking forward to seeing everyone there! Daniel On

Airflow CeleryExecutor & SQS

Is anyone successfully using the CeleryExecutor with SQS? I'm having an issue where my workers can't/won't read from my queues and was curious if anyone has had a similar problem. Thanks, -Nik nik.hodgkin...@collectivehealth.com (913) 927-4891 -- [image: https://www.collectivehealth.com]