Re: Airflow meetup in India

2019-08-18 Thread ramandumcs
We are from Noida but would be open to participate in Bangalore's meetup. Thanks, Raman Gupta On 2019/08/18 04:40:27, Sumit Maheshwari wrote: > We are in Bangalore. And most of the folks who showed interest are also > from Bangalore. > > On Sun, Aug 18, 2019 at 12:16 AM Kaxil Naik wrote: > >

Re: Removal of "run_duration" and its impact on orphaned tasks

2019-08-18 Thread Bolke de Bruin
James Could you log this with debug on for SchedulerJob? There is only one place where the number of tasks can go lower and thats when the executor reports having the task. That's logged at debug level. Are you collecting metrics from Airflow? If so I can create a small patch that will track tasks

Re: Outage report

2019-08-18 Thread Kamil BreguĊ‚a
Hi This problem also exists in GCP operators. I have noticed this problem long time ago and I will want to solve it https://issues.apache.org/jira/browse/AIRFLOW-4771 This problem limits the use of AIrflow in the multitenant environment, because the scheduler connects to the connection table. Gre