Re: New Scheduler process seems incompatible with sqlite...

That sounds possible. Can you set min_file_process_interval = 0? My airflow config looks as shown below. [scheduler] # Task instances listen for external kill signal (when you clear tasks # from the CLI or the UI), this defines the frequency at which they should # listen (in seconds).

New Scheduler process seems incompatible with sqlite...

When testing the scheduler locally, on master, using sqlite and sequential executor, dag.sync_to_db never returns when querying the db... orm_dag = session.query( > DagModel).filter(DagModel.dag_id == dag.dag_id).first() Any insights? My guess is that this is due to the new multi-process nature

Tracking metrics in a task

Hello! Airflow does a great job of tracking metrics at the task level and I am wondering if there is any support for tracking metrics within a task. Say I have a task which downloads data, processes it, then stores it. Are there any Airflow features which allow me to track how long these subtasks

Apache Airflow October2016 Podling Report

Fellow Airflowers, Apache Airflow is now required to provide podling status updates every 3 months. https://wiki.apache.org/incubator/October2016 Please review the status available at the link above and provide any feedback that you think should be included in the report. The report is due (EOD

Re: Call to Committers : PR Clean up Duty : ETA Nov 15

I've added my 10 to https://cwiki.apache.org/confluence/display/AIRFLOW/ Whittling+down+PR+List Li Xuanji, Sumit, Dan, Arthur, Max, Bolke, Chris, Jeremiah et al please add yours to the list. On Sun, Oct 2, 2016 at 9:57 AM, siddharth anand wrote: > Hi Folks, > We have in

Fwd: Podling Report Reminder - October 2016

I have content ready to add to the Oct podling report. In the 3 months since I last did this, I forgot how to edit this page. -s -- Forwarded message -- From: Date: Mon, Oct 3, 2016 at 7:47 PM Subject: Podling Report Reminder - October 2016 To: