Re: New Scheduler process seems incompatible with sqlite...

2016-10-04 Thread siddharth anand
That sounds possible. Can you set min_file_process_interval = 0? My airflow config looks as shown below. [scheduler] # Task instances listen for external kill signal (when you clear tasks # from the CLI or the UI), this defines the frequency at which they should # listen (in seconds). job_hear

New Scheduler process seems incompatible with sqlite...

2016-10-04 Thread Ben Tallman
When testing the scheduler locally, on master, using sqlite and sequential executor, dag.sync_to_db never returns when querying the db... orm_dag = session.query( > DagModel).filter(DagModel.dag_id == dag.dag_id).first() Any insights? My guess is that this is due to the new multi-process nature