[ https://issues.apache.org/jira/browse/AIRFLOW-6175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Imberman updated AIRFLOW-6175: ------------------------------------- Fix Version/s: 1.10.6 > Executor changes queued tasks to scheduled without removing from task queue > --------------------------------------------------------------------------- > > Key: AIRFLOW-6175 > URL: https://issues.apache.org/jira/browse/AIRFLOW-6175 > Project: Apache Airflow > Issue Type: Bug > Components: scheduler > Affects Versions: 1.10.6 > Reporter: Daniel Imberman > Priority: Blocker > Fix For: 1.10.6 > > > There is a bug caused by scheduler_jobs refactor which leads to task failure > and scheduler locking. > Essentially when a there is an overflow of tasks going into the scheduler, > the tasks are set back to scheduled, but are not removed from the executor's > queued_tasks queue. > This means that the executor will attempt to run tasks that are in the > scheduled state, but those tasks will fail dependency checks. Eventually the > queue is filled with scheduled tasks, and the scheduler can no longer run. -- This message was sent by Atlassian Jira (v8.3.4#803005)