lukas-at-harren commented on issue #13542: URL: https://github.com/apache/airflow/issues/13542#issuecomment-824575868
I can observe the same problem with version 2.0.2: * Tasks fail, because a DAG/task has gone missing (we are using dynamically created DAGs, and they can go missing) * The scheduler keeps those queued * The pool gradually fills up with these queued tasks * The whole operation stops, because of this behaviour My current remedy: * Manually remove those queued tasks My desired solution: When a DAG/task goes missing while it is queued, it should end up in a failed state. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
