Mathew Wicks created AIRFLOW-6827:
-------------------------------------
Summary: PROPOSAL: Implement a run_pool concept for DagRuns
Key: AIRFLOW-6827
URL: https://issues.apache.org/jira/browse/AIRFLOW-6827
Project: Apache Airflow
Issue Type: New Feature
Components: DagRun, scheduler
Affects Versions: 1.10.9
Reporter: Mathew Wicks
Currently we have a concept of resource pools for tasks, where there can be at
most N instances of a task running at once. However, no such concept exists for
DagRuns.
For example, you might have a requirement that two DAGs (with different dag_id)
cannot run at the same time, so you might define a run_pool for these DAGs with
size 1. Meaning only 1 DagRun may be in the RUNNING state at a time.
I am interested in hearing everyone's thoughts.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
