[ 
https://issues.apache.org/jira/browse/AIRFLOW-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16873141#comment-16873141
 ] 

ASF subversion and git services commented on AIRFLOW-4591:
----------------------------------------------------------

Commit 003050a1a56b5ef5fcb82c359d1366624e5e7690 in airflow's branch 
refs/heads/v1-10-test from Chao-Han Tsai
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=003050a ]

[AIRFLOW-4591] Make default_pool a real pool (#5349)

`non_pooled_task_slot_count` and `non_pooled_backfill_task_slot_count`
are removed in favor of a real pool, e.g. `default_pool`.

By default tasks are running in `default_pool`.
`default_pool` is initialized with 128 slots and user can change the
number of slots through UI/CLI. `default_pool` cannot be removed.

(cherry picked from commit 2c99ec624bd66e9fa38e9f0087d46ef4d7f05aec)


> Tag tasks with default pool
> ---------------------------
>
>                 Key: AIRFLOW-4591
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-4591
>             Project: Apache Airflow
>          Issue Type: New Feature
>          Components: core
>    Affects Versions: 2.0.0
>            Reporter: Chao-Han Tsai
>            Assignee: Chao-Han Tsai
>            Priority: Major
>             Fix For: 2.0.0
>
>
> Currently the number of running tasks without a pool specified will be 
> limited by `non_pooled_task_slot_count`. It limits the number of tasks 
> launched per scheduler loop but does not limit the number of tasks running in 
> parallel.
> This ticket proposes that we assign tasks without a pool specified to default 
> pool which limits the number of running tasks in parallel.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to