[ 
https://issues.apache.org/jira/browse/AIRFLOW-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

raman reassigned AIRFLOW-3516:
------------------------------

    Assignee: raman

> Improve K8 Executors Pod creation Rate
> --------------------------------------
>
>                 Key: AIRFLOW-3516
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3516
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: executor, kubernetes, scheduler
>    Affects Versions: 1.10.1
>            Reporter: raman
>            Assignee: raman
>            Priority: Major
>
> It seems that Airflow scheduler is creating worker pod sequentially(one pod 
> per scheduler loop) in Kubernetes executors sync function which is called 
> from base executors.heartbeat() function.
> One enhancement could be to create the k8 pod in batches where batch size can 
> be configured through airflow.cfg file



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to