[ https://issues.apache.org/jira/browse/AIRFLOW-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
raman updated AIRFLOW-3516: --------------------------- Component/s: (was: scheduler) > Improve K8 Executors Pod creation Rate > -------------------------------------- > > Key: AIRFLOW-3516 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3516 > Project: Apache Airflow > Issue Type: Improvement > Components: executor, kubernetes > Affects Versions: 1.10.1 > Reporter: raman > Assignee: raman > Priority: Major > > It seems that Airflow scheduler is creating worker pod sequentially(one pod > per scheduler loop) in Kubernetes executors sync function which is called > from base executors.heartbeat() function. > One enhancement could be to create the k8 pod in batches where batch size can > be configured through airflow.cfg file -- This message was sent by Atlassian JIRA (v7.6.3#76005)