raman created AIRFLOW-3916:
------------------------------
Summary: Remove Metastore dependency for K8 Worker pod heartbeat
Key: AIRFLOW-3916
URL: https://issues.apache.org/jira/browse/AIRFLOW-3916
Project: Apache Airflow
Issue Type: Improvement
Components: executor, kubernetes, worker
Affects Versions: 1.10.2, 1.10.1
Reporter: raman
Currently K8 Worker pod uses Metastore for continuous heartbeat which might
make metastore a bottleneck for 1000(s) of running Pods.
Airflow with K8 Executor mode uses KubernetesJobWatcher to track the status for
submitted worker pod(s). It can be leveraged to remove the worker pod's
dependency on Meta store for heartbeating.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
