The GitHub Actions job "Tests (AMD)" on airflow.git/k8s-executor-async-pod-creation has failed. Run started by GitHub user 1fanwang (triggered by 1fanwang).
Head commit for run: d17fb0e627ebf61b2dd5554b9f9821564e6818a0 / 1fanwang <[email protected]> Add opt-in concurrent pod creation to KubernetesExecutor The KubernetesExecutor creates worker pods one at a time within each scheduler loop: run_next() issues a synchronous create_namespaced_pod and blocks on the API response before starting the next. When per-create latency is high (API round-trip, mutating admission webhooks), this serializes the scheduler loop and caps pod-creation throughput per loop. Add an opt-in concurrent path: when [kubernetes_executor] async_pod_creation is True, the pods dequeued in a loop are built synchronously (pod-mutation hook and reconciliation unchanged), then their create calls are issued concurrently via the asynchronous Kubernetes client, bounded by pod_creation_max_concurrency. The sequential path stays the default and is unchanged. A new pod_creation_batch_duration metric (emitted by both paths) measures per-loop batch creation time. Report URL: https://github.com/apache/airflow/actions/runs/27459889068 With regards, GitHub Actions via GitBox --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
