GitHub user Komalpawar22 edited a comment on the discussion: Airflow 2.10.4 is
significantly slower compared to 2.9.3
Thank you for your response. I understand the need for concrete data to make
this issue actionable. Below are the details of my setup and observations:
System Details
Airflow Version: Upgraded from 2.9.3 → 2.10.4
Executor: KubernetesExecutor
Database: MySQL
Python Version: 3.11
OS: Linux
Deployment Mode: Kubernetes Autopilot Cluster
Old version was taking 7-8 seconds to load the dag
And the latest version take 50-60 seconds or even more than a minute
```yaml
resources:
limits:
cpu: 100m
ephemeral-storage: 1000Mi
memory: 3Gi
requests:
cpu: 100m
ephemeral-storage: 1000Mi
memory: 3Gi
```
Using `5 replicas` of this configuration, I have deployed airflow with official
Helm chart 1.14.0
GitHub link:
https://github.com/apache/airflow/discussions/46552#discussioncomment-12094081
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
