crabio opened a new issue, #36478: URL: https://github.com/apache/airflow/issues/36478
### Apache Airflow version 2.8.0 ### If "Other Airflow 2 version" selected, which one? 2.7.3 ### What happened? I found race condition between 2 schedulers. Scheduler 1 starts task pod task finished Scheduler 2 processes task finish and kill pod Scheduler 1 thinks that task is still running, but Scheduler 2 updates tasks status in the database. ### What you think should happen instead? Multiple schedulers should process properly concurrent work with Kubernetes Executor ### How to reproduce 1. Deploy Airflow via Community Helm chart with Kubernetes Executor 2. Add more than 50 tasks in 2-3 DAGs ### Operating System Docker based on apache/airflow:2.7.3 ### Versions of Apache Airflow Providers apache-airflow == 2.7.3 dbt-core == 1.6.6 dbt-snowflake == 1.6.4 apache-airflow-providers-snowflake apache-airflow[statsd] facebook-business == 16.0.2 google-ads == 21.1.0 twitter-ads == 11.0.0 acryl-datahub-airflow-plugin acryl-datahub[dbt] checksumdir filelock openpyxl cronsim apache-airflow-providers-cncf-kubernetes==7.8.0 apache-airflow-providers-apache-kafka == 1.2.0 kubernetes snowplow_analytics_sdk ### Deployment Other 3rd-party Helm chart ### Deployment details _No response_ ### Anything else? logs: [Untitled discover search.csv](https://github.com/apache/airflow/files/13318290/Untitled.discover.search.csv) ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
