fbertos opened a new issue, #39781:
URL: https://github.com/apache/airflow/issues/39781
### Apache Airflow version
2.9.1
### If "Other Airflow 2 version" selected, which one?
_No response_
### What happened?
Hi,
We are using Airflow 2.9.1 with PostgreSQL 15.7.0 on Azure Kubernetes
Service.
Looks like this behaviour is not affecting the normal operation of the
system but we are receiving hundreds of error messages like this:
2024-05-23 09:44:06.574 GMT [221572] ERROR: could not obtain lock on row in
relation "dag_run"
2024-05-23 09:44:06.574 GMT [221572] STATEMENT: SELECT dag_run.state AS
dag_run_state, dag_run.id AS dag_run_id, dag_run.dag_id AS dag_run_dag_id,
dag_run.queued_at AS dag_run_queued_at, dag_run.execution_date AS
dag_run_execution_date, dag_run.start_date AS dag_run_start_date,
dag_run.end_date AS dag_run_end_date, dag_run.run_id AS dag_run_run_id,
dag_run.creating_job_id AS dag_run_creating_job_id, dag_run.external_trigger AS
dag_run_external_trigger, dag_run.run_type AS dag_run_run_type, dag_run.conf AS
dag_run_conf, dag_run.data_interval_start AS dag_run_data_interval_start,
dag_run.data_interval_end AS dag_run_data_interval_end,
dag_run.last_scheduling_decision AS dag_run_last_scheduling_decision,
dag_run.dag_hash AS dag_run_dag_hash, dag_run.log_template_id AS
dag_run_log_template_id, dag_run.updated_at AS dag_run_updated_at,
dag_run.clear_number AS dag_run_clear_number
FROM dag_run
WHERE dag_run.dag_id = '***' AND dag_run.run_id = '****' FOR UPDATE
NOWAIT
This seems to be happening when scheduler replicas are more than 1.
### What you think should happen instead?
Not receiving this type of errors.
### How to reproduce
Using PostgresSQL 15.7.0
Just increase scheduler replicas up to more than 1
Run several dag_runs of the same DAG in parallel.
Watch postgres server logs.
### Operating System
Ubuntu 20.04.5
### Versions of Apache Airflow Providers
apache-airflow-providers-microsoft-mssql==3.6.1
apache-airflow-providers-snowflake==5.4.0
apache-airflow-providers-microsoft-azure==10.0.0
apache-airflow-providers-http==4.10.1
apache-airflow-providers-cncf-kubernetes==8.1.1
apache-airflow-providers-common-sql==1.12.0
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
_No response_
### Anything else?
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]