deepak4babu opened a new issue, #35524:
URL: https://github.com/apache/airflow/issues/35524

   ### Apache Airflow version
   
   Other Airflow 2 version (please specify below)
   
   ### What happened
   
   Airflow version: 2.6.2, 2.7.1
   Postgresql Version: 13.11
   
   In our airflow setup, tasks are getting stuck in running state after this 
log line.
   
   
![image](https://github.com/apache/airflow/assets/40018681/f26cbe78-08ac-4267-978f-a7856e6641f4)
   
   On further checking, we found that the "select 1" query from airflow is 
getting stuck in idle in transaction state. Once we kill the query manually, 
the task completes.
   
![image](https://github.com/apache/airflow/assets/40018681/94a8d5f5-e4c9-488a-9e54-e4c37e7e62a7)
   
   
   Below is our airflow configuration
   
   AIRFLOW_USER_HOME_DIR=/home/airflow
   
AIRFLOW__API__AUTH_BACKENDS=airflow.api.auth.backend.basic_auth,airflow.api.auth.backend.session
   AIRFLOW__CELERY__BROKER_URL=amqp://********
   AIRFLOW__CELERY__RESULT_BACKEND=db+postgresql://***********
   AIRFLOW__CORE__DAGS_ARE_PAUSED_AT_CREATION=False
   AIRFLOW__CORE__DAGS_FOLDER=/opt/airflow/dags/
   AIRFLOW__CORE__DAG_IGNORE_FILE_SYNTAX=glob
   AIRFLOW__CORE__EXECUTOR=CeleryExecutor
   AIRFLOW__CORE__LOAD_EXAMPLES=False
   AIRFLOW__CORE__MAX_ACTIVE_RUNS_PER_DAG=1
   AIRFLOW__CORE__MAX_ACTIVE_TASKS_PER_DAG=1024
   AIRFLOW__CORE__MIN_SERIALIZED_DAG_FETCH_INTERVAL=10
   AIRFLOW__CORE__MIN_SERIALIZED_DAG_UPDATE_INTERVAL=10
   AIRFLOW__DATABASE__LOAD_DEFAULT_CONNECTIONS=False
   AIRFLOW__DATABASE__SQL_ALCHEMY_CONN=postgresql+psycopg2://*******
   AIRFLOW__DATABASE__SQL_ALCHEMY_POOL_PRE_PING=True
   AIRFLOW__LOGGING__BASE_LOG_FOLDER=/opt/airflow/logs
   AIRFLOW__LOGGING__LOGGING_LEVEL=INFO
   AIRFLOW__LOGGING__WORKER_LOG_SERVER_PORT=8793
   AIRFLOW__METRICS__STATSD_HOST=***********
   AIRFLOW__METRICS__STATSD_ON=True
   AIRFLOW__METRICS__STATSD_PORT=9125
   AIRFLOW__METRICS__STATSD_PREFIX=airflow
   AIRFLOW__SCHEDULER__DAG_DIR_LIST_INTERVAL=2592000
   AIRFLOW__SCHEDULER__ENABLE_HEALTH_CHECK=True
   AIRFLOW__SCHEDULER__MIN_FILE_PROCESS_INTERVAL=2592000
   AIRFLOW__SCHEDULER__TASK_QUEUED_TIMEOUT=1800
   AIRFLOW__SCHEDULER__TASK_QUEUED_TIMEOUT_CHECK_INTERVAL=600
   AIRFLOW__WEBSERVER__BASE_URL=http://localhost:8080
   AIRFLOW__WEBSERVER__SECRET_KEY=********
   AIRFLOW__WEBSERVER__SHOW_TRIGGER_FORM_IF_NO_PARAMS=True
   AIRFLOW__WEBSERVER__WEB_SERVER_PORT=8082
   
   
   ### What you think should happen instead
   
   Task should complete without any stuck queries
   
   ### How to reproduce
   
   It happens randomly, we cannot reproduce it.
   
   ### Operating System
   
   NAME="Debian GNU/Linux" VERSION_ID="11" VERSION="11 (bullseye)" 
VERSION_CODENAME=bullseye ID=debian
   
   ### Versions of Apache Airflow Providers
   
   apache-airflow-providers-celery==3.3.3
   apache-airflow-providers-common-sql==1.7.1
   apache-airflow-providers-ftp==3.5.1
   apache-airflow-providers-http==4.5.1
   apache-airflow-providers-imap==3.3.1
   apache-airflow-providers-sqlite==3.4.3
   
   ### Deployment
   
   Other
   
   ### Deployment details
   
   We have modified version of the official helm chart and airflow image to add 
some custom things. The core helm templates are all same.
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to