Re: Airflow Celery Executor and Postgres idle connection problem

2019-12-27 Thread Jarek Potiuk
You might have some code in your DAG to open and not close those connections. I think in normal circumstances there should be connection pools used and no connections should be left-over in idle state. Which version of Airflow are you using? Can you make a quick test and modify your DAGs to do noth

Airflow Celery Executor and Postgres idle connection problem

2019-12-26 Thread Mehmet Ersoy
Helle friends, I am using Airflow Celery Executor (with postgres backend) and when I start a dag workers are oppening so many connections and when they finish them work these connections are remaining "idle" status. Why doesn't they close the connection completely? Thanks, Best regards, Mehmet.