GitHub user paj26 added a comment to the discussion: Scaling Airflow 3 on EKS — API server OOMs, PgBouncer saturation, and health check flakiness at 8K concurrent tasks
@gilt-cl thanks for the analysis and particularly the configs. Have you managed to get anywhere on this? Am particularly interested in the assertion that pgbouncer is no longer needed, am struggling with getting Postgres running on this. Also have split my api-server into core and execution, but that’s not my bottleneck. GitHub link: https://github.com/apache/airflow/discussions/62117#discussioncomment-16785894 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
