mukul-jain12 opened a new issue, #51512:
URL: https://github.com/apache/airflow/issues/51512
### Apache Airflow version
Other Airflow 2 version (please specify below)
### If "Other Airflow 2 version" selected, which one?
Airflow 3.0.0
### What happened?
**Environment:**
Airflow Version: 3.0.0
Executor: LocalExecutor
Database Backend: MySQL
Python Version: 3.12
OS: Ubuntu 22.04
Deployment Method: VM
**Summary:**
1. After upgrading to Airflow 3.0.0, a specific task inside multiple
DAGs starts failing every 2–3 days.
2. DAG runs successfully, but the same task fails with the same error
repeatedly.
3. Restarting Airflow services temporarily resolves the task failure.
4. No code change, no DAG change, no environment change between working
and failing runs.
**🧾 Error Message:**
The error occurs for the entire DAG as well as for a specific task, as shown
in the image below. While the DAG appears to execute successfully, the task
fails with the same recurring error. PFA screenshots and error messages below:
`Log message source details: sources=["Could not read served logs: Invalid
URL
'http://:8793/log/dag_id=BataApac_Fraud_Service/run_id=scheduled__2025-06-08T05:20:00+00:00/task_id=fraud_service/attempt=1.log':
No host supplied"] ::group::Log message source details: sources=["Could not
read served logs: Invalid URL
'http://:8793/log/dag_id=BataApac_Fraud_Service/run_id=scheduled__2[0](http://20.105.2.4:8081/dags/BataApac_Fraud_Service/runs/scheduled__2025-06-08T05:20:00+00:00/tasks/fraud_service?try_number=1#0)25-06-08T05:20:00+00:00/task_id=fraud_service/attempt=1.log':
No host supplied"]`
<img width="615" alt="Image"
src="https://github.com/user-attachments/assets/564daf6f-53a6-4ee6-bb05-9e47716d39b5";
/>
<img width="552" alt="Image"
src="https://github.com/user-attachments/assets/8a43b1e6-bc87-4e7c-a4ae-07208f092c0c";
/>
**📌 Temporary Workaround**
1. Restarting the Airflow services manually resolves the issue temporarily.
2. After restart, DAGs resume normal execution without changes.
🔧 Suggestions Needed
1. Any known issue related to DAG failure loop in 3.0.0?
2. Recommended fix or workaround?
3. Should we downgrade or patch?
### What you think should happen instead?
_No response_
### How to reproduce
I’m currently unable to provide a specific reproducible case, as the issue
occurs intermittently. However, here’s the behavior I’ve observed:
After upgrading to Airflow 3.0.0, everything works fine for 2–3 days.
Suddenly, some DAGs or specific tasks fail with log URL issues (No host
supplied or invalid log path).
The DAG run may complete, but a few tasks still fail and show no logs due to
malformed log URLs (e.g., http://:8793/...).
Restarting the Airflow services resolves the issue temporarily, and all DAGs
and tasks resume normal execution.
This seems to be related to Airflow’s logging system or task instance state
management. Let me know if there’s a way I can collect more debug logs or
configuration snapshots to help troubleshoot.
### Operating System
ubuntu 22.04
### Versions of Apache Airflow Providers
Providers info
apache-airflow-providers-airbyte | 5.0.2
apache-airflow-providers-alibaba | 3.0.3
apache-airflow-providers-amazon | 9.6.1
apache-airflow-providers-apache-beam | 6.0.4
apache-airflow-providers-apache-cassandra | 3.7.2
apache-airflow-providers-apache-drill | 3.0.1
apache-airflow-providers-apache-druid | 4.1.1
apache-airflow-providers-apache-flink | 1.6.2
apache-airflow-providers-apache-hdfs | 4.8.1
apache-airflow-providers-apache-hive | 9.0.6
apache-airflow-providers-apache-iceberg | 1.2.1
apache-airflow-providers-apache-impala | 1.6.1
apache-airflow-providers-apache-kafka | 1.8.1
apache-airflow-providers-apache-kylin | 3.8.3
apache-airflow-providers-apache-livy | 4.3.2
apache-airflow-providers-apache-pig | 4.6.1
apache-airflow-providers-apache-pinot | 4.7.0
apache-airflow-providers-apache-spark | 5.2.1
apache-airflow-providers-apprise | 2.0.2
apache-airflow-providers-arangodb | 2.7.4
apache-airflow-providers-asana | 2.9.1
apache-airflow-providers-atlassian-jira | 3.0.2
apache-airflow-providers-celery | 3.10.6
apache-airflow-providers-cloudant | 4.1.1
apache-airflow-providers-cncf-kubernetes | 10.4.3
apache-airflow-providers-cohere | 1.4.3
apache-airflow-providers-common-compat | 1.6.0
apache-airflow-providers-common-io | 1.5.4
apache-airflow-providers-common-messaging | 1.0.0
apache-airflow-providers-common-sql | 1.26.0
apache-airflow-providers-databricks | 7.3.2
apache-airflow-providers-datadog | 3.8.3
apache-airflow-providers-dbt-cloud | 4.3.3
apache-airflow-providers-dingding | 3.7.3
apache-airflow-providers-discord | 3.9.5
apache-airflow-providers-docker | 4.3.1
apache-airflow-providers-edge3 | 1.0.0
apache-airflow-providers-elasticsearch | 6.2.2
apache-airflow-providers-exasol | 4.7.5
apache-airflow-providers-fab | 2.0.1
apache-airflow-providers-facebook | 3.7.2
apache-airflow-providers-ftp | 3.12.3
apache-airflow-providers-git | 0.0.2
apache-airflow-providers-github | 2.8.3
apache-airflow-providers-google | 15.1.0
apache-airflow-providers-grpc | 3.7.3
apache-airflow-providers-hashicorp | 4.1.1
apache-airflow-providers-http | 5.2.2
apache-airflow-providers-imap | 3.8.3
apache-airflow-providers-influxdb | 2.8.3
apache-airflow-providers-jdbc | 5.1.0
apache-airflow-providers-jenkins | 4.0.4
apache-airflow-providers-microsoft-azure | 12.3.1
apache-airflow-providers-microsoft-mssql | 4.2.2
apache-airflow-providers-microsoft-psrp | 3.0.1
apache-airflow-providers-microsoft-winrm | 3.9.2
apache-airflow-providers-mongo | 5.0.3
apache-airflow-providers-mysql | 4.0.2
apache-airflow-providers-neo4j | 3.8.2
apache-airflow-providers-odbc | 4.9.2
apache-airflow-providers-openai | 1.5.4
apache-airflow-providers-openfaas | 3.7.2
apache-airflow-providers-openlineage | 2.2.0
apache-airflow-providers-opensearch | 1.6.3
apache-airflow-providers-opsgenie | 5.8.3
apache-airflow-providers-oracle | 4.0.3
apache-airflow-providers-pagerduty | 4.0.3
apache-airflow-providers-papermill | 3.10.1
apache-airflow-providers-pgvector | 1.4.1
apache-airflow-providers-pinecone | 2.2.2
apache-airflow-providers-postgres | 6.1.3
apache-airflow-providers-presto | 5.8.4
apache-airflow-providers-qdrant | 1.3.2
apache-airflow-providers-redis | 4.0.2
apache-airflow-providers-salesforce | 5.10.1
apache-airflow-providers-samba | 4.9.2
apache-airflow-providers-segment | 3.7.2
apache-airflow-providers-sftp | 5.2.1
apache-airflow-providers-singularity | 3.7.1
apache-airflow-providers-slack | 9.0.5
apache-airflow-providers-smtp | 2.0.3
apache-airflow-providers-snowflake | 6.2.2
apache-airflow-providers-sqlite | 4.0.2
apache-airflow-providers-ssh | 4.0.1
apache-airflow-providers-standard | 1.0.0
apache-airflow-providers-tableau | 5.0.2
apache-airflow-providers-telegram | 4.7.2
apache-airflow-providers-teradata | 3.0.3
apache-airflow-providers-trino | 6.1.2
apache-airflow-providers-vertica | 4.0.1
apache-airflow-providers-weaviate | 3.0.3
apache-airflow-providers-yandex | 4.0.3
apache-airflow-providers-ydb | 2.1.1
apache-airflow-providers-zendesk | 4.9.1
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
Airflow Version: 3.0.0
Executor: LocalExecutor
Database Backend: MySQL v8
Python Version: 3.12
OS: Ubuntu 22.04
Deployment Method: VM
### Anything else?
1. No changes are made in DAGs or dependencies in this period.
2. Happens on both new and existing DAGs.
3. Could potentially be memory/resource exhaustion or zombie DAG issue.
### Are you willing to submit PR?
- [x] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
