GitHub user ahipp13 added a comment to the discussion: Remote Logging to Azure
Blob Storage Still Broke in Airflow 3.0.4
@potiuk cleaned up stack trace is below. I threw it on DEBUG too just to make
sure. If they need to be cleaner, let me know.
The rest of my configuration values are above. If anybody needs more info
please let me know and I can try to provide it. Thank you. Right now I unmarked
as answer as it sounds like some work can be done on this. If not let me know
and I can remark as answer.
```
{"event":"Unable to retrieve connection from secrets backend
(MetastoreBackend). Checking subsequent secrets
backend.","level":"debug","logger":"airflow.models.connection","timestamp":"2025-08-14T13:23:57.246032Z"}
{"event":"Exception when trying to check remote location: \"The conn_id
`edw_az_conn` isn't
defined\"","level":"debug","logger":"airflow.providers.microsoft.azure.log.wasb_task_handler.WasbRemoteLogIO","timestamp":"2025-08-14T13:23:57.247026Z"}
{"event":"Unable to retrieve connection from secrets backend
(MetastoreBackend). Checking subsequent secrets
backend.","level":"debug","logger":"airflow.models.connection","timestamp":"2025-08-14T13:23:57.247231Z"}
{"event":"Could not write logs to
wasb-airflow-logs/dag_id=DAN_NAME/run_id=scheduled__2025-08-14T03:00:00+00:00/task_id=process_namespaces_sand/attempt=1.log",
"level":"error","logger":"airflow.providers.microsoft.azure.log.wasb_task_handler.WasbRemoteLogIO","timestamp":"2025-08-14T13:23:57.247353Z","exception":
[{"exc_type":"AirflowNotFoundException","exc_value":"The conn_id `edw_az_conn`
isn't defined","exc_notes":[],"syntax_error":null,"is_cause":false,"frames":
[{"filename":"/opt/airflow/lib/python3.12/site-packages/airflow/providers/microsoft/azure/log/wasb_task_handler.py","lineno":170,"name":"write"},
{"filename":"/opt/airflow/lib/python3.12/site-packages/airflow/providers/microsoft/azure/hooks/wasb.py","lineno":368,"name":"load_string"},
{"filename":"/opt/airflow/lib/python3.12/site-packages/airflow/providers/microsoft/azure/hooks/wasb.py","lineno":425,"name":"upload"},
{"filename":"/opt/airflow/lib/python3.12/site-packages/airflow/providers/microsoft/azure/hooks/wasb.py","lineno":240,"name":"_get_blob_client"},
{"filename":"/usr/lib/python3.12/functools.py","lineno":998,"name":"__get__"},
{"filename":"/opt/airflow/lib/python3.12/site-packages/airflow/providers/microsoft/azure/hooks/wasb.py","lineno":160,"name":"blob_service_client"},
{"filename":"/opt/airflow/lib/python3.12/site-packages/airflow/providers/microsoft/azure/hooks/wasb.py","lineno":164,"name":"get_conn"},
{"filename":"/opt/airflow/lib/python3.12/site-packages/airflow/hooks/base.py","lineno":64,"name":"get_connection"},
{"filename":"/opt/airflow/lib/python3.12/site-packages/airflow/models/connection.py","lineno":512,"name":"get_connection_from_secrets"}],"is_group":false,"exceptions":[]}]}
```
GitHub link:
https://github.com/apache/airflow/discussions/54489#discussioncomment-14104274
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
