schizophrenicmaniac opened a new pull request, #77127: URL: https://github.com/apache/airflow/pull/77127
`WasbRemoteLogIO.read` listed blobs with `get_blobs_list`, which walks a single level with `delimiter="/"`. For a watcher's log directory on a triggerer, that listing returns `trigger.log` plus the `rotated/` prefix instead of the parts inside it. Reading `rotated/` then fails with BlobNotFound, which gets logged and added to the sources on every read, and the rotated parts (most of a busy watcher's history) never show up. When the requested path ends in `/`, `read` now lists with `get_blobs_list_recursive`, so nested blobs like `rotated/trigger.log.1` are listed and read directly. Task log reads don't end in `/`, so they still go through `get_blobs_list` and behave the same as before. Added tests for both cases: a directory read picks up and reads the rotated part with no read errors, and a file read still uses the one-level listing. closes: #77057 related: #76560 --- ##### Was generative AI tooling used to co-author this PR? - [ ] Yes (please specify the tool below) --- * Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#pull-request-guidelines)** for more information. Note: commit author/co-author name and email in commits become permanently public when merged. * For fundamental code changes, an Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvement+Proposals)) is needed. * When adding dependency, check compliance with the [ASF 3rd Party License Policy](https://www.apache.org/legal/resolved.html#category-x). * For significant user-facing changes create newsfragment: `{pr_number}.significant.rst`, in [airflow-core/newsfragments](https://github.com/apache/airflow/tree/main/airflow-core/newsfragments). You can add this file in a follow-up commit after the PR is created so you know the PR number. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
