The GitHub Actions job "Tests (AMD)" on airflow.git/fix-wasb-duplicate-logs has succeeded. Run started by GitHub user bmanan7 (triggered by bmanan7).
Head commit for run: 2e8e46f5291015949d5948e5fa08a2a01d46f6f5 / Manan Bhatt <[email protected]> Fix duplicated task logs in the WASB log handler Several task-execution lifecycles can write to one remote log key. With a reschedule-mode sensor, try_number does not change, so every poke uploads to the same attempt log. The local log file is opened in append mode and is never truncated after a successful upload, so a lifecycle that reuses the same local path re-sends the lines the blob already holds and the stored log grows quadratically. This depends on the local path being reused, which happens on a long-lived worker or a shared logs volume, and not when every lifecycle starts with a fresh one. The S3 handler had the same defect, reported as a worker OOM and fixed in #67144. Emptying the local file on a successful upload is intentionally the same approach, so the two handlers stay consistent. Report URL: https://github.com/apache/airflow/actions/runs/30651897842 With regards, GitHub Actions via GitBox --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
