The GitHub Actions job "Tests" on airflow.git/TestGCSTimeSpanFileTransformOperator-Parallel-UL-DL has succeeded. Run started by GitHub user SameerMesiah97 (triggered by SameerMesiah97).
Head commit for run: a59d466ae17d1817110c52d98946a84a876dc57c / Sameer Mesiah <[email protected]> Add parallel download and upload support to `GCSTimeSpanFileTransformOperator` by introducing `max_download_workers` and `max_upload_workers` (defaulting to 1) and executing both phases via `ThreadPoolExecutor` when configured. The implementation reuses a single `storage.Client` per phase, filters out directory placeholder objects before download, and preserves existing error propagation and `*_continue_on_fail` semantics. Unit tests have been updated and extended to cover worker validation, parallel execution paths, and failure handling. The existing `gcs_transform_timespan` system test DAG has also been extended with a parallel execution case to validate the behavior against real GCS. Report URL: https://github.com/apache/airflow/actions/runs/23026437617 With regards, GitHub Actions via GitBox --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
