The GitHub Actions job "Tests" on airflow.git/parallelise-pypi-fetches has failed. Run started by GitHub user kaxil (triggered by kaxil).
Head commit for run: df600b06a51c5e403e782cd34c7785e40d3e1ab4 / Kaxil Naik <[email protected]> Parallelise PyPI fetches in extract_metadata.py Each registry build did ~2N sequential `urllib.request.urlopen` calls to pypistats.org and pypi.org -- one per provider per endpoint, with 5-10s timeouts each. With ~86 providers that's ~172 serialised HTTP calls, which dominated wall-clock and turned any pypistats slowdown into a multi-minute build delay (and occasionally raced the 30-minute job timeout). It also amplified the impact of issue #1309: a single flaky response zeroes that provider's downloads, but the build still serialised on the next call. This batches the calls through `concurrent.futures.ThreadPoolExecutor` with `max_workers=16`, mirroring the pattern already used in `extract_parameters.py` and `extract_versions.py`. Per-package failures remain isolated because the worker functions already return zero-value defaults on error -- one bad response cannot poison the dict for any other package. Tests cover three shapes: round-trip correctness across multiple packages, empty-input no-op, and per-package failure isolation. Report URL: https://github.com/apache/airflow/actions/runs/25191627167 With regards, GitHub Actions via GitBox --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
