jason810496 opened a new pull request, #72097: URL: https://github.com/apache/airflow/pull/72097
- related: #70812, #66100 - failing run: https://github.com/apache/airflow/actions/runs/32948512400 ## Why Dispatching **Publish Docs to S3** with `include-docs=ts-sdk` fails: `ts-sdk` is passed to the registry as a provider ID, extraction exits 1 with `provider(s) not found in provider.yaml files: ['ts-sdk']`, and that blocks the publish. `java-sdk` has the same latent bug. ## How The non-provider token list is hand-copied in three places, and two were missing both SDK tokens: - `.github/workflows/publish-docs-to-s3.yml` (bash array), stale - `dev/registry/derive_wave_providers.py` (`NON_PROVIDER_TOKENS`), stale - `dev/breeze/src/airflow_breeze/utils/publish_docs_to_s3.py` (`NON_SHORT_NAME_PACKAGES`), in sync but unpinned The duplication is deliberate (the bash copy lets release tags predating #66100 still publish), so rather than removing it, tests pin all three to breeze's `REGULAR_DOC_PACKAGES`: ``` NON_PROVIDER_TOKENS == set(REGULAR_DOC_PACKAGES) - META_TOKENS ``` Anchoring to `REGULAR_DOC_PACKAGES` is the point: #70812 added `ts-sdk` there and to the workflow but never touched `dev/registry/`, so only this direction catches that drift. `registry-tests.yml` also only triggered on `dev/registry/**`, so such a PR ran no check at all. ## What - Add `java-sdk` and `ts-sdk` to both stale copies. - Add three drift guards in `dev/registry/tests/test_derive_wave_providers.py`, one per copy. They raise rather than silently pass if their pattern stops matching, and the AST helper rejects non-literal elements, which would otherwise shrink both sides of the comparison in step and pass vacuously. - Add `test_derive` cases `ts-sdk`, `java-sdk ts-sdk task-sdk`, and `ts-sdk amazon` (a real provider alongside an SDK token must still rebuild). - Widen `registry-tests.yml` `pull_request` paths to cover `publish-docs-to-s3.yml` and `global_constants.py`. --- ##### Was generative AI tooling used to co-author this PR? - [x] Yes, with help of Claude Code Opus 5 following [the guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
