XD-DENG opened a new pull request, #77188: URL: https://github.com/apache/airflow/pull/77188
Adds `apache-airflow-providers-apache-polaris`, a new community provider for [Apache Polaris](https://polaris.apache.org/), the open-source catalog for Apache Iceberg. The provider includes: - A `polaris` connection type. It supports Polaris's internal OAuth tokens, an external OIDC identity provider, or a static bearer token, and it masks every token it fetches. - `PolarisManagementHook` and `PolarisCatalogHook` for the Polaris Management and catalog APIs. They can also hand catalog properties to pyiceberg (optional `iceberg` extra) or to Spark and other engines. - Idempotent operators (`if_exists` / `if_missing`) for catalogs, namespaces, tables, principals, principal and catalog roles, grants, and policies. - A helper that turns Polaris table-maintenance policies into Iceberg Spark procedure calls. - How-to docs for every operator, plus example Dags as system tests. - A Breeze integration (`breeze --integration polaris`, Polaris 1.9.0) with integration tests. Requirements: Airflow >= 3.1.1, Python >= 3.11, `apache-polaris>=1.9.0`. The provider starts in the incubation lifecycle stage. Notes for reviewers: - `apache-polaris` 1.9.0, the first SDK release the provider can use, was published on 2026-11-16, inside uv's 4-day `exclude-newer` window. `pyproject.toml` carries a temporary `exclude-newer-package` entry for it, to be removed after 2026-11-21. - Polaris 1.8 and 1.9 answer 409 when one namespace-properties request both sets and removes keys, so the hook sends updates and removals as separate requests. - This PR stays a draft while the `[DISCUSS]` thread for the new provider runs on the dev list. Checks run locally: - `prek run --from-ref main --stage pre-commit` passes. `check-provider-yaml-valid` was skipped because it needs the Breeze CI image. - Provider unit tests: 376 passed. - mypy on the provider's source and tests: no issues. - Integration tests against Polaris 1.9.0: 18 passed. The 3 example Dags (system tests) passed against the same server. - Breeze tests for selective checks and test types: passed. - Not run locally: the docs build with spellcheck, and the Breeze-image checks. --- ##### Was generative AI tooling used to co-author this PR? - [X] Yes — Claude Code (Opus 5.5) Generated-by: Claude Code (Opus 5.5) following [the guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions) --- 🤖 Generated with [Claude Code](https://claude.com/claude-code) https://claude.ai/code/session_01KCYvgMVjToFjwMVF4nrawu -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
