This is an automated email from the ASF dual-hosted git repository.
dabla pushed a change to branch dabla/agent-async/01-task-agent-aexecute
in repository https://gitbox.apache.org/repos/asf/airflow.git
from 5669cfddcf2 Run the async agent's blocking supervisor calls on the
provider's own worker
add 2617656daf5 Explain which Gradle to use when verifying a Java SDK
release (#77004)
add 2bf98e865e4 Fix wrong claims and a broken link in providers release
docs (#76993)
add e227cf56078 Show the same Dag in each language SDK in tabs (#77002)
add 162f629a01e Fix task state lookup for mapped tasks in Google triggers
(#76895)
add e74e2584cab Let MSGraphAsyncOperator and MSGraphSensor start from the
triggerer (#53009)
add d31dfb83a9c Fix runner labels for the Language SDK XCom object storage
e2e tests (#76994)
add f38e935ff34 Stop loading the CI image and cloning airflow-site to
publish docs (#75937)
add ea7677ed172 Fix an issue with getting dataflow_job_id for Dataflow
Runner when logging is disabled in Pipeline (#72809)
add baac5581c6c Stop creating AWS clients when importing the docs
publisher (#76658)
add f8c7ead5b4a Task SDK: send error response on IPC decode failure
(#76555)
add a81cfb7ac98 Fix failing __doc__ usage in case of PYTHONOPTIMIZE=2
(#77013)
add c26585893f0 Bump openlineage libraries to 1.55 in openlineage provider
(#77031)
add ef71095a5b0 Remove rawwar from API code owners (#77048)
add f2fc5fc95ef Bump the oxc group across 1 directory with 2 updates
(#77034)
add cd58133d136 Bump vite from 8.3.6 to 8.3.7 in
/dev/react-plugin-tools/react_plugin_template (#77035)
add 0536891ff3d Bump the auth-ui-package-updates group across 1 directory
with 3 updates (#77036)
add 7b6c0f3e2c3 Bump the ts-sdk-package-updates group across 1 directory
with 3 updates (#77038)
add 260ddd00026 Bump the edge-ui-package-updates group across 1 directory
with 6 updates (#77039)
add de88871105e Fill gaps in the Java SDK post-vote release steps (#77018)
add 7ba7e7ad6f0 Keep Breeze shim warning tests independent of the terminal
width (#76587)
add 4b78d37e164 Bump the core-ui-package-updates group across 1 directory
with 6 updates (#77045)
add e30b8ff691c Clean up runner disk space before building PROD image
(#77072)
add e499f1cac25 Keep .asf.yaml in sync and auto-undraft green pilot pull
requests (#76866)
add f7361c24b86 Protect main with the branch ruleset instead of legacy
protection (#77075)
add 425dee518ff Restructure Docker image docs around small production
images (#76792)
add 8b7a10621d4 Bump the fab-ui-package-updates group across 1 directory
with 5 updates (#76764)
add 11f515a4b7a Keep contributor testing comments short on providers
testing issues (#76772)
add e161af12209 Stop shipping metadata DB credentials to task-executing
components (#72206)
add 9e3d1613bda Protect main with the branch ruleset instead of legacy
protection (#77074)
add 5171c9670ad Require multiprocess>=0.70.16 and dill>=0.3.8 in
huggingface provider (#77078)
add 8ae08bb7dd8 Explain fork CI runs that fail to start and link
contributor docs (#76835)
add 433ef3ebd6f Report fork CI to pull requests sooner and with failing
jobs (#76836)
add 5addde0337b i18n(ko): add missing translation in dags.json (Nov 14)
(#77082)
add 5e3dff5d5e8 Stop CI jobs from rejecting every restored image snapshot
(#76418)
add f15847e8869 Let durable agent tasks pause for tool approval (#76882)
add 2935fcb9fbb Go SDK: read the Dag run conf into a struct with typed
fields (#75602)
add 4c20f4ca486 Park HITL reviews between rounds and let durable agent
tasks use them (#76916)
add 53ca1605d23 Add deferrable support to AthenaSparkOperator (#75915)
add d099acc6a40 Detect supervisor-subprocess trigger count mismatch in
Triggerer (#68792)
add aa5957206d9 Fail deferrable KPO instead of silent SUCCESS when a GC'd
pod takes its XCom with it (#73749)
add eb39f15c312 Report fork CI's tested base and withhold CI passed on an
old base (#76837)
add d45e8ea4149 Add a pull request lifecycle diagram for fork CI (#76839)
add ba8075502bc Generate the fork CI diagrams from one source with the
diagrams prek hook (#76841)
add b152048711d Alert on CI job slowdowns only when every recent run is
slow (#73551)
add 32c92b69620 Tell fork CI authors at the open pull request limit to
free a slot (#77100)
add 71f6e9b2484 Add a prek hook to keep scheduled workflows skipping in
forks (#76267)
add 91eed64d3c8 Check the AIP and ADIP wiki trees daily and report
problems to Slack (#76845)
add 0dfab52bf72 Fix duplicate word in DingTalk operator docs (#77093)
add 33207221caa Fix duplicate word in Breeze test commands docs (#77094)
add 759083ee023 Preserve SSH protocol for fork remotes in breeze ci audit
(#76854)
add ce559e40efc Store callback and backfill enum values, not their repr,
in the DB (#76927)
add dd39c346e69 Stop default Celery worker Service selecting
KubernetesExecutor pods (#74587)
add 1195d1b11cc Add terminationGracePeriodSeconds to the Celery worker
liveness probe (#76749)
add d1bc04f43ce Auto-label importer PRs (#77115)
add 245304d6bf5 Skip the ready-for-review CI run when the head already
passed (#77118)
add febd7b45a09 Harden fork CI reconciler state transitions and closure
rules (#76956)
add 89ed9cfc4eb Optimize fork CI change detection and conflict handling
(#76955)
add f68fd1f1db4 Stop the wiki check reporting well-formed AIP pages
(#77111)
add f9444a50746 Add example of event-triggering off of an RSS feed (#77122)
add 52487ede0a9 Test fork CI pull requests merged with their base branch
(#77131)
add 15e84188397 Document JSON connections in Azure Key Vault backend
(#76650)
add c4aa191bf63 Keep what contributors need about fork CI in the
contributor docs (#77133)
add 748148ccdb7 Count passed fork CI jobs and post job statuses at the
intended rate (#77125)
add 5c9c4d85e89 Move core Fernet helpers out of database models (#76605)
add 542ab65b4d3 Move airflowctl assets state store commands to a subgroup
(#75703)
add 081db6f5ef5 Document that a mapped task state store index is
positional (#76283)
add 8a016b710ff Support durable execution in Databricks task operators
(#76295)
add e6fe78e006f Fix removed tasks fail_fast; stop finished TI overwrite
(#76191)
add 79b500352e0 Run Go SDK tests outside repo and on latest Go (#77014)
add e74a7354920 UI: Speed up the latest run lookup for Dags with many old
runs (#75873)
add 2dae3e4e161 Log and audit when the partitioned Dag run per-tick cap is
reached (#71072)
add f2905a7e08f Clarify required params in Lang SDK ADR-0016 (#77081)
add e306ae6529f Add end-to-end tests for task loops (#76886)
add 3d8302a9ead UI: Keep Dag list filters when returning through the Dags
link (#76953)
add 8b471383adc UI: Keep import-error count failures out of the page
(#76954)
add 9fb5deaa209 Fix driverless PostgreSQL Celery `result_backend`
requiring psycopg2 (#77166)
add dbf7d644aa6 SDK release templates and documentation (#76807)
add fff91b39504 Redirect to the requested page after Keycloak login
(#76362)
add e766e71cae7 Release the scoped session on the handler thread in the
FAB FastAPI routes (#76403)
add bb2ac454a42 Template the Neptune cluster operators' db_cluster_id
argument under its own name (#70491)
add 93aed9ad738 Fix templated page_size staying a string in mapped
SqlToS3Operator tasks (#77153)
add 1602aca7101 Merge branch 'main' of https://github.com/apache/airflow
into dabla/agent-async/01-task-agent-aexecute
add ec5151e6e9f Bump the fab-ui-package-updates group across 1 directory
with 4 updates (#77170)
add 9e6126a19c1 Allow mounting the Airflow config as a directory to avoid
the subPath mount race (#70180)
add bada0686efe Allow authenticationRef method in database connection
(#75220)
add 715043b8980 Honor config_file in deferrable KubernetesJobOperator
(#76712)
add 332649741ef Clean up triggers still referenced by task instances with
no state (#76834)
add 0289ce3321c Upgrade Huggingface datasets to 5.2.0 (#77150)
add 8f88f8df531 Bump lang SDK versions after the 1.0.0 release (#77016)
add 41619107e37 Fix import airflow slowdown from reading every package's
metadata (#76890)
add ba4a8117e2c Add Task SDK client contract tests (#77146)
add e12aab3ac6d Discard task state by default on every task clear path
(#76806)
add 0fb56a641c4 Let deferrable operators reuse the durable reconnect
decision tree (#77161)
add 3a7a110f82e Java SDK: Let a task stop through onKill when Airflow asks
it to (#75538)
add ff9a6a926ce Add durable execution to
AzureDataFactoryRunPipelineOperator (#77162)
add 67607c15ca7 Fix 500 from the Keycloak auth manager when a browser
session has no Keycloak tokens (#76353)
add 466bfe33515 Add team-level authorization to Keycloak auth manager list
filters (#77007)
add 5a846fd1a8e Support durable execution for dbt cloud job runs (#76918)
add f5f7f2b838b TS SDK: Fix the XCom map index default and reject invalid
XCom arguments (#76893)
add 58a14b281bb Fix two dead source links in core docs (#77193)
add 3b35135afe9 Fail API tests that run sync DB work on the event loop
(#76424)
add 5c1747992f0 Merge branch 'main' of https://github.com/apache/airflow
into dabla/agent-async/01-task-agent-aexecute
No new revisions were added by this update.
Summary of changes:
.apache-magpie-overrides/release-verify-rc.md | 21 +-
.asf.yaml | 54 +-
.github/CODEOWNERS | 4 +-
.github/actions/merge-with-base/action.yml | 77 +
.github/boring-cyborg.yml | 4 +
.github/workflows/additional-ci-image-checks.yml | 12 +
.github/workflows/additional-prod-image-tests.yml | 47 +-
.github/workflows/agent-framework-tests.yml | 12 +
.github/workflows/airflow-distributions-tests.yml | 12 +
.github/workflows/airflow-e2e-tests.yml | 12 +
.github/workflows/basic-tests.yml | 62 +-
.github/workflows/ci-amd.yml | 185 ++-
.github/workflows/ci-arm.yml | 185 ++-
.github/workflows/ci-duration-monitor.yml | 6 +
.github/workflows/ci-image-build.yml | 12 +
.github/workflows/ci-image-checks.yml | 43 +-
.github/workflows/dependency-upgrade-summary.yml | 12 +
.github/workflows/finalize-tests.yml | 13 +
.github/workflows/fork-ci-monitor.yml | 5 +-
.github/workflows/generate-constraints.yml | 12 +
.github/workflows/helm-tests.yml | 17 +
.github/workflows/integration-system-tests.yml | 22 +
.github/workflows/java-sdk-release-verify.yml | 4 +-
.github/workflows/k8s-tests.yml | 17 +
.github/workflows/kustomize-overlays-tests.yml | 12 +
.github/workflows/openlineage-e2e-compat-tests.yml | 12 +
.github/workflows/prod-image-build.yml | 18 +
.github/workflows/prod-image-extra-checks.yml | 8 +
.github/workflows/prod-packages-build.yml | 12 +
.github/workflows/push-image-cache.yml | 17 +
.github/workflows/run-unit-tests.yml | 12 +
...scheduled-verify-improvement-proposals-wiki.yml | 64 +
.github/workflows/special-tests.yml | 18 +
.github/workflows/test-providers.yml | 17 +
.github/workflows/ui-e2e-tests.yml | 12 +
.pre-commit-config.yaml | 30 +-
README.md | 2 +-
.../lang-sdk/0016-mapped-tasks-across-lang-sdks.md | 18 +-
.../task-and-asset-state-store.rst | 4 +-
.../authoring-and-scheduling/language-sdks/go.rst | 33 +-
.../language-sdks/index.rst | 239 ++-
.../language-sdks/java.rst | 87 ++
.../language-sdks/typescript.rst | 11 +-
.../docs/core-concepts/auth-manager/index.rst | 2 +-
airflow-core/docs/core-concepts/dag-run.rst | 10 +-
.../docs/core-concepts/resumable-tasks.rst | 13 +-
.../docs/core-concepts/task-state-store.rst | 21 +-
airflow-core/docs/howto/docker-compose/index.rst | 2 +-
airflow-core/newsfragments/76806.significant.rst | 33 +
.../auth/managers/simple/ui/package.json | 6 +-
.../auth/managers/simple/ui/pnpm-lock.yaml | 221 +--
.../api_fastapi/core_api/datamodels/dag_run.py | 5 +
.../core_api/openapi/v2-rest-api-generated.yaml | 14 +
.../api_fastapi/core_api/routes/public/dag_run.py | 2 +
.../core_api/routes/public/task_instances.py | 10 +-
.../airflow/api_fastapi/core_api/routes/ui/dags.py | 34 +-
.../core_api/services/public/dag_run.py | 2 +
.../core_api/services/public/task_instances.py | 43 +-
.../airflow/api_fastapi/execution_api/AGENTS.md | 9 +
.../execution_api/routes/task_instances.py | 7 +-
.../execution_api/versions/v2026_10_30.py | 2 +-
airflow-core/src/airflow/cli/cli_config.py | 7 +
.../src/airflow/cli/commands/dag_command.py | 3 +
.../src/airflow/cli/commands/task_command.py | 1 +
airflow-core/src/airflow/{models => }/crypto.py | 57 -
.../src/airflow/executors/workloads/callback.py | 3 +
.../src/airflow/jobs/scheduler_job_runner.py | 90 +-
.../src/airflow/jobs/triggerer_job_runner.py | 61 +-
airflow-core/src/airflow/models/backfill.py | 6 +
airflow-core/src/airflow/models/callback.py | 3 +
airflow-core/src/airflow/models/connection.py | 3 +-
airflow-core/src/airflow/models/connection_test.py | 3 +-
airflow-core/src/airflow/models/crypto.py | 106 +-
airflow-core/src/airflow/models/taskinstance.py | 67 +-
airflow-core/src/airflow/models/trigger.py | 12 +-
airflow-core/src/airflow/models/variable.py | 2 +-
.../src/airflow/serialization/definitions/dag.py | 11 +
.../airflow/ui/openapi-gen/requests/schemas.gen.ts | 12 +
.../airflow/ui/openapi-gen/requests/types.gen.ts | 8 +
airflow-core/src/airflow/ui/package.json | 16 +-
airflow-core/src/airflow/ui/pnpm-lock.yaml | 576 +++----
.../airflow/ui/public/i18n/locales/ko/dags.json | 1 +
.../ui/src/components/Clear/Run/ClearRunButton.tsx | 2 +-
.../components/Clear/Run/ClearRunDialog.test.tsx | 102 ++
.../ui/src/components/Clear/Run/ClearRunDialog.tsx | 43 +-
.../ui/src/context/dagsListSearch/Context.ts | 34 +-
.../dagsListSearch/DagsListSearchProvider.test.tsx | 72 +
.../dagsListSearch/DagsListSearchProvider.tsx | 56 +
.../airflow/ui/src/context/dagsListSearch/index.ts | 35 +-
.../src/airflow/ui/src/layouts/BaseLayout.tsx | 65 +-
.../src/airflow/ui/src/layouts/DagsLayout.test.tsx | 45 +
.../src/airflow/ui/src/layouts/DagsLayout.tsx | 5 +-
.../airflow/ui/src/layouts/Nav/DagsButton.test.tsx | 12 +
.../src/airflow/ui/src/layouts/Nav/DagsButton.tsx | 3 +
.../src/airflow/ui/src/layouts/Nav/NavButton.tsx | 14 +-
.../pages/DagRuns/BulkClearDagRunsButton.test.tsx | 120 ++
.../src/pages/DagRuns/BulkClearDagRunsButton.tsx | 31 +-
.../DagsList/DagsFilters/DagsFilters.test.tsx | 9 +
.../pages/Dashboard/Stats/DagImportErrors.test.tsx | 58 +
.../src/pages/Dashboard/Stats/DagImportErrors.tsx | 4 +-
.../Dashboard/Stats/PluginImportErrors.test.tsx | 55 +
.../pages/Dashboard/Stats/PluginImportErrors.tsx | 8 +-
.../airflow/ui/src/queries/useBulkClearDagRuns.ts | 2 +
airflow-core/tests/unit/api_fastapi/conftest.py | 36 +-
.../core_api/routes/public/test_dag_run.py | 39 +
.../core_api/routes/public/test_dags.py | 4 +-
.../core_api/routes/public/test_task_instances.py | 9 +-
.../unit/api_fastapi/execution_api/conftest.py | 19 +
.../execution_api/test_task_sdk_client_contract.py | 256 +++
.../versions/head/test_task_instances.py | 30 +
.../execution_api/versions/test_v2026_10_30.py | 16 +-
.../known_api_server_threadpool_offloads.txt | 5 +-
.../api_fastapi/known_sync_db_on_event_loop.txt | 37 +
.../unit/api_fastapi/test_event_loop_blocking.py | 234 +++
.../tests/unit/cli/commands/test_dag_command.py | 23 +-
.../cli/commands/test_rotate_fernet_key_command.py | 2 +-
airflow-core/tests/unit/jobs/test_scheduler_job.py | 686 +++++++-
airflow-core/tests/unit/jobs/test_triggerer_job.py | 165 +-
airflow-core/tests/unit/models/test_backfill.py | 6 +
airflow-core/tests/unit/models/test_callback.py | 7 +
airflow-core/tests/unit/models/test_cleartasks.py | 53 +
airflow-core/tests/unit/models/test_connection.py | 2 +-
.../tests/unit/models/test_crypto.py | 12 +-
.../tests/unit/models/test_taskinstance.py | 49 +
airflow-core/tests/unit/models/test_trigger.py | 22 +
.../airflowctl_tests/test_airflowctl_commands.py | 18 +-
airflow-ctl/docs/images/command_hashes.txt | 2 +-
airflow-ctl/docs/images/output_assets.svg | 166 +-
.../src/airflowctl/api/datamodels/generated.py | 14 +
airflow-ctl/src/airflowctl/ctl/cli_config.py | 8 +
.../src/airflowctl/ctl/commands/dag_command.py | 1 +
airflow-ctl/src/airflowctl/ctl/help_texts.yaml | 1 +
.../airflow_ctl/ctl/commands/test_dag_command.py | 6 +-
.../tests/airflow_ctl/ctl/test_cli_config.py | 1 +
.../java-native-bundle/gradle.properties | 2 +-
airflow-e2e-tests/java-test-bundle/build.gradle | 1 +
.../java-test-bundle/gradle.properties | 2 +-
.../org/apache/airflow/e2e/TestBundleBuilder.java | 59 +-
.../src/resources/dags/java_test_dags.py | 24 +
.../basic_tests/test_task_loops.py | 312 ++++
.../dags/example_task_loop_test.py | 125 ++
.../airflow_e2e_tests/e2e_test_utils/clients.py | 22 +
.../java_sdk_tests/test_java_sdk_dag.py | 65 +
chart/docs/production-guide.rst | 20 +-
chart/docs/quick-start.rst | 2 +-
chart/files/pod-template-file.kubernetes-helm-yaml | 4 +-
chart/newsfragments/72206.significant.rst | 3 +
chart/templates/_helpers.yaml | 96 +-
.../api-server/api-server-deployment.yaml | 2 +
chart/templates/cleanup/cleanup-cronjob.yaml | 1 +
.../dag-processor/dag-processor-deployment.yaml | 2 +
.../database-cleanup/database-cleanup-cronjob.yaml | 1 +
chart/templates/flower/flower-deployment.yaml | 1 +
chart/templates/jobs/create-user-job.yaml | 1 +
chart/templates/jobs/migrate-database-job.yaml | 1 +
.../templates/scheduler/scheduler-deployment.yaml | 2 +
.../templates/triggerer/triggerer-deployment.yaml | 2 +
chart/templates/workers/worker-deployment.yaml | 17 +-
chart/templates/workers/worker-kedaautoscaler.yaml | 10 +
chart/templates/workers/worker-service.yaml | 2 -
.../helm_tests/airflow_aux/test_airflow_common.py | 270 +++-
.../airflow_aux/test_pod_template_file.py | 76 +
chart/tests/helm_tests/airflow_core/test_worker.py | 50 +
chart/tests/helm_tests/other/test_keda.py | 88 ++
chart/values.schema.json | 41 +
chart/values.yaml | 16 +
contributing-docs/05_pull_requests.rst | 20 +-
contributing-docs/18_contribution_workflow.rst | 112 +-
contributing-docs/25_maintainer_pr_triage.md | 36 +-
contributing-docs/32_open_pull_request_limit.rst | 3 +
dev/AGENTS.md | 12 +-
dev/README_RELEASE_LANGUAGE_SDKS.md | 432 ++++++
dev/README_RELEASE_PROVIDERS.md | 21 +-
dev/breeze/doc/05_test_commands.rst | 2 +-
dev/breeze/doc/06_managing_docker_images.rst | 2 +-
dev/breeze/doc/08_ci_tasks.rst | 33 +-
dev/breeze/doc/09_release_management_tasks.rst | 14 +-
dev/breeze/doc/ci/04_selective_checks.md | 10 +-
dev/breeze/doc/ci/05_workflows.md | 9 +
.../doc/ci/08_fork_ci_for_external_contributors.md | 451 ++++--
.../ci/images/diagram_fork_ci_architecture.md5sum | 1 +
.../doc/ci/images/diagram_fork_ci_architecture.py | 80 +
.../doc/ci/images/diagram_fork_ci_architecture.svg | 157 ++
.../doc/ci/images/diagram_fork_ci_lifecycle.md5sum | 1 +
.../doc/ci/images/diagram_fork_ci_lifecycle.py | 94 ++
.../doc/ci/images/diagram_fork_ci_lifecycle.svg | 283 ++++
.../doc/ci/images/diagram_fork_ci_states.md5sum | 1 +
dev/breeze/doc/ci/images/diagram_fork_ci_states.py | 104 ++
.../doc/ci/images/diagram_fork_ci_states.svg | 284 ++++
.../src/airflow_breeze/commands/ci_commands.py | 3 +-
dev/breeze/src/airflow_breeze/utils/ci_audit.py | 37 +-
.../src/airflow_breeze/utils/fork_ci_gate.py | 5 +-
.../src/airflow_breeze/utils/fork_ci_messages.py | 316 +++-
.../src/airflow_breeze/utils/fork_ci_reconcile.py | 708 +++++++--
.../src/airflow_breeze/utils/fork_compare.py | 152 +-
.../src/airflow_breeze/utils/publish_docs_to_s3.py | 28 +-
.../src/airflow_breeze/utils/reproduce_ci.py | 29 +
.../src/airflow_breeze/utils/selective_checks.py | 18 +-
dev/breeze/tests/test_ci_audit.py | 47 +
dev/breeze/tests/test_ci_commands.py | 26 +
dev/breeze/tests/test_fork_ci_gate.py | 1 +
dev/breeze/tests/test_fork_ci_messages.py | 280 +++-
dev/breeze/tests/test_fork_ci_reconcile.py | 1380 +++++++++++++++--
dev/breeze/tests/test_fork_compare.py | 152 +-
dev/breeze/tests/test_publish_docs_to_s3.py | 9 +
dev/breeze/tests/test_reproduce_ci.py | 32 +-
dev/breeze/tests/test_selective_checks.py | 83 +-
dev/breeze/tests/test_shim_version_check.py | 11 +
.../react_plugin_template/package.json | 2 +-
.../react_plugin_template/pnpm-lock.yaml | 177 +--
devel-common/src/sphinx_exts/redirects.py | 19 +-
.../test_utils/operators/run_deferrable.py | 32 +-
.../src/tests_common/test_utils/version_compat.py | 2 +
.../tests/unit/sphinx_exts/test_redirects.py | 45 +
docker-stack-docs/README.md | 24 +-
docker-stack-docs/_static/anchor-redirects.js | 132 ++
docker-stack-docs/build-advanced.rst | 438 ++++++
docker-stack-docs/build-arg-ref.rst | 11 +-
docker-stack-docs/build-customizing.rst | 343 ++++
docker-stack-docs/build-extending.rst | 231 +++
docker-stack-docs/build-publishing.rst | 50 +
docker-stack-docs/build.rst | 1216 ++-------------
docker-stack-docs/changelog.rst | 4 +-
docker-stack-docs/conf.py | 13 +-
.../customizing/add-build-essential-custom.sh | 2 +-
.../docker-examples/customizing/custom-sources.sh | 2 +-
.../customizing/pypi-dev-runtime-deps.sh | 2 +-
.../customizing/pypi-extras-and-deps.sh | 2 +-
.../customizing/pypi-selected-version.sh | 2 +-
...uild-essential-custom.sh => selected-extras.sh} | 9 +-
.../extending/slim-with-providers/Dockerfile | 17 +-
.../restricted/restricted_environments.sh | 25 +-
docker-stack-docs/entrypoint.rst | 194 +--
docker-stack-docs/image-variants.rst | 66 +
docker-stack-docs/index.rst | 238 +--
docker-stack-docs/legacy-images.rst | 56 +
docker-stack-docs/recipes.rst | 91 --
.../redirects.txt | 5 +-
docker-stack-docs/security-public-cves.rst | 60 +
docker-stack-docs/security-release-time.rst | 44 +
docker-stack-docs/security-scan-results.rst | 80 +
docker-stack-docs/testing.rst | 135 ++
docker-stack-docs/why-build-your-own-image.rst | 53 +
.../test_examples_of_prod_image_building.py | 14 +-
docs/spelling_wordlist.txt | 1 +
generated/known_airflow_exceptions.txt | 2 +-
go-sdk/DEVELOPMENT.md | 101 ++
go-sdk/internal/fieldname/fieldname.go | 30 +
go-sdk/pkg/binding/binding.go | 11 +-
go-sdk/sdk/conf.go | 385 +++++
go-sdk/sdk/conf_test.go | 353 +++++
go-sdk/sdk/context.go | 2 +
java-sdk/DEVELOPMENT.md | 231 +--
java-sdk/README.md | 2 +-
java-sdk/gradle.properties | 2 +-
.../org/apache/airflow/sdk/AirflowProcessor.kt | 145 +-
.../org/apache/airflow/sdk/AirflowProcessorTest.kt | 525 +++++++
java-sdk/sdk/build.gradle.kts | 46 +
.../main/kotlin/org/apache/airflow/sdk/Context.kt | 62 +-
.../main/kotlin/org/apache/airflow/sdk/DagDef.kt | 1 +
.../main/kotlin/org/apache/airflow/sdk/Server.kt | 51 +-
.../kotlin/org/apache/airflow/sdk/StoppableTask.kt | 94 ++
.../apache/airflow/sdk/execution/Cancellation.kt | 190 +++
.../org/apache/airflow/sdk/execution/Comm.kt | 18 +-
.../org/apache/airflow/sdk/execution/Logger.kt | 205 ++-
.../org/apache/airflow/sdk/execution/Task.kt | 18 +-
.../kotlin/org/apache/airflow/sdk/ContextTest.kt | 14 +
.../kotlin/org/apache/airflow/sdk/ServerTest.kt | 1093 +++++++++++++
.../airflow/sdk/execution/CancellationTest.kt | 327 ++++
.../org/apache/airflow/sdk/execution/CommTest.kt | 88 ++
.../apache/airflow/sdk/execution/LogSenderTest.kt | 767 +++++++++
.../org/apache/airflow/sdk/execution/TaskTest.kt | 72 +-
.../lang_sdk/java_example/gradle.properties | 2 +-
kubernetes-tests/lang_sdk/ts_example/package.json | 2 +-
.../amazon/docs/operators/athena/athena_spark.rst | 24 +
.../providers/amazon/aws/operators/athena_spark.py | 49 +
.../providers/amazon/aws/operators/neptune.py | 74 +-
.../providers/amazon/aws/transfers/sql_to_s3.py | 13 +-
.../providers/amazon/aws/triggers/athena.py | 49 +
.../providers/amazon/aws/waiters/athena.json | 25 +
.../system/amazon/aws/example_athena_spark.py | 13 +
.../unit/amazon/aws/operators/test_athena_spark.py | 220 +++
.../unit/amazon/aws/transfers/test_sql_to_s3.py | 45 +-
.../tests/unit/amazon/aws/triggers/test_athena.py | 55 +-
.../tests/unit/amazon/aws/waiters/test_athena.py | 91 ++
.../airflow/providers/apache/beam/hooks/beam.py | 30 +-
.../providers/apache/beam/operators/beam.py | 65 +-
.../beam/tests/unit/apache/beam/hooks/test_beam.py | 108 +-
.../tests/unit/apache/beam/operators/test_beam.py | 135 +-
providers/celery/docs/changelog.rst | 7 +
providers/celery/provider.yaml | 4 +-
.../providers/celery/executors/default_celery.py | 23 +-
.../airflow/providers/celery/get_provider_info.py | 2 +-
.../unit/celery/executors/test_celery_executor.py | 58 +-
.../unit/celery/executors/test_default_celery.py | 15 +-
providers/cncf/kubernetes/docs/changelog.rst | 11 +
.../providers/cncf/kubernetes/hooks/kubernetes.py | 8 +-
.../providers/cncf/kubernetes/operators/pod.py | 9 +-
.../unit/cncf/kubernetes/hooks/test_kubernetes.py | 43 +-
.../unit/cncf/kubernetes/operators/test_pod.py | 33 +-
providers/common/ai/docs/durable_execution.rst | 25 +-
providers/common/ai/docs/hitl_review.rst | 164 +-
providers/common/ai/docs/observability.rst | 4 +-
providers/common/ai/docs/operators/agent.rst | 5 +-
providers/common/ai/docs/recovery.rst | 4 +-
providers/common/ai/docs/tool_approval.rst | 67 +-
providers/common/ai/docs/troubleshooting.rst | 15 +-
providers/common/ai/docs/why_common_ai.rst | 9 +-
.../providers/common/ai/durable/capability.py | 44 +-
.../providers/common/ai/durable/fingerprint.py | 20 +
.../airflow/providers/common/ai/durable/journal.py | 157 +-
.../common/ai/example_dags/example_agent.py | 1 -
.../src/airflow/providers/common/ai/exceptions.py | 5 +-
.../providers/common/ai/mixins/hitl_review.py | 439 +++++-
.../airflow/providers/common/ai/operators/agent.py | 820 ++++++++--
.../providers/common/ai/plugins/hitl_review.py | 354 ++---
.../providers/common/ai/utils/hitl_review.py | 11 +-
.../common/ai/tests/unit/common/ai/conftest.py | 56 +-
.../unit/common/ai/durable/test_fingerprint.py | 41 +-
.../tests/unit/common/ai/durable/test_journal.py | 529 +++++++
.../unit/common/ai/mixins/test_hitl_review.py | 241 ++-
.../tests/unit/common/ai/operators/test_agent.py | 14 +-
.../common/ai/operators/test_agent_hitl_review.py | 531 +++++++
.../ai/operators/test_agent_tool_approval.py | 849 +++++++++-
.../unit/common/ai/plugins/test_hitl_review.py | 137 +-
providers/databricks/docs/operators/notebook.rst | 55 +-
providers/databricks/docs/operators/run_now.rst | 21 +-
providers/databricks/docs/operators/submit_run.rst | 21 +-
providers/databricks/docs/operators/task.rst | 55 +-
.../providers/databricks/operators/databricks.py | 207 ++-
.../unit/databricks/operators/test_databricks.py | 374 ++++-
providers/dbt/cloud/docs/operators.rst | 38 +
providers/dbt/cloud/pyproject.toml | 2 +-
.../airflow/providers/dbt/cloud/operators/dbt.py | 180 ++-
.../tests/unit/dbt/cloud/operators/test_dbt.py | 235 ++-
providers/dingding/docs/operators.rst | 2 +-
.../providers/edge3/plugins/www/package.json | 12 +-
.../providers/edge3/plugins/www/pnpm-lock.yaml | 297 ++--
.../providers/3rd-party-licenses/LICENSES-ui.txt | 2 +-
.../fab/auth_manager/api_fastapi/routes/login.py | 35 +-
.../fab/auth_manager/api_fastapi/routes/roles.py | 17 +-
.../fab/auth_manager/api_fastapi/routes/users.py | 15 +-
.../fab/src/airflow/providers/fab/www/package.json | 16 +-
.../src/airflow/providers/fab/www/pnpm-lock.yaml | 1631 +++++++-------------
.../api_fastapi/routes/test_session_release.py | 117 ++
.../providers/google/cloud/hooks/dataflow.py | 54 +-
.../providers/google/cloud/triggers/bigquery.py | 4 +-
.../providers/google/cloud/triggers/dataproc.py | 12 +-
.../tests/unit/google/cloud/hooks/test_dataflow.py | 111 ++
.../unit/google/cloud/triggers/test_bigquery.py | 24 +-
.../unit/google/cloud/triggers/test_dataproc.py | 60 +
providers/http/docs/triggers.rst | 30 +-
.../http/tests/system/http/example_sec_rss.py | 80 +
.../http/tests/unit/http/system}/__init__.py | 0
.../tests/unit/http/system/test_example_sec_rss.py | 103 ++
providers/huggingface/README.rst | 2 +
providers/huggingface/docs/index.rst | 2 +
providers/huggingface/pyproject.toml | 4 +
.../docs/auth-manager/manage/permissions.rst | 29 +
providers/keycloak/provider.yaml | 12 +
.../providers/keycloak/auth_manager/constants.py | 2 +
.../keycloak/auth_manager/keycloak_auth_manager.py | 229 ++-
.../providers/keycloak/auth_manager/middleware.py | 30 +
.../keycloak/auth_manager/routes/login.py | 22 +-
.../providers/keycloak/get_provider_info.py | 7 +
.../keycloak/auth_manager/routes/test_login.py | 103 ++
.../auth_manager/test_keycloak_auth_manager.py | 91 ++
.../unit/keycloak/auth_manager/test_middleware.py | 157 +-
providers/microsoft/azure/docs/changelog.rst | 8 +
.../azure/docs/operators/adf_run_pipeline.rst | 28 +
.../microsoft/azure/docs/operators/msgraph.rst | 35 +
.../docs/secrets-backends/azure-key-vault.rst | 2 +-
providers/microsoft/azure/docs/sensors/msgraph.rst | 19 +
.../microsoft/azure/operators/data_factory.py | 78 +-
.../providers/microsoft/azure/operators/msgraph.py | 102 +-
.../providers/microsoft/azure/sensors/msgraph.py | 67 +-
.../microsoft/azure/triggers/data_factory.py | 7 +-
.../providers/microsoft/azure/triggers/msgraph.py | 14 +
.../providers/microsoft/azure/version_compat.py | 2 +
.../microsoft/azure/operators/test_data_factory.py | 149 +-
.../unit/microsoft/azure/operators/test_msgraph.py | 287 +++-
.../unit/microsoft/azure/operators/test_powerbi.py | 15 +-
.../unit/microsoft/azure/sensors/test_msgraph.py | 201 ++-
.../azure/tests/unit/microsoft/azure/test_utils.py | 13 +
.../microsoft/azure/triggers/test_data_factory.py | 16 +-
.../unit/microsoft/azure/triggers/test_msgraph.py | 14 +
providers/openlineage/README.rst | 4 +-
providers/openlineage/docs/index.rst | 4 +-
providers/openlineage/pyproject.toml | 4 +-
scripts/ci/analyze_ci_job_durations.py | 155 +-
scripts/ci/docker_data_root_snapshot.sh | 10 +-
.../ci/prek/check_airflowctl_command_coverage.py | 1 +
scripts/ci/prek/check_fork_ci_gate_config.py | 91 +-
scripts/ci/prek/check_fork_ci_tests_merge.py | 169 ++
scripts/ci/prek/check_order_dockerfile_extras.py | 37 +-
.../prek/check_scheduled_workflows_skip_forks.py | 104 ++
scripts/ci/prek/update_versions.py | 13 +-
.../ci/prek/validate_operators_init_exemptions.txt | 2 -
scripts/ci/verify_improvement_proposals_wiki.py | 477 ++++++
.../ci/prek/test_check_fork_ci_gate_config.py | 215 ++-
.../ci/prek/test_check_fork_ci_tests_merge.py | 132 ++
.../ci/prek/test_check_order_dockerfile_extras.py | 41 +-
.../test_check_scheduled_workflows_skip_forks.py | 138 ++
scripts/tests/ci/test_analyze_ci_job_durations.py | 124 ++
scripts/tests/ci/test_docker_data_root_snapshot.py | 82 +
.../ci/test_verify_improvement_proposals_wiki.py | 540 +++++++
.../src/airflow_shared/module_loading/__init__.py | 21 +-
.../tests/module_loading/test_entry_points.py | 45 +-
.../observability/metrics/metrics_template.yaml | 7 +
.../tests/plugins_manager/test_plugins_manager.py | 10 +-
task-sdk/docs/api.rst | 2 +
task-sdk/docs/resumable-job-mixin.rst | 35 +-
task-sdk/docs/ts-bundle-spec.rst | 2 +-
task-sdk/src/airflow/sdk/__init__.py | 4 +-
task-sdk/src/airflow/sdk/__init__.pyi | 6 +-
.../src/airflow/sdk/bases/resumablejobmixin.py | 154 +-
.../src/airflow/sdk/execution_time/supervisor.py | 15 +-
.../tests/task_sdk/bases/test_resumablejobmixin.py | 59 +
.../task_sdk/execution_time/test_supervisor.py | 42 +
ts-sdk/DEVELOPMENT.md | 134 +-
ts-sdk/README.md | 4 +-
ts-sdk/docs/index.md | 8 +-
ts-sdk/docs/package-lock.json | 4 +-
ts-sdk/docs/package.json | 2 +-
ts-sdk/docs/tests/deployment-checks.test.mjs | 4 +-
ts-sdk/example/package.json | 2 +-
ts-sdk/package.json | 5 +-
ts-sdk/pnpm-lock.yaml | 223 +--
ts-sdk/src/coordinator/client.ts | 71 +-
ts-sdk/src/sdk/client-types.ts | 27 +-
ts-sdk/src/sdk/client.ts | 11 +-
ts-sdk/tests/coordinator/client.test.ts | 70 +-
ts-sdk/tests/public-api.test.ts | 12 +-
uv.lock | 49 +-
434 files changed, 29702 insertions(+), 6116 deletions(-)
create mode 100644 .github/actions/merge-with-base/action.yml
create mode 100644
.github/workflows/scheduled-verify-improvement-proposals-wiki.yml
create mode 100644 airflow-core/newsfragments/76806.significant.rst
copy airflow-core/src/airflow/{models => }/crypto.py (60%)
create mode 100644
airflow-core/src/airflow/ui/src/components/Clear/Run/ClearRunDialog.test.tsx
copy airflow-e2e-tests/java-test-bundle/build.gradle =>
airflow-core/src/airflow/ui/src/context/dagsListSearch/Context.ts (58%)
create mode 100644
airflow-core/src/airflow/ui/src/context/dagsListSearch/DagsListSearchProvider.test.tsx
create mode 100644
airflow-core/src/airflow/ui/src/context/dagsListSearch/DagsListSearchProvider.tsx
copy airflow-e2e-tests/java-test-bundle/build.gradle =>
airflow-core/src/airflow/ui/src/context/dagsListSearch/index.ts (58%)
create mode 100644 airflow-core/src/airflow/ui/src/layouts/DagsLayout.test.tsx
create mode 100644
airflow-core/src/airflow/ui/src/pages/DagRuns/BulkClearDagRunsButton.test.tsx
create mode 100644
airflow-core/src/airflow/ui/src/pages/Dashboard/Stats/DagImportErrors.test.tsx
create mode 100644
airflow-core/src/airflow/ui/src/pages/Dashboard/Stats/PluginImportErrors.test.tsx
create mode 100644
airflow-core/tests/unit/api_fastapi/execution_api/test_task_sdk_client_contract.py
copy java-sdk/gradle.properties =>
airflow-core/tests/unit/api_fastapi/execution_api/versions/test_v2026_10_30.py
(58%)
copy airflow-e2e-tests/java-native-bundle/gradle.properties =>
airflow-core/tests/unit/api_fastapi/known_api_server_threadpool_offloads.txt
(87%)
create mode 100644
airflow-core/tests/unit/api_fastapi/known_sync_db_on_event_loop.txt
create mode 100644
airflow-core/tests/unit/api_fastapi/test_event_loop_blocking.py
copy java-sdk/gradle.properties =>
airflow-core/tests/unit/models/test_crypto.py (66%)
create mode 100644
airflow-e2e-tests/tests/airflow_e2e_tests/basic_tests/test_task_loops.py
create mode 100644
airflow-e2e-tests/tests/airflow_e2e_tests/dags/example_task_loop_test.py
create mode 100644 chart/newsfragments/72206.significant.rst
create mode 100644 dev/README_RELEASE_LANGUAGE_SDKS.md
create mode 100644 dev/breeze/doc/ci/images/diagram_fork_ci_architecture.md5sum
create mode 100644 dev/breeze/doc/ci/images/diagram_fork_ci_architecture.py
create mode 100644 dev/breeze/doc/ci/images/diagram_fork_ci_architecture.svg
create mode 100644 dev/breeze/doc/ci/images/diagram_fork_ci_lifecycle.md5sum
create mode 100644 dev/breeze/doc/ci/images/diagram_fork_ci_lifecycle.py
create mode 100644 dev/breeze/doc/ci/images/diagram_fork_ci_lifecycle.svg
create mode 100644 dev/breeze/doc/ci/images/diagram_fork_ci_states.md5sum
create mode 100644 dev/breeze/doc/ci/images/diagram_fork_ci_states.py
create mode 100644 dev/breeze/doc/ci/images/diagram_fork_ci_states.svg
create mode 100644 devel-common/tests/unit/sphinx_exts/test_redirects.py
create mode 100644 docker-stack-docs/_static/anchor-redirects.js
create mode 100644 docker-stack-docs/build-advanced.rst
create mode 100644 docker-stack-docs/build-customizing.rst
create mode 100644 docker-stack-docs/build-extending.rst
create mode 100644 docker-stack-docs/build-publishing.rst
copy
docker-stack-docs/docker-examples/customizing/{add-build-essential-custom.sh =>
selected-extras.sh} (85%)
copy java-sdk/gradle.properties =>
docker-stack-docs/docker-examples/extending/slim-with-providers/Dockerfile (58%)
create mode 100644 docker-stack-docs/image-variants.rst
create mode 100644 docker-stack-docs/legacy-images.rst
delete mode 100644 docker-stack-docs/recipes.rst
copy airflow-e2e-tests/java-test-bundle/gradle.properties =>
docker-stack-docs/redirects.txt (90%)
create mode 100644 docker-stack-docs/security-public-cves.rst
create mode 100644 docker-stack-docs/security-release-time.rst
create mode 100644 docker-stack-docs/security-scan-results.rst
create mode 100644 docker-stack-docs/testing.rst
create mode 100644 docker-stack-docs/why-build-your-own-image.rst
create mode 100644 go-sdk/internal/fieldname/fieldname.go
create mode 100644 go-sdk/sdk/conf.go
create mode 100644 go-sdk/sdk/conf_test.go
create mode 100644
java-sdk/sdk/src/main/kotlin/org/apache/airflow/sdk/StoppableTask.kt
create mode 100644
java-sdk/sdk/src/main/kotlin/org/apache/airflow/sdk/execution/Cancellation.kt
create mode 100644
java-sdk/sdk/src/test/kotlin/org/apache/airflow/sdk/execution/CancellationTest.kt
create mode 100644
java-sdk/sdk/src/test/kotlin/org/apache/airflow/sdk/execution/LogSenderTest.kt
create mode 100644
providers/amazon/tests/unit/amazon/aws/waiters/test_athena.py
create mode 100644
providers/common/ai/tests/unit/common/ai/operators/test_agent_hitl_review.py
create mode 100644
providers/fab/tests/unit/fab/auth_manager/api_fastapi/routes/test_session_release.py
create mode 100644 providers/http/tests/system/http/example_sec_rss.py
copy {airflow-core/src/airflow/api/common =>
providers/http/tests/unit/http/system}/__init__.py (100%)
create mode 100644
providers/http/tests/unit/http/system/test_example_sec_rss.py
create mode 100755 scripts/ci/prek/check_fork_ci_tests_merge.py
create mode 100755 scripts/ci/prek/check_scheduled_workflows_skip_forks.py
create mode 100644 scripts/ci/verify_improvement_proposals_wiki.py
create mode 100644 scripts/tests/ci/prek/test_check_fork_ci_tests_merge.py
create mode 100644
scripts/tests/ci/prek/test_check_scheduled_workflows_skip_forks.py
create mode 100644 scripts/tests/ci/test_verify_improvement_proposals_wiki.py