This is an automated email from the ASF dual-hosted git repository.
dependabot[bot] pushed a change to branch
dependabot/uv/dev/breeze/uv-security-updates-2118ef368f
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard a1d9d3a7c9a Bump pyjwt
add 2e803e58997 Add key-pair JWT authentication to Snowflake Cortex Agent
hook (#73815)
add e92147c12aa UI: Add a time-window scope to the Dags list run state
filter (#70470)
add 63a5966473b Check PyPI history before a new provider's first release
(#73887)
add ede78e095b6 Add embedding kwargs to common AI hooks and operators
(#72002)
add 64943ba6dbb Fix `run_duration` calculation in airflow dags test by
decoupling start_date (#68837)
add 9e67831f2bb Allow filtering the Dag runs list by Dag tags (#70861)
add e22c9d02b2e Add Has Events filter to Assets search (#72460)
add f31b572df18 Fix airflowctl commands crashing instead of printing their
result (#72675)
add 1559dae90ab UI: Use TeamName component for all team name displays
(#73910)
add 489316fbc72 Migrate execution API reads to async sessions (#73403)
add a8e95debbc6 Fix flaky AgentOperator durable usage budget tests (#73996)
add e33e45fe67a Add `AssetAndTimeSchedule` timetable (#58543)
add a91216d5ea9 TS SDK: serialize a native Dag to Dag JSON (#73441)
add 884e687ea77 Fix short-circuit inside a mapped task group not skipping
downstream (#73959)
add 3f19c146545 Go SDK: declare data edges with airflow.Inputs (#73895)
add 13adb691464 Close German Translation Gaps 2026-09-30 (#73980)
add d886882ac14 Let Common AI toolsets use the agent's tool retry budget
(#73957)
add 35633455ed7 Add first-class `capabilities` to Common AI
`AgentOperator` (#73984)
add adaa16f88af Parse Dag files through the Task SDK importers (#73853)
add 12127b07978 Fix check-conn-id-templated crashing on a vanishing
__pycache__ (#74016)
add 4d304d0876c Export files an agent built in a sandbox to object storage
(#73990)
add e9c552cc827 Add a vendor-neutral managed-agent hook contract to Common
AI (#73532)
add a33fe27cace Add async client to `AnthropicHook` (#73967)
add e6a9de5d832 Go SDK: bring the coordinator-protocol models back to the
supervisor schema (#73963)
add 27cd88ca74c Cache repeated agent prompts by default in AgentOperator
(#73994)
add 529f429400a Go SDK: reject a task handler and a Dag that share a
dag_id (#73876)
add bc9ca5b1227 Correctly shutdown async sessions on exit. (#73838)
add f1b36db6093 Back off between GitDagBundle bare clone attempts so a
fresh GitHub App token can propagate (#73878)
add 6b847411de1 Stop rebuilding the FAB app on every users and roles API
call (#73104)
add 56817294cdd Go SDK: add airflow.TriggerDagRun, a task that triggers a
Dag run (#74003)
add b8475094703 Fix go-sdk generated drift (#74028)
add 8f3e8466c67 Support Airflow 2.11 in the Common AI provider (#73991)
add f0cde671827 Use "Airflow versions" in user-facing docs, not "cores"
(#74045)
add 0bb09cb6ba5 Close the providers testing issue right after announcing
the release (#73890)
add 43377466a06 Release the DuckDB provider as 0.2.0 (#73888)
add 53e43f29130 Speed up CI image restores with zstd-compressed stashes
(#73997)
add e4d397f021e Bound get_schema results for very wide tables in the SQL
toolsets (#74017)
add 7d6244bf191 Clarify `max_db_retries` doc wording to avoid off-by-one
confusion (#73722)
add bb463bf9230 Correlate executor task events by attempt UUID (#73916)
add c19faf0c5ae Render the HITL review workflow as a Mermaid diagram
(#74024)
add 2aa31ae7bff Use airflow.sdk imports in Airflow 3 upgrade guide example
(#74015)
add f3532c60eda Use Task SDK TaskInstanceState in OpenSearch log handler
(#72444)
add 0ec26723858 Add GKEPodExecOperator for existing Pods (#72577)
add 740986adfce Add missing cycle assertion to test_semi_complex (#71973)
add fca1c01c73e Fix Windows UnicodeDecodeError during pytest collection
(#73536)
add 1787ef7cbba Run the deferred AWS hook configuration check as a prek
hook (#73681)
add 413ae46a045 Align timetable docs with Airflow 3 data interval and
catchup behaviour (#70658)
add 64f9f3ac784 Update issue templates now that Airflow 2 has reached end
of life (#74056)
add 6330b4de9c5 Go SDK: reject a second TaskSpec or Inputs when dag.Task
applies it (#74057)
add 383a9a87a98 Stop wiping the uv cache before every CI image build
(#74052)
add 58e987defec Fix Non-DB test collection failure in Google Stackdriver
hook test (#74066)
add 498724fc13a Go SDK: enumerate every user-facing enum in the airflow
package (#74064)
add 5e476d7cf89 TS SDK: answer the Dag-parsing request from bundle.serve
(#73442)
add dd271599939 Go SDK: vendor the schemas it generates from (#74047)
add 77927390c17 Move Dag cycle detection from the Task SDK to shared
(#74034)
add a3e07159a0b Add Dag ID filtering to Assets search (#70971)
add d3b9a0dd2b3 Add KafkaSharedStreamProducer and KafkaSharedStreamTrigger
(#68625)
add ae6139d58a8 Fix DecreasingPriorityStrategy example by initializing
try_number before weight evaluation (#62148)
add 402d7885194 Java SDK: Resolve a task's arguments from the Dag's own
wiring (#73596)
add e14854221ad Group and filter Dags by folder on the Dags page (#68544)
add 18af65032e3 Render the Language SDK Spec diagrams as Mermaid (#74065)
add be53013349e Support azure-datalake-store 1.x in AzureDataLakeHook
(#73819)
add bc15e1093b5 Close German Translation Gaps 2026-10-02 (#74088)
add 3045451b8b0 Treat an empty Dag run config as no config in the UI
(#74083)
add c31888641b1 Persist the match-anywhere search toggle in the URL
(#74019)
add 4803c0b3f79 Discover Dag definitions through the Task SDK importers
(#74020)
add f5283f3da9b Move the Dag file processor's shared plumbing into a base
class (#74040)
add e3dd28607b9 Document team-scoped plugins in multi-team mode (#73995)
add b62299ced8a Cap microsoft-kiota-http below 1.13 in the Microsoft Azure
provider (#74090)
add d7b672f44e0 Update docs and diagrams for the Airflow 3 Dag processor
(#74073)
add 9566d881ab6 Bump pyjwt
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (a1d9d3a7c9a)
\
N -- N -- N
refs/heads/dependabot/uv/dev/breeze/uv-security-updates-2118ef368f (9566d881ab6)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/ISSUE_TEMPLATE/1-airflow_bug_report.yml | 7 +-
.github/ISSUE_TEMPLATE/2-feature_request.yml | 3 +-
.github/workflows/ci-image-build.yml | 8 +
.pre-commit-config.yaml | 50 +-
.../modules_management.rst | 2 +-
.../docs/administration-and-deployment/plugins.rst | 172 ++++-
.../authoring-and-scheduling/asset-scheduling.rst | 31 +-
.../language-sdks/typescript.rst | 23 +
.../docs/authoring-and-scheduling/timetable.rst | 179 +++--
airflow-core/docs/best-practices.rst | 10 +-
airflow-core/docs/core-concepts/dags.rst | 6 +-
airflow-core/docs/core-concepts/executor/index.rst | 23 +-
airflow-core/docs/core-concepts/multi-team.rst | 16 +-
airflow-core/docs/core-concepts/overview.rst | 4 +-
.../img/diagram_basic_airflow_architecture.md5sum | 2 +-
.../img/diagram_basic_airflow_architecture.png | Bin 116194 -> 127853 bytes
.../docs/img/diagram_basic_airflow_architecture.py | 9 +-
...agram_dag_processor_airflow_architecture.md5sum | 2 +-
.../diagram_dag_processor_airflow_architecture.png | Bin 237657 -> 237572 bytes
.../diagram_dag_processor_airflow_architecture.py | 23 +-
...diagram_distributed_airflow_architecture.md5sum | 2 +-
.../diagram_distributed_airflow_architecture.png | Bin 192497 -> 215541 bytes
.../diagram_distributed_airflow_architecture.py | 20 +-
.../docs/installation/upgrading_to_airflow3.rst | 2 +-
airflow-core/docs/migrations-ref.rst | 4 +-
airflow-core/newsfragments/58543.feature.rst | 1 +
airflow-core/newsfragments/68496.significant.rst | 4 +-
airflow-core/src/airflow/api_fastapi/app.py | 2 +
.../api_fastapi/common/parameters/__init__.py | 4 +
.../airflow/api_fastapi/common/parameters/asset.py | 23 +
.../airflow/api_fastapi/common/parameters/dag.py | 87 +++
.../api_fastapi/common/parameters/dag_run.py | 35 +-
.../api_fastapi/core_api/datamodels/ui/dags.py | 14 +
.../api_fastapi/core_api/openapi/_private_ui.yaml | 114 +++
.../core_api/openapi/v2-rest-api-generated.yaml | 19 +
.../api_fastapi/core_api/routes/public/dag_run.py | 4 +
.../api_fastapi/core_api/routes/ui/assets.py | 3 +
.../airflow/api_fastapi/core_api/routes/ui/dags.py | 51 ++
.../src/airflow/api_fastapi/execution_api/app.py | 2 +
.../api_fastapi/execution_api/routes/assets.py | 14 +-
.../api_fastapi/execution_api/routes/dag_runs.py | 18 +-
.../api_fastapi/execution_api/routes/hitl.py | 12 +-
.../execution_api/routes/task_instances.py | 28 +-
.../execution_api/routes/task_reschedules.py | 6 +-
.../src/airflow/config_templates/config.yml | 43 +-
.../src/airflow/dag_processing/collection.py | 21 +-
airflow-core/src/airflow/dag_processing/dagbag.py | 240 +++---
.../airflow/dag_processing/importers/__init__.py | 39 -
.../src/airflow/dag_processing/importers/base.py | 266 -------
.../dag_processing/importers/python_importer.py | 360 ---------
airflow-core/src/airflow/dag_processing/manager.py | 133 ++--
.../src/airflow/dag_processing/processor.py | 160 ++--
.../src/airflow/executors/base_executor.py | 123 ++-
.../src/airflow/executors/local_executor.py | 13 +-
.../src/airflow/executors/workloads/task.py | 3 +-
.../src/airflow/executors/workloads/types.py | 17 +-
.../src/airflow/jobs/scheduler_job_runner.py | 256 ++++---
...3_4_0_add_timetable_asset_gated_to_dagmodel.py} | 29 +-
airflow-core/src/airflow/models/dag.py | 32 +-
airflow-core/src/airflow/models/dagcode.py | 45 +-
airflow-core/src/airflow/models/dagrun.py | 2 +-
airflow-core/src/airflow/models/serialized_dag.py | 19 +-
airflow-core/src/airflow/models/taskinstance.py | 4 +-
airflow-core/src/airflow/serialization/encoders.py | 9 +
airflow-core/src/airflow/settings.py | 14 +-
.../ti_deps/deps/not_previously_skipped_dep.py | 6 +-
airflow-core/src/airflow/timetables/assets.py | 112 ++-
airflow-core/src/airflow/timetables/base.py | 16 +
airflow-core/src/airflow/timetables/simple.py | 1 +
.../src/airflow/ui/openapi-gen/queries/common.ts | 21 +-
.../ui/openapi-gen/queries/ensureQueryData.ts | 41 +-
.../src/airflow/ui/openapi-gen/queries/prefetch.ts | 41 +-
.../src/airflow/ui/openapi-gen/queries/queries.ts | 41 +-
.../src/airflow/ui/openapi-gen/queries/suspense.ts | 41 +-
.../airflow/ui/openapi-gen/requests/schemas.gen.ts | 37 +
.../ui/openapi-gen/requests/services.gen.ts | 37 +-
.../airflow/ui/openapi-gen/requests/types.gen.ts | 42 +
.../airflow/ui/public/i18n/locales/ar/dags.json | 2 -
.../airflow/ui/public/i18n/locales/ca/dags.json | 4 -
.../airflow/ui/public/i18n/locales/de/assets.json | 1 +
.../airflow/ui/public/i18n/locales/de/browse.json | 30 +
.../airflow/ui/public/i18n/locales/de/common.json | 35 +-
.../ui/public/i18n/locales/de/components.json | 5 +
.../src/airflow/ui/public/i18n/locales/de/dag.json | 5 +
.../airflow/ui/public/i18n/locales/de/dags.json | 26 +-
.../ui/public/i18n/locales/de/dashboard.json | 17 +-
.../airflow/ui/public/i18n/locales/el/dags.json | 2 -
.../airflow/ui/public/i18n/locales/en/assets.json | 1 +
.../airflow/ui/public/i18n/locales/en/common.json | 9 +-
.../airflow/ui/public/i18n/locales/en/dags.json | 13 +-
.../airflow/ui/public/i18n/locales/es/dags.json | 4 -
.../airflow/ui/public/i18n/locales/fr/dags.json | 2 -
.../airflow/ui/public/i18n/locales/he/dags.json | 2 -
.../airflow/ui/public/i18n/locales/hi/dags.json | 2 -
.../airflow/ui/public/i18n/locales/ko/dags.json | 4 -
.../airflow/ui/public/i18n/locales/pl/dags.json | 4 -
.../airflow/ui/public/i18n/locales/ru/dags.json | 2 -
.../airflow/ui/public/i18n/locales/zh-CN/dags.json | 4 -
.../airflow/ui/public/i18n/locales/zh-TW/dags.json | 4 -
.../ui/src/components/FilterBar/FilterBar.test.tsx | 21 +
.../ui/src/components/FilterBar/FilterBar.tsx | 31 +-
.../FilterBar/filters/RunStateFilter.tsx | 234 ++++++
.../FilterBar/filters/runStateParams.test.ts | 95 +++
.../components/FilterBar/filters/runStateParams.ts | 76 ++
.../airflow/ui/src/components/FilterBar/types.ts | 14 +-
.../TriggerDag/TriggerDAGButton.test.tsx | 112 +++
.../src/components/TriggerDag/TriggerDAGButton.tsx | 7 +-
.../src/airflow/ui/src/constants/filterConfigs.tsx | 38 +-
.../src/airflow/ui/src/constants/localStorage.ts | 1 +
.../src/airflow/ui/src/constants/searchParams.ts | 6 +
.../ui/src/hooks/useAdvancedSearch.test.tsx | 148 ++++
.../src/airflow/ui/src/hooks/useAdvancedSearch.ts | 36 +-
.../src/airflow/ui/src/mocks/handlers/dag_runs.ts | 49 +-
.../src/airflow/ui/src/mocks/handlers/dags.ts | 10 +
.../ui/src/pages/AssetsList/AssetsList.test.tsx | 113 ++-
.../airflow/ui/src/pages/AssetsList/AssetsList.tsx | 21 +-
.../ui/src/pages/Connections/Connections.tsx | 4 +
.../airflow/ui/src/pages/DagRuns/DagRuns.test.tsx | 27 +
.../src/airflow/ui/src/pages/DagRuns/DagRuns.tsx | 10 +-
.../ui/src/pages/DagRuns/DagRunsFilters.tsx | 1 +
.../DagsList/DagFolderTree/DagFolderTree.test.tsx | 323 ++++++++
.../pages/DagsList/DagFolderTree/DagFolderTree.tsx | 216 ++++++
.../DagsList/DagFolderTree/buildFolderTree.test.ts | 119 +++
.../DagsList/DagFolderTree/buildFolderTree.ts | 152 ++++
.../DagsList/DagFolderTree}/index.ts | 3 +-
.../src/pages/DagsList/DagsFilters/DagsFilters.tsx | 3 +-
.../ui/src/pages/DagsList/DagsList.test.tsx | 41 +-
.../src/airflow/ui/src/pages/DagsList/DagsList.tsx | 193 +++--
.../src/airflow/ui/src/pages/Events/Events.tsx | 4 +
airflow-core/src/airflow/ui/src/pages/Jobs.tsx | 11 +-
.../src/airflow/ui/src/pages/Pools/PoolBarCard.tsx | 12 +-
.../src/airflow/ui/src/pages/Run/Details.tsx | 4 +-
.../airflow/ui/src/pages/Variables/Variables.tsx | 4 +
.../useColorMode.tsx => queries/useDagFolders.ts} | 18 +-
.../src/airflow/ui/src/queries/useDags.tsx | 9 +
...artitionKey.test.ts => hasDagRunConfig.test.ts} | 14 +-
.../levels.js => src/utils/hasDagRunConfig.ts} | 13 +-
airflow-core/src/airflow/ui/src/utils/index.ts | 1 +
.../ui/src/utils/useFiltersHandler.test.tsx | 63 ++
.../src/airflow/ui/src/utils/useFiltersHandler.ts | 22 +-
.../src/airflow/ui/tests/e2e/pages/DagsPage.ts | 18 +-
airflow-core/src/airflow/utils/db.py | 2 +-
airflow-core/src/airflow/utils/file.py | 50 +-
.../api_fastapi/auth/managers/simple/conftest.py | 3 +-
airflow-core/tests/unit/api_fastapi/conftest.py | 27 +-
.../core_api/routes/public/test_auth.py | 28 +-
.../core_api/routes/public/test_backfills.py | 20 +-
.../core_api/routes/public/test_connections.py | 9 +-
.../core_api/routes/public/test_dag_bundles.py | 43 +-
.../core_api/routes/public/test_dag_parsing.py | 18 +-
.../core_api/routes/public/test_dag_run.py | 134 ++--
.../core_api/routes/public/test_task_instances.py | 111 ++-
.../api_fastapi/core_api/routes/ui/test_assets.py | 23 +
.../api_fastapi/core_api/routes/ui/test_dags.py | 226 ++++++
.../unit/api_fastapi/execution_api/test_app.py | 84 +-
.../versions/head/test_task_instances.py | 5 +-
airflow-core/tests/unit/api_fastapi/test_app.py | 108 ++-
airflow-core/tests/unit/core/test_settings.py | 120 +++
.../unit/dag_processing/importers/test_registry.py | 99 ---
.../tests/unit/dag_processing/test_collection.py | 86 ++-
.../tests/unit/dag_processing/test_dagbag.py | 283 ++++---
.../tests/unit/dag_processing/test_manager.py | 324 +++++++-
.../tests/unit/dag_processing/test_processor.py | 31 +-
.../tests/unit/executors/test_base_executor.py | 278 ++++++-
.../tests/unit/executors/test_local_executor.py | 10 +-
.../tests/unit/executors/test_workloads.py | 16 +-
airflow-core/tests/unit/jobs/test_scheduler_job.py | 747 ++++++++++++++++--
airflow-core/tests/unit/models/test_dag.py | 36 +-
airflow-core/tests/unit/models/test_dagcode.py | 39 +
.../tests/unit/models/test_taskinstance.py | 12 +
airflow-core/tests/unit/state/test_metastore.py | 9 +
.../deps/test_not_previously_skipped_dep.py | 44 ++
.../tests/unit/timetables/test_assets_timetable.py | 227 +++++-
airflow-core/tests/unit/utils/test_file.py | 37 +-
airflow-core/tests/unit/utils/test_session.py | 18 +-
airflow-ctl/src/airflowctl/ctl/cli_config.py | 12 +-
.../tests/airflow_ctl/ctl/test_cli_config.py | 34 +-
.../airflow_e2e_tests/openlineage_tests/README.md | 2 +-
.../dags_extra/e2e_versioned_bundle.py | 4 +-
dev/README_RELEASE_PROVIDERS.md | 87 ++-
.../airflow_breeze/commands/ci_image_commands.py | 4 +-
.../airflow_breeze/commands/testing_commands.py | 2 +-
dev/breeze/src/airflow_breeze/global_constants.py | 2 +-
dev/breeze/tests/test_ci_image_commands.py | 20 +
dev/breeze/tests/test_selective_checks.py | 16 +-
devel-common/src/tests_common/pytest_plugin.py | 9 +-
devel-common/src/tests_common/test_utils/config.py | 11 +-
.../src/tests_common/test_utils/mock_executor.py | 5 +-
.../src/tests_common/test_utils/providers.py | 2 +-
docs/spelling_wordlist.txt | 2 +
generated/known_sdk_imports_in_core.txt | 8 +-
go-sdk/README.md | 59 +-
go-sdk/adr/0008-native-dag-interface.md | 7 +-
go-sdk/airflow/bundle.go | 46 +-
go-sdk/airflow/bundle_test.go | 111 +++
go-sdk/airflow/dag.go | 140 +++-
go-sdk/airflow/dag_test.go | 23 +-
go-sdk/airflow/enums.go | 156 ++++
go-sdk/airflow/enums_test.go | 221 ++++++
go-sdk/airflow/inputs.go | 145 ++++
go-sdk/airflow/inputs_test.go | 437 +++++++++++
go-sdk/airflow/spec.gen.go | 3 +-
go-sdk/airflow/spec.go | 33 +-
go-sdk/airflow/spec_test.go | 71 --
go-sdk/airflow/task_handler.go | 12 +-
go-sdk/airflow/task_option.go | 28 +-
go-sdk/airflow/trigger_dag_run.go | 165 ++++
go-sdk/airflow/trigger_dag_run_test.go | 276 +++++++
go-sdk/internal/bundle/task.go | 28 +-
go-sdk/internal/genspec/authoring.go | 8 +-
go-sdk/internal/genspec/main.go | 9 +-
go-sdk/internal/genspec/normalize_test.go | 5 +-
go-sdk/pkg/binding/binding.go | 56 +-
go-sdk/pkg/binding/binding_test.go | 27 +
.../pkg/execution/genmodels/discriminators.gen.go | 4 +
go-sdk/pkg/execution/genmodels/gen.go | 13 +-
go-sdk/pkg/execution/genmodels/models.gen.go | 171 +++--
go-sdk/pkg/execution/messages_test.go | 23 +-
{java-sdk/sdk => go-sdk}/schema/dag-schema.json | 0
.../schema/supervisor-schema.json | 33 +
.../org/apache/airflow/sdk/BuilderProcessor.kt | 2 +-
.../kotlin/org/apache/airflow/sdk/BuilderTest.kt | 4 +-
.../src/main/kotlin/org/apache/airflow/sdk/Arg.kt | 11 +-
.../main/kotlin/org/apache/airflow/sdk/Context.kt | 10 +-
.../main/kotlin/org/apache/airflow/sdk/DagDef.kt | 1 +
.../kotlin/org/apache/airflow/sdk/InputTask.kt | 2 +-
.../org/apache/airflow/sdk/execution/Task.kt | 7 +-
.../org/apache/airflow/sdk/internal/ArgValues.kt | 124 +++
.../org/apache/airflow/sdk/internal/TaskArgs.kt | 42 +-
.../org/apache/airflow/sdk/ArgTestSupport.kt | 15 +
.../kotlin/org/apache/airflow/sdk/ArgValuesTest.kt | 2 +-
.../kotlin/org/apache/airflow/sdk/InputTaskTest.kt | 90 +++
.../org/apache/airflow/sdk/execution/TaskTest.kt | 24 +
.../apache/airflow/sdk/internal/ArgValuesTest.kt | 266 +++++++
providers/.pre-commit-config.yaml | 7 +
providers/amazon/docs/index.rst | 2 +
providers/amazon/docs/operators/bedrock.rst | 40 +
providers/amazon/pyproject.toml | 4 +
.../airflow/providers/amazon/aws/hooks/bedrock.py | 229 +++++-
.../tests/unit/amazon/aws/hooks/test_bedrock.py | 280 +++++++
.../amazon/aws/test_deferred_hook_configuration.py | 242 +-----
providers/anthropic/pyproject.toml | 2 +-
.../airflow/providers/anthropic/hooks/anthropic.py | 99 ++-
.../tests/unit/anthropic/hooks/test_anthropic.py | 141 +++-
providers/apache/kafka/docs/triggers.rst | 33 +
providers/apache/kafka/provider.yaml | 1 +
.../providers/apache/kafka/get_provider_info.py | 1 +
.../apache/kafka/triggers/shared_stream.py | 407 ++++++++++
.../providers/apache/kafka/version_compat.py | 2 +
.../apache/kafka/triggers/test_shared_stream.py | 259 +++++++
.../apache/kafka/triggers/test_shared_stream.py | 481 ++++++++++++
.../unit/celery/executors/test_celery_executor.py | 4 +
.../executors/test_kubernetes_executor.py | 2 +
providers/common/ai/README.rst | 3 +-
providers/common/ai/docs/approval_gates.rst | 2 +-
providers/common/ai/docs/capabilities.rst | 137 ++++
providers/common/ai/docs/changelog.rst | 12 +
providers/common/ai/docs/code_mode.rst | 7 +-
providers/common/ai/docs/features.rst | 6 +-
providers/common/ai/docs/guardrails.rst | 66 --
providers/common/ai/docs/hitl_review.rst | 63 +-
providers/common/ai/docs/hooks/langchain.rst | 20 +-
providers/common/ai/docs/hooks/llamaindex.rst | 12 +
providers/common/ai/docs/index.rst | 5 +-
providers/common/ai/docs/installation.rst | 33 +-
providers/common/ai/docs/observability.rst | 3 +
providers/common/ai/docs/operators/agent.rst | 108 ++-
.../ai/docs/operators/llamaindex_embedding.rst | 26 +-
.../ai/docs/operators/llamaindex_retrieval.rst | 18 +-
providers/common/ai/docs/operators/llm_batch.rst | 4 +-
providers/common/ai/docs/operators/llm_branch.rst | 2 +-
providers/common/ai/docs/quickstart.rst | 3 +-
providers/common/ai/docs/redirects.txt | 1 +
providers/common/ai/docs/sandbox/backends.rst | 11 +-
providers/common/ai/docs/sandbox/configuration.rst | 59 +-
providers/common/ai/docs/sandbox/index.rst | 5 +-
providers/common/ai/docs/self_hosted_models.rst | 3 +-
providers/common/ai/docs/stability.rst | 2 +-
providers/common/ai/docs/tool_approval.rst | 5 +-
providers/common/ai/docs/toolsets/datafusion.rst | 13 +-
providers/common/ai/docs/toolsets/hook.rst | 3 +
providers/common/ai/docs/toolsets/index.rst | 77 +-
.../common/ai/docs/toolsets/managed_agent.rst | 337 ++++----
.../common/ai/docs/toolsets/object_storage.rst | 3 +
providers/common/ai/docs/toolsets/sql.rst | 45 +-
providers/common/ai/docs/troubleshooting.rst | 8 +-
providers/common/ai/pyproject.toml | 7 +-
.../ai/src/airflow/providers/common/ai/__init__.py | 4 +-
.../airflow/providers/common/ai/batch/anthropic.py | 5 +-
.../airflow/providers/common/ai/batch/openai.py | 5 +-
.../airflow/providers/common/ai/batch/results.py | 5 +-
.../providers/common/ai/decorators/agent.py | 2 +-
.../airflow/providers/common/ai/decorators/llm.py | 2 +-
.../providers/common/ai/decorators/llm_batch.py | 2 +-
.../providers/common/ai/decorators/llm_branch.py | 2 +-
.../common/ai/decorators/llm_file_analysis.py | 2 +-
.../common/ai/decorators/llm_schema_compare.py | 2 +-
.../providers/common/ai/decorators/llm_sql.py | 2 +-
.../providers/common/ai/durable/caching_model.py | 4 +-
.../providers/common/ai/durable/caching_toolset.py | 17 +-
.../providers/common/ai/durable/fingerprint.py | 12 +-
.../airflow/providers/common/ai/durable/storage.py | 7 +-
.../common/ai/durable/task_state_store.py | 4 +-
.../ai/example_dags/example_agent_capabilities.py | 27 +-
.../ai/example_dags/example_sandbox_toolset.py | 70 +-
.../src/airflow/providers/common/ai/exceptions.py | 17 +-
.../airflow/providers/common/ai/hooks/langchain.py | 30 +-
.../providers/common/ai/hooks/llamaindex.py | 25 +-
.../providers/common/ai/hooks/pydantic_ai.py | 10 +
.../providers/common/ai/managed_agents/__init__.py | 49 ++
.../providers/common/ai/managed_agents/base.py | 251 ++++++
.../providers/common/ai/managed_agents/failover.py | 145 ++++
.../airflow/providers/common/ai/mixins/approval.py | 6 +-
.../airflow/providers/common/ai/observability.py | 19 +-
.../airflow/providers/common/ai/operators/agent.py | 193 +++--
.../common/ai/operators/llamaindex_embedding.py | 15 +-
.../common/ai/operators/llamaindex_retrieval.py | 16 +-
.../airflow/providers/common/ai/operators/llm.py | 17 +-
.../airflow/providers/common/ai/sandbox/base.py | 167 +++-
.../providers/common/ai/sandbox/opensandbox.py | 71 +-
.../src/airflow/providers/common/ai/sandbox/sbx.py | 90 ++-
.../providers/common/ai/tools/_from_toolset.py | 18 +-
.../providers/common/ai/toolsets/__init__.py | 4 +-
.../providers/common/ai/toolsets/datafusion.py | 45 +-
.../airflow/providers/common/ai/toolsets/hook.py | 11 +-
.../common/ai/toolsets/langchain_bridge.py | 5 +-
.../providers/common/ai/toolsets/managed_agent.py | 365 ++++-----
.../providers/common/ai/toolsets/object_storage.py | 11 +-
.../providers/common/ai/toolsets/sandbox.py | 209 ++++-
.../airflow/providers/common/ai/toolsets/sql.py | 43 +-
.../airflow/providers/common/ai/utils/logging.py | 18 +-
.../providers/common/ai/utils/prompt_cache.py | 140 ++++
.../providers/common/ai/utils/query_results.py | 202 ++++-
.../providers/common/ai/utils/task_logger.py | 67 ++
.../providers/common/ai/utils/toolset_base.py | 19 +
.../providers/common/ai/utils/usage_budget.py | 11 +-
.../ai/tests/unit/common/ai/batch/test_dispatch.py | 2 +-
.../ai/tests/unit/common/ai/batch/test_results.py | 2 +-
.../ai/tests/unit/common/ai/batch/test_state.py | 2 +-
.../common/ai/tests/unit/common/ai/conftest.py | 11 +-
.../tests/unit/common/ai/decorators/test_agent.py | 22 +-
.../unit/common/ai/decorators/test_llm_batch.py | 3 +-
.../common/ai/decorators/test_llm_file_analysis.py | 5 +-
.../ai/tests/unit/common/ai/durable/test_base.py | 2 +-
.../unit/common/ai/durable/test_caching_toolset.py | 55 ++
.../unit/common/ai/durable/test_fingerprint.py | 20 +
.../unit/common/ai/durable/test_replay_cost.py | 2 +-
.../common/ai/durable/test_replay_verification.py | 2 +-
.../tests/unit/common/ai/durable/test_storage.py | 2 +-
.../common/ai/durable/test_task_state_store.py | 2 +-
.../tests/unit/common/ai/hooks/test_langchain.py | 66 ++
.../tests/unit/common/ai/hooks/test_llamaindex.py | 72 ++
.../tests/unit/common/ai/hooks/test_pydantic_ai.py | 15 +
.../unit/common/ai/managed_agents}/__init__.py | 0
.../unit/common/ai/managed_agents/test_base.py | 137 ++++
.../unit/common/ai/managed_agents/test_failover.py | 205 +++++
.../tests/unit/common/ai/mixins/test_approval.py | 6 +-
.../tests/unit/common/ai/operators/test_agent.py | 313 +++++++-
.../common/ai/operators/test_document_loader.py | 12 +-
.../ai/operators/test_llamaindex_embedding.py | 17 +-
.../ai/operators/test_llamaindex_retrieval.py | 19 +-
.../ai/tests/unit/common/ai/operators/test_llm.py | 24 +-
.../unit/common/ai/operators/test_llm_batch.py | 3 +-
.../unit/common/ai/operators/test_llm_branch.py | 4 +-
.../common/ai/operators/test_llm_file_analysis.py | 11 +-
.../tests/unit/common/ai/operators/test_llm_sql.py | 4 +-
.../ai/tests/unit/common/ai/sandbox/test_base.py | 163 +++-
.../unit/common/ai/sandbox/test_opensandbox.py | 137 ++++
.../ai/tests/unit/common/ai/sandbox/test_sbx.py | 106 +++
.../ai/tests/unit/common/ai/test_observability.py | 19 +
.../unit/common/ai/tools/test__from_toolset.py | 33 +-
.../unit/common/ai/toolsets/test_datafusion.py | 55 +-
.../unit/common/ai/toolsets/test_managed_agent.py | 403 ++++------
.../unit/common/ai/toolsets/test_object_storage.py | 8 +-
.../unit/common/ai/toolsets/test_retry_budget.py | 98 +++
.../tests/unit/common/ai/toolsets/test_sandbox.py | 356 +++++++++
.../ai/tests/unit/common/ai/toolsets/test_sql.py | 62 +-
.../ai/tests/unit/common/ai/utils/test_logging.py | 55 +-
.../unit/common/ai/utils/test_prompt_cache.py | 209 +++++
.../unit/common/ai/utils/test_query_results.py | 167 +++-
.../tests/unit/common/ai/utils/test_task_logger.py | 82 ++
.../common/compat/_set_during_execution.py | 40 +
.../src/airflow/providers/common/compat/sdk.py | 14 +-
.../common/compat/security/test_access_view.py | 8 +-
.../common/compat/test__set_during_execution.py} | 22 +-
.../compat/tests/unit/common/compat/test_sdk.py | 18 +-
providers/duckdb/README.rst | 6 +-
providers/duckdb/docs/changelog.rst | 9 +-
providers/duckdb/docs/index.rst | 6 +-
providers/duckdb/provider.yaml | 2 +-
providers/duckdb/pyproject.toml | 6 +-
.../src/airflow/providers/duckdb/__init__.py | 2 +-
providers/fab/pyproject.toml | 2 +-
.../fab/auth_manager/api_fastapi/routes/roles.py | 14 +-
.../fab/auth_manager/api_fastapi/routes/users.py | 12 +-
.../providers/fab/auth_manager/fab_auth_manager.py | 4 +-
.../unit/fab/auth_manager/api_fastapi/conftest.py | 21 +
.../auth_manager/api_fastapi/routes/test_roles.py | 161 ++--
.../auth_manager/api_fastapi/routes/test_users.py | 128 ++--
.../git/src/airflow/providers/git/bundles/git.py | 31 +-
.../git/src/airflow/providers/git/hooks/git.py | 7 +-
providers/git/tests/unit/git/bundles/test_git.py | 44 ++
providers/git/tests/unit/git/hooks/test_git.py | 10 +
providers/google/docs/index.rst | 10 +-
.../docs/operators/cloud/kubernetes_engine.rst | 20 +
.../google/docs/operators/cloud/vertex_ai.rst | 24 +
providers/google/pyproject.toml | 6 +-
.../google/cloud/hooks/vertex_ai/agent_engine.py | 159 +++-
.../google/cloud/operators/kubernetes_engine.py | 114 +++
.../kubernetes_engine/example_kubernetes_engine.py | 105 ++-
.../unit/google/cloud/hooks/test_stackdriver.py | 2 +-
.../cloud/hooks/vertex_ai/test_agent_engine.py | 145 ++++
.../cloud/operators/test_kubernetes_engine.py | 146 +++-
providers/microsoft/azure/README.rst | 6 +-
providers/microsoft/azure/docs/index.rst | 6 +-
providers/microsoft/azure/pyproject.toml | 13 +-
.../providers/microsoft/azure/hooks/data_lake.py | 13 +-
.../unit/microsoft/azure/hooks/test_data_lake.py | 61 +-
.../providers/opensearch/log/os_task_handler.py | 3 +-
.../smtp/src/airflow/providers/smtp/hooks/smtp.py | 2 +-
.../snowflake/hooks/snowflake_cortex_agent.py | 42 +-
.../snowflake/hooks/test_snowflake_cortex_agent.py | 106 ++-
.../airflow/providers/standard/operators/hitl.py | 6 +-
.../tests/unit/standard/operators/test_hitl.py | 4 +-
pyproject.toml | 5 +-
.../ci/lang_sdk_serialization}/__init__.py | 0
scripts/ci/lang_sdk_serialization/compare.py | 233 ++++++
.../ci/lang_sdk_serialization/serialize_python.py | 140 ++++
scripts/ci/lang_sdk_serialization/test_dags.yaml | 166 ++++
scripts/ci/prek/check_conn_id_templated.py | 18 +-
.../ci/prek/check_deferred_hook_configuration.py | 294 +++++++
scripts/ci/prek/check_go_sdk_generated_drift.py | 190 +++++
scripts/ci/prek/check_go_sdk_spec_drift.py | 140 ----
scripts/ci/prek/common_prek_utils.py | 26 +-
scripts/ci/prek/sync_go_sdk_schemas.py | 142 ++++
scripts/ci/prek/update_providers_dependencies.py | 14 +-
.../tests/ci/lang_sdk_serialization}/__init__.py | 0
.../ci/lang_sdk_serialization/test_compare.py | 245 ++++++
.../tests/ci/prek/test_check_conn_id_templated.py | 26 +-
.../prek/test_check_deferred_hook_configuration.py | 373 +++++++++
...ift.py => test_check_go_sdk_generated_drift.py} | 90 ++-
scripts/tests/ci/prek/test_sync_go_sdk_schemas.py | 127 ++++
shared/dagnode/src/airflow_shared/dagnode/cycle.py | 73 ++
shared/dagnode/tests/dagnode/test_cycle.py | 79 ++
.../observability/metrics/metrics_template.yaml | 20 +-
task-sdk/docs/api.rst | 2 +
task-sdk/docs/conf.py | 1 +
task-sdk/docs/lang-sdk-spec.rst | 83 +-
task-sdk/src/airflow/sdk/__init__.py | 3 +
task-sdk/src/airflow/sdk/__init__.pyi | 2 +
task-sdk/src/airflow/sdk/bases/timetable.py | 7 +
task-sdk/src/airflow/sdk/definitions/dag.py | 45 +-
.../airflow/sdk/definitions/timetables/assets.py | 25 +
.../airflow/sdk/execution_time/schema/schema.json | 33 +
.../sdk/execution_time/schema/versions/__init__.py | 8 +-
.../execution_time/schema/versions/v2026_10_30.py | 12 +
task-sdk/src/airflow/sdk/importers/base.py | 36 +-
.../src/airflow/sdk/importers/python_importer.py | 22 +-
task-sdk/src/airflow/sdk/serde/__init__.py | 7 +-
task-sdk/tests/task_sdk/definitions/test_dag.py | 18 +-
.../task_sdk/importers/test_python_importer.py | 20 +
task-sdk/tests/task_sdk/importers/test_registry.py | 14 +
ts-sdk/.pre-commit-config.yaml | 14 +
ts-sdk/package.json | 3 +-
ts-sdk/pnpm-lock.yaml | 27 +-
..._lint.py => check_serialization_conformance.py} | 16 +-
ts-sdk/src/coordinator/runtime.ts | 69 +-
ts-sdk/src/coordinator/serde.ts | 751 ++++++++++++++++++
ts-sdk/src/generated/supervisor.ts | 18 +
ts-sdk/src/sdk/dag.ts | 25 +-
ts-sdk/tests/conformance/serialize_typescript.ts | 163 ++++
ts-sdk/tests/coordinator/arg-binding.test.ts | 19 +
ts-sdk/tests/coordinator/integration.test.ts | 108 ++-
ts-sdk/tests/coordinator/serde.test.ts | 846 +++++++++++++++++++++
ts-sdk/tests/public-api.test.ts | 4 +
uv.lock | 39 +-
476 files changed, 23070 insertions(+), 4347 deletions(-)
create mode 100644 airflow-core/newsfragments/58543.feature.rst
delete mode 100644
airflow-core/src/airflow/dag_processing/importers/__init__.py
delete mode 100644 airflow-core/src/airflow/dag_processing/importers/base.py
delete mode 100644
airflow-core/src/airflow/dag_processing/importers/python_importer.py
copy
airflow-core/src/airflow/migrations/versions/{0111_3_3_0_add_timetable_periodic_to_dag.py
=> 0141_3_4_0_add_timetable_asset_gated_to_dagmodel.py} (63%)
create mode 100644
airflow-core/src/airflow/ui/src/components/FilterBar/filters/RunStateFilter.tsx
create mode 100644
airflow-core/src/airflow/ui/src/components/FilterBar/filters/runStateParams.test.ts
create mode 100644
airflow-core/src/airflow/ui/src/components/FilterBar/filters/runStateParams.ts
create mode 100644
airflow-core/src/airflow/ui/src/components/TriggerDag/TriggerDAGButton.test.tsx
create mode 100644
airflow-core/src/airflow/ui/src/hooks/useAdvancedSearch.test.tsx
create mode 100644
airflow-core/src/airflow/ui/src/pages/DagsList/DagFolderTree/DagFolderTree.test.tsx
create mode 100644
airflow-core/src/airflow/ui/src/pages/DagsList/DagFolderTree/DagFolderTree.tsx
create mode 100644
airflow-core/src/airflow/ui/src/pages/DagsList/DagFolderTree/buildFolderTree.test.ts
create mode 100644
airflow-core/src/airflow/ui/src/pages/DagsList/DagFolderTree/buildFolderTree.ts
copy airflow-core/src/airflow/ui/src/{layouts/Details/Gantt =>
pages/DagsList/DagFolderTree}/index.ts (91%)
copy airflow-core/src/airflow/ui/src/{context/colorMode/useColorMode.tsx =>
queries/useDagFolders.ts} (62%)
copy airflow-core/src/airflow/ui/src/utils/{partitionKey.test.ts =>
hasDagRunConfig.test.ts} (64%)
copy airflow-core/src/airflow/ui/{rules/levels.js =>
src/utils/hasDagRunConfig.ts} (68%)
delete mode 100644
airflow-core/tests/unit/dag_processing/importers/test_registry.py
create mode 100644 go-sdk/airflow/enums.go
create mode 100644 go-sdk/airflow/enums_test.go
create mode 100644 go-sdk/airflow/inputs.go
create mode 100644 go-sdk/airflow/inputs_test.go
delete mode 100644 go-sdk/airflow/spec_test.go
create mode 100644 go-sdk/airflow/trigger_dag_run.go
create mode 100644 go-sdk/airflow/trigger_dag_run_test.go
copy {java-sdk/sdk => go-sdk}/schema/dag-schema.json (100%)
copy task-sdk/src/airflow/sdk/execution_time/schema/schema.json =>
go-sdk/schema/supervisor-schema.json (99%)
create mode 100644
java-sdk/sdk/src/test/kotlin/org/apache/airflow/sdk/internal/ArgValuesTest.kt
create mode 100644
providers/apache/kafka/src/airflow/providers/apache/kafka/triggers/shared_stream.py
create mode 100644
providers/apache/kafka/tests/integration/apache/kafka/triggers/test_shared_stream.py
create mode 100644
providers/apache/kafka/tests/unit/apache/kafka/triggers/test_shared_stream.py
create mode 100644 providers/common/ai/docs/capabilities.rst
delete mode 100644 providers/common/ai/docs/guardrails.rst
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/managed_agents/__init__.py
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/managed_agents/base.py
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/managed_agents/failover.py
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/utils/prompt_cache.py
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/utils/task_logger.py
rename {airflow-core/tests/unit/dag_processing/importers =>
providers/common/ai/tests/unit/common/ai/managed_agents}/__init__.py (100%)
create mode 100644
providers/common/ai/tests/unit/common/ai/managed_agents/test_base.py
create mode 100644
providers/common/ai/tests/unit/common/ai/managed_agents/test_failover.py
create mode 100644
providers/common/ai/tests/unit/common/ai/toolsets/test_retry_budget.py
create mode 100644
providers/common/ai/tests/unit/common/ai/utils/test_prompt_cache.py
create mode 100644
providers/common/ai/tests/unit/common/ai/utils/test_task_logger.py
create mode 100644
providers/common/compat/src/airflow/providers/common/compat/_set_during_execution.py
copy providers/{amazon/tests/unit/amazon/aws/cli/test_definition.py =>
common/compat/tests/unit/common/compat/test__set_during_execution.py} (52%)
copy {airflow-core/src/airflow/_shared =>
scripts/ci/lang_sdk_serialization}/__init__.py (100%)
create mode 100644 scripts/ci/lang_sdk_serialization/compare.py
create mode 100644 scripts/ci/lang_sdk_serialization/serialize_python.py
create mode 100644 scripts/ci/lang_sdk_serialization/test_dags.yaml
create mode 100755 scripts/ci/prek/check_deferred_hook_configuration.py
create mode 100755 scripts/ci/prek/check_go_sdk_generated_drift.py
delete mode 100755 scripts/ci/prek/check_go_sdk_spec_drift.py
create mode 100755 scripts/ci/prek/sync_go_sdk_schemas.py
copy {airflow-core/src/airflow/_shared =>
scripts/tests/ci/lang_sdk_serialization}/__init__.py (100%)
create mode 100644 scripts/tests/ci/lang_sdk_serialization/test_compare.py
create mode 100644
scripts/tests/ci/prek/test_check_deferred_hook_configuration.py
rename scripts/tests/ci/prek/{test_check_go_sdk_spec_drift.py =>
test_check_go_sdk_generated_drift.py} (50%)
create mode 100644 scripts/tests/ci/prek/test_sync_go_sdk_schemas.py
create mode 100644 shared/dagnode/src/airflow_shared/dagnode/cycle.py
create mode 100644 shared/dagnode/tests/dagnode/test_cycle.py
copy ts-sdk/scripts/ci/prek/{ts_sdk_lint.py =>
check_serialization_conformance.py} (67%)
create mode 100644 ts-sdk/src/coordinator/serde.ts
create mode 100644 ts-sdk/tests/conformance/serialize_typescript.ts
create mode 100644 ts-sdk/tests/coordinator/serde.test.ts
