This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a change to branch ci-upgrade-main
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 42919d1f2e4 [main] CI: Upgrade important CI environment
add e6fe78e006f Fix removed tasks fail_fast; stop finished TI overwrite
(#76191)
add 79b500352e0 Run Go SDK tests outside repo and on latest Go (#77014)
add e74a7354920 UI: Speed up the latest run lookup for Dags with many old
runs (#75873)
add 2dae3e4e161 Log and audit when the partitioned Dag run per-tick cap is
reached (#71072)
add f2905a7e08f Clarify required params in Lang SDK ADR-0016 (#77081)
add e306ae6529f Add end-to-end tests for task loops (#76886)
add 3d8302a9ead UI: Keep Dag list filters when returning through the Dags
link (#76953)
add 8b471383adc UI: Keep import-error count failures out of the page
(#76954)
add 9fb5deaa209 Fix driverless PostgreSQL Celery `result_backend`
requiring psycopg2 (#77166)
add dbf7d644aa6 SDK release templates and documentation (#76807)
add fff91b39504 Redirect to the requested page after Keycloak login
(#76362)
add e766e71cae7 Release the scoped session on the handler thread in the
FAB FastAPI routes (#76403)
add bb2ac454a42 Template the Neptune cluster operators' db_cluster_id
argument under its own name (#70491)
add 93aed9ad738 Fix templated page_size staying a string in mapped
SqlToS3Operator tasks (#77153)
add ec5151e6e9f Bump the fab-ui-package-updates group across 1 directory
with 4 updates (#77170)
add 9e6126a19c1 Allow mounting the Airflow config as a directory to avoid
the subPath mount race (#70180)
add bada0686efe Allow authenticationRef method in database connection
(#75220)
add 715043b8980 Honor config_file in deferrable KubernetesJobOperator
(#76712)
add 332649741ef Clean up triggers still referenced by task instances with
no state (#76834)
add 0289ce3321c Upgrade Huggingface datasets to 5.2.0 (#77150)
add 8f88f8df531 Bump lang SDK versions after the 1.0.0 release (#77016)
add 41619107e37 Fix import airflow slowdown from reading every package's
metadata (#76890)
add ba4a8117e2c Add Task SDK client contract tests (#77146)
add e12aab3ac6d Discard task state by default on every task clear path
(#76806)
add 0fb56a641c4 Let deferrable operators reuse the durable reconnect
decision tree (#77161)
add 3a7a110f82e Java SDK: Let a task stop through onKill when Airflow asks
it to (#75538)
add ff9a6a926ce Add durable execution to
AzureDataFactoryRunPipelineOperator (#77162)
add 67607c15ca7 Fix 500 from the Keycloak auth manager when a browser
session has no Keycloak tokens (#76353)
add 466bfe33515 Add team-level authorization to Keycloak auth manager list
filters (#77007)
add 5a846fd1a8e Support durable execution for dbt cloud job runs (#76918)
add f5f7f2b838b TS SDK: Fix the XCom map index default and reject invalid
XCom arguments (#76893)
add 58a14b281bb Fix two dead source links in core docs (#77193)
add 3b35135afe9 Fail API tests that run sync DB work on the event loop
(#76424)
add bdc117c7e2c Fix FAB user auto-registration failing with a 500 when
add_user fails (#76746)
add 35eedb3749b Let SQLToolset agents see table comments and search large
schemas (#76799)
add 32550ea56b6 UI: Send the hide-paused default with the first Dags list
request (#76689)
add 56bbac12ad9 UI: Fix operator-triggered runs showing a raw translation
key (#77008)
add 740539cd36d Add tooltips to copy buttons in import error views (#77165)
add df9fac6008f Say why a fork CI monitor call failed in its Slack note
(#77132)
add 8dba9c5dfd6 Speed up Dag imports by loading libcst only when needed
(#77192)
add a2713f36442 UI: Portal MarkAs button tooltips to prevent scrollbar
layout shift (#77172) (#77199)
add 2b5d63c4020 Support Athena managed query results in AthenaHook (#77067)
add 6c64331e41c Let the Athena Spark system test follow default_deferrable
(#77173)
add 0b73e17633c Scope Dags list import errors badge to the selected bundle
(#77186)
add 1ffc5592644 Fix nondeterministic Breeze test collection (#77160)
add 258a0b10498 Unify `queue` parameter on `MessageQueueTrigger` with
trigger queues (#77046)
add 925b1e61bc3 Refresh the Magpie reconciliation stamp (#77102)
add 1e30d3d5a0d Add browser login to airflowctl (#75938)
add 668a7da30ab UI: Add a Triggers page to browse every trigger of every
kind (#76567)
add a58e0d149a1 Migrate type linting from typescript-eslint to oxlint
(#76931)
add 0f2ec8a3c32 Fix FAB userinfo page breaking after viewing a user
(#76473)
add ff4c44289b6 Name the failed task in K8s test assertions (#77144)
add 8894f5be87f Reinstall stale provider UI dependencies when compiling
assets (#75607)
add 1f22663a5ce Remove leftover mapping logic from the Task SDK worker
(#77159)
add 343241ebdaa [main] CI: Upgrade important CI environment
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (42919d1f2e4)
\
N -- N -- N refs/heads/ci-upgrade-main (343241ebdaa)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.apache-magpie.lock | 22 +-
.asf.yaml | 22 +
.github/workflows/ci-amd.yml | 23 +
.github/workflows/ci-arm.yml | 23 +
.github/workflows/java-sdk-release-verify.yml | 4 +-
.pre-commit-config.yaml | 4 +-
Dockerfile | 4 +-
Dockerfile.ci | 6 +-
.../lang-sdk/0016-mapped-tasks-across-lang-sdks.md | 18 +-
.../logging-monitoring/triggers.rst | 29 +-
.../task-and-asset-state-store.rst | 4 +-
.../language-sdks/java.rst | 87 ++
.../language-sdks/typescript.rst | 11 +-
airflow-core/docs/best-practices.rst | 2 +-
.../docs/core-concepts/auth-manager/index.rst | 2 +-
airflow-core/docs/core-concepts/dag-run.rst | 10 +-
.../docs/core-concepts/resumable-tasks.rst | 13 +-
.../docs/core-concepts/task-state-store.rst | 5 +-
airflow-core/docs/migrations-ref.rst | 4 +-
airflow-core/newsfragments/76806.significant.rst | 33 +
.../airflow/api_fastapi/common/parameters/asset.py | 55 +-
.../api_fastapi/common/parameters/trigger.py | 103 +-
.../api_fastapi/core_api/datamodels/dag_run.py | 5 +
.../api_fastapi/core_api/datamodels/trigger.py | 9 +-
.../api_fastapi/core_api/datamodels/ui/common.py | 4 +
.../api_fastapi/core_api/datamodels/ui/deadline.py | 5 +
.../api_fastapi/core_api/openapi/_private_ui.yaml | 27 +
.../core_api/openapi/v2-rest-api-generated.yaml | 84 +-
.../api_fastapi/core_api/routes/public/assets.py | 72 +-
.../api_fastapi/core_api/routes/public/dag_run.py | 2 +
.../core_api/routes/public/task_instances.py | 10 +-
.../api_fastapi/core_api/routes/public/triggers.py | 56 +-
.../airflow/api_fastapi/core_api/routes/ui/dags.py | 34 +-
.../api_fastapi/core_api/routes/ui/dependencies.py | 23 +-
.../src/airflow/api_fastapi/core_api/security.py | 23 +-
.../core_api/services/public/dag_run.py | 2 +
.../core_api/services/public/task_instances.py | 43 +-
.../core_api/services/ui/dependencies.py | 51 +-
.../airflow/api_fastapi/execution_api/AGENTS.md | 9 +
.../execution_api/routes/task_instances.py | 9 +-
airflow-core/src/airflow/cli/cli_config.py | 7 +
.../src/airflow/cli/commands/dag_command.py | 3 +
.../src/airflow/cli/commands/task_command.py | 1 +
.../src/airflow/jobs/scheduler_job_runner.py | 90 +-
.../src/airflow/jobs/triggerer_job_runner.py | 18 +-
...5_0_rename_trigger_owner_ref_to_used_by_ref.py} | 32 +-
airflow-core/src/airflow/models/callback.py | 2 +-
airflow-core/src/airflow/models/taskinstance.py | 69 +-
airflow-core/src/airflow/models/trigger.py | 45 +-
.../src/airflow/serialization/definitions/dag.py | 11 +
airflow-core/src/airflow/ui/.oxlintrc.json | 79 +-
.../src/airflow/ui/openapi-gen/queries/common.ts | 15 +-
.../ui/openapi-gen/queries/ensureQueryData.ts | 22 +-
.../src/airflow/ui/openapi-gen/queries/prefetch.ts | 22 +-
.../src/airflow/ui/openapi-gen/queries/queries.ts | 22 +-
.../src/airflow/ui/openapi-gen/queries/suspense.ts | 22 +-
.../airflow/ui/openapi-gen/requests/schemas.gen.ts | 106 +-
.../ui/openapi-gen/requests/services.gen.ts | 10 +-
.../airflow/ui/openapi-gen/requests/types.gen.ts | 54 +-
airflow-core/src/airflow/ui/package.json | 1 +
airflow-core/src/airflow/ui/pnpm-lock.yaml | 101 +-
.../airflow/ui/public/i18n/locales/en/assets.json | 4 +
.../airflow/ui/public/i18n/locales/en/browse.json | 42 +
.../airflow/ui/public/i18n/locales/en/common.json | 4 +
.../ui/public/i18n/locales/en/components.json | 2 +
.../src/airflow/ui/public/i18n/locales/en/dag.json | 2 +
.../ui/public/i18n/locales/en/dashboard.json | 2 +
airflow-core/src/airflow/ui/rules/typescript.js | 814 +------------
.../ui/src/components/Assets/ListPopover.tsx | 40 +-
.../ui/src/components/Clear/Run/ClearRunButton.tsx | 2 +-
.../components/Clear/Run/ClearRunDialog.test.tsx | 102 ++
.../ui/src/components/Clear/Run/ClearRunDialog.tsx | 43 +-
.../ui/src/components/DagImportErrorDetails.tsx | 2 +-
.../ui/src/components/FailingWatchersChip.test.tsx | 200 ++++
.../ui/src/components/FailingWatchersChip.tsx | 60 +
.../ui/src/components/FailingWatchersModal.tsx | 161 +++
.../ui/src/components/FilterBar/FilterBar.test.tsx | 55 +
.../FilterBar/filters/MultiSelectFilter.tsx | 10 +-
.../FilterBar/filters/MultiSelectPill.tsx | 16 +-
.../src/components/Graph/AssetWatcherNode.test.tsx | 66 ++
.../Graph/{AliasNode.tsx => AssetWatcherNode.tsx} | 36 +-
.../ui/src/components/Graph/elkGraphUtils.test.ts | 24 +
.../ui/src/components/Graph/elkGraphUtils.ts | 4 +
.../airflow/ui/src/components/Graph/graphTypes.ts | 2 +
.../ui/src/components/Graph/reactflowUtils.ts | 2 +
.../src/airflow/ui/src/components/HeaderCard.tsx | 2 +-
.../src/components/MarkAs/Run/MarkRunAsButton.tsx | 1 +
.../MarkAs/TaskGroup/MarkTaskGroupAsButton.tsx | 1 +
.../TaskInstance/MarkTaskInstanceAsButton.tsx | 1 +
.../ui/src/components/TriggerStatusBadge.test.tsx | 49 +
.../ui/src/components/TriggerStatusBadge.tsx | 61 +
.../src/airflow/ui/src/constants/filterConfigs.tsx | 26 +
.../src/airflow/ui/src/constants/searchParams.ts | 3 +
.../src/context/dagsListSearch/Context.ts} | 10 +-
.../dagsListSearch/DagsListSearchProvider.test.tsx | 72 ++
.../dagsListSearch/DagsListSearchProvider.tsx | 56 +
.../{gridSelection => dagsListSearch}/index.ts | 3 +-
.../src/airflow/ui/src/i18n/locales.test.ts | 13 +
.../src/airflow/ui/src/layouts/BaseLayout.tsx | 65 +-
.../DagsLayout.test.tsx} | 30 +-
.../src/airflow/ui/src/layouts/DagsLayout.tsx | 5 +-
.../ui/src/layouts/Details/DetailsLayout.tsx | 2 +
.../Details/Grid/RunTypeLegend.test.tsx} | 16 +-
.../ui/src/layouts/Details/Grid/RunTypeLegend.tsx | 7 +-
.../ui/src/layouts/Nav/BrowseButton.test.tsx | 18 +-
.../airflow/ui/src/layouts/Nav/BrowseButton.tsx | 37 +-
.../airflow/ui/src/layouts/Nav/DagsButton.test.tsx | 12 +
.../src/airflow/ui/src/layouts/Nav/DagsButton.tsx | 3 +
.../src/airflow/ui/src/layouts/Nav/NavButton.tsx | 14 +-
.../src/airflow/ui/src/mocks/handlers/assets.ts | 3 +-
.../src/airflow/ui/src/mocks/handlers/index.ts | 2 +
.../src/airflow/ui/src/mocks/handlers/triggers.ts | 136 +++
.../src/airflow/ui/src/pages/Asset/Header.test.tsx | 35 +-
.../Dag/Backfills/BackfillsDateFilter.test.tsx | 7 +-
.../pages/DagRuns/BulkClearDagRunsButton.test.tsx | 120 ++
.../src/pages/DagRuns/BulkClearDagRunsButton.tsx | 31 +-
.../DagsList/DagsFilters/DagsFilters.test.tsx | 30 +-
.../src/pages/DagsList/DagsFilters/DagsFilters.tsx | 4 -
.../src/airflow/ui/src/pages/DagsList/DagsList.tsx | 7 +-
.../ui/src/pages/DagsList/usePausedDefault.ts | 47 +-
.../Dashboard/Stats/DagImportErrors.test.tsx} | 39 +-
.../src/pages/Dashboard/Stats/DagImportErrors.tsx | 13 +-
.../Dashboard/Stats/DagImportErrorsModal.test.tsx | 18 +
.../pages/Dashboard/Stats/DagImportErrorsModal.tsx | 6 +-
.../pages/Dashboard/Stats/FailingTriggers.test.tsx | 72 ++
.../Dashboard/Stats/FailingTriggers.tsx} | 39 +-
.../Dashboard/Stats/PluginImportErrors.test.tsx} | 36 +-
.../pages/Dashboard/Stats/PluginImportErrors.tsx | 8 +-
.../ui/src/pages/Dashboard/Stats/Stats.test.tsx | 1 +
.../airflow/ui/src/pages/Dashboard/Stats/Stats.tsx | 3 +
.../airflow/ui/src/pages/Run/Callbacks.test.tsx | 26 +
.../src/airflow/ui/src/pages/Run/Callbacks.tsx | 14 +
.../TriggererInfo.test.tsx} | 17 +-
.../ui/src/pages/TaskInstance/TriggererInfo.tsx | 8 +-
.../src/airflow/ui/src/pages/Trigger/Details.tsx | 128 +++
.../airflow/ui/src/pages/Trigger/ScheduledDags.tsx | 49 +
.../airflow/ui/src/pages/Trigger/Trigger.test.tsx | 221 ++++
.../src/airflow/ui/src/pages/Trigger/Trigger.tsx | 112 ++
.../src/airflow/ui/src/pages/Trigger/UsedBy.tsx | 189 +++
.../Breadcrumb => pages/Trigger}/index.ts | 7 +-
.../ui/src/pages/Triggers/TriggerUsedBy.tsx | 65 ++
.../ui/src/pages/Triggers/Triggers.test.tsx | 153 +++
.../src/airflow/ui/src/pages/Triggers/Triggers.tsx | 244 ++++
.../Triggers/TriggersForbidden.tsx} | 22 +-
.../ui/src/pages/Triggers/getScheduledDagIds.ts} | 14 +-
.../Triggers/getTriggerClassName.ts} | 3 +-
.../Details/Graph => pages/Triggers}/index.ts | 3 +-
.../airflow/ui/src/queries/useBulkClearDagRuns.ts | 2 +
airflow-core/src/airflow/ui/src/router.tsx | 16 +
.../airflow/ui/src/system-components/Clipboard.tsx | 28 +-
.../src/airflow/ui/src/utils/useFiltersHandler.ts | 3 +
.../src/airflow/ui/tests/e2e/fixtures/pom.ts | 5 +
.../src/airflow/ui/tests/e2e/global-teardown.ts | 1 +
.../src/airflow/ui/tests/e2e/pages/TriggersPage.ts | 64 ++
.../airflow/ui/tests/e2e/specs/triggers.spec.ts | 74 ++
airflow-core/src/airflow/ui/tsconfig.node.json | 2 -
airflow-core/src/airflow/utils/db.py | 2 +-
airflow-core/tests/unit/api_fastapi/conftest.py | 36 +-
.../core_api/routes/public/test_assets.py | 57 +
.../core_api/routes/public/test_dag_run.py | 39 +
.../core_api/routes/public/test_dags.py | 4 +-
.../core_api/routes/public/test_task_instances.py | 9 +-
.../core_api/routes/public/test_triggers.py | 147 ++-
.../core_api/routes/ui/test_deadlines.py | 19 +
.../core_api/routes/ui/test_dependencies.py | 184 ++-
.../core_api/routes/ui/test_structure.py | 14 +
.../unit/api_fastapi/execution_api/conftest.py | 19 +
.../execution_api/test_task_sdk_client_contract.py | 256 +++++
.../versions/head/test_task_instances.py | 32 +-
.../known_api_server_threadpool_offloads.txt} | 2 +-
.../api_fastapi/known_sync_db_on_event_loop.txt | 37 +
.../unit/api_fastapi/test_event_loop_blocking.py | 234 ++++
.../tests/unit/cli/commands/test_dag_command.py | 23 +-
airflow-core/tests/unit/jobs/test_scheduler_job.py | 686 ++++++++++-
airflow-core/tests/unit/jobs/test_triggerer_job.py | 34 +-
...0157_rename_trigger_owner_ref_to_used_by_ref.py | 112 ++
airflow-core/tests/unit/models/test_callback.py | 4 +-
airflow-core/tests/unit/models/test_cleartasks.py | 53 +
.../tests/unit/models/test_taskinstance.py | 51 +-
airflow-core/tests/unit/models/test_trigger.py | 46 +-
airflow-ctl/docs/images/command_hashes.txt | 2 +-
airflow-ctl/docs/images/output_auth_login.svg | 140 ++-
airflow-ctl/docs/start.rst | 14 +-
airflow-ctl/src/airflowctl/api/client.py | 16 +-
.../airflowctl/api/datamodels/auth_generated.py | 2 +-
.../src/airflowctl/api/datamodels/generated.py | 42 +-
airflow-ctl/src/airflowctl/api/operations.py | 35 +
airflow-ctl/src/airflowctl/ctl/cli_config.py | 55 +-
.../src/airflowctl/ctl/commands/auth_command.py | 93 +-
.../src/airflowctl/ctl/commands/dag_command.py | 1 +
.../src/airflowctl/ctl/utils/browser_login.py | 195 ++++
airflow-ctl/src/airflowctl/exceptions.py | 4 +
airflow-ctl/tests/airflow_ctl/api/test_client.py | 37 +-
.../tests/airflow_ctl/api/test_operations.py | 120 +-
.../airflow_ctl/ctl/commands/test_auth_command.py | 319 ++++++
.../airflow_ctl/ctl/commands/test_dag_command.py | 6 +-
.../tests/airflow_ctl/ctl/test_cli_config.py | 9 +
.../airflow_ctl/ctl/utils/test_browser_login.py | 281 +++++
.../java-native-bundle/gradle.properties | 2 +-
airflow-e2e-tests/java-test-bundle/build.gradle | 1 +
.../java-test-bundle/gradle.properties | 2 +-
.../org/apache/airflow/e2e/TestBundleBuilder.java | 59 +-
.../src/resources/dags/java_test_dags.py | 24 +
airflow-e2e-tests/pyproject.toml | 2 +-
.../basic_tests/test_task_loops.py | 312 +++++
.../dags/example_task_loop_test.py | 125 ++
.../airflow_e2e_tests/e2e_test_utils/clients.py | 22 +
.../java_sdk_tests/test_java_sdk_dag.py | 65 ++
chart/templates/_helpers.yaml | 16 +-
chart/templates/workers/worker-deployment.yaml | 2 +-
chart/templates/workers/worker-kedaautoscaler.yaml | 10 +
.../helm_tests/airflow_aux/test_airflow_common.py | 79 ++
chart/tests/helm_tests/other/test_keda.py | 88 ++
chart/values.schema.json | 32 +
chart/values.yaml | 15 +
dev/README_RELEASE_LANGUAGE_SDKS.md | 432 +++++++
dev/breeze/doc/ci/02_images.md | 2 +-
.../doc/ci/08_fork_ci_for_external_contributors.md | 6 +-
.../commands/release_management_commands.py | 2 +-
.../files/hardened_os_deps_image_digests.json | 24 +-
.../files/hardened_python_image_digests.json | 8 +-
dev/breeze/src/airflow_breeze/global_constants.py | 2 +-
.../src/airflow_breeze/utils/fork_ci_reconcile.py | 34 +-
dev/breeze/tests/test_docker_command_utils.py | 4 +-
dev/breeze/tests/test_fork_ci_reconcile.py | 50 +-
dev/breeze/uv.lock | 126 +-
devel-common/pyproject.toml | 2 +-
.../tests_common/test_utils/common_msg_queue.py | 2 +-
docs/spelling_wordlist.txt | 1 +
go-sdk/DEVELOPMENT.md | 101 ++
java-sdk/DEVELOPMENT.md | 257 +----
java-sdk/README.md | 2 +-
java-sdk/gradle.properties | 2 +-
.../org/apache/airflow/sdk/AirflowProcessor.kt | 145 ++-
.../org/apache/airflow/sdk/AirflowProcessorTest.kt | 525 +++++++++
java-sdk/sdk/build.gradle.kts | 46 +
.../main/kotlin/org/apache/airflow/sdk/Context.kt | 62 +-
.../main/kotlin/org/apache/airflow/sdk/DagDef.kt | 1 +
.../main/kotlin/org/apache/airflow/sdk/Server.kt | 51 +-
.../kotlin/org/apache/airflow/sdk/StoppableTask.kt | 94 ++
.../apache/airflow/sdk/execution/Cancellation.kt | 190 +++
.../org/apache/airflow/sdk/execution/Comm.kt | 18 +-
.../org/apache/airflow/sdk/execution/Logger.kt | 205 +++-
.../org/apache/airflow/sdk/execution/Task.kt | 18 +-
.../kotlin/org/apache/airflow/sdk/ContextTest.kt | 14 +
.../kotlin/org/apache/airflow/sdk/ServerTest.kt | 1093 ++++++++++++++++++
.../airflow/sdk/execution/CancellationTest.kt | 327 ++++++
.../org/apache/airflow/sdk/execution/CommTest.kt | 88 ++
.../apache/airflow/sdk/execution/LogSenderTest.kt | 767 +++++++++++++
.../org/apache/airflow/sdk/execution/TaskTest.kt | 72 +-
.../lang_sdk/java_example/gradle.properties | 2 +-
kubernetes-tests/lang_sdk/ts_example/package.json | 2 +-
.../tests/kubernetes_tests/test_base.py | 48 +-
providers/amazon/README.rst | 4 +-
providers/amazon/docs/index.rst | 4 +-
.../amazon/docs/operators/athena/athena_spark.rst | 6 -
providers/amazon/pyproject.toml | 4 +-
.../airflow/providers/amazon/aws/hooks/athena.py | 18 +-
.../providers/amazon/aws/operators/athena.py | 10 +-
.../providers/amazon/aws/operators/neptune.py | 74 +-
.../providers/amazon/aws/transfers/sql_to_s3.py | 13 +-
.../system/amazon/aws/example_athena_spark.py | 13 -
.../tests/unit/amazon/aws/hooks/test_athena.py | 51 +
.../unit/amazon/aws/transfers/test_sql_to_s3.py | 45 +-
providers/celery/docs/changelog.rst | 7 +
providers/celery/provider.yaml | 4 +-
.../providers/celery/executors/default_celery.py | 23 +-
.../airflow/providers/celery/get_provider_info.py | 2 +-
.../unit/celery/executors/test_celery_executor.py | 58 +-
.../unit/celery/executors/test_default_celery.py | 15 +-
providers/cncf/kubernetes/docs/changelog.rst | 11 +
.../providers/cncf/kubernetes/hooks/kubernetes.py | 8 +-
.../unit/cncf/kubernetes/hooks/test_kubernetes.py | 43 +-
providers/common/ai/docs/agent_security.rst | 5 +-
.../ai/docs/toolsets/progressive_disclosure.rst | 3 +-
providers/common/ai/docs/toolsets/sql.rst | 232 +++-
providers/common/ai/pyproject.toml | 4 +-
.../airflow/providers/common/ai/toolsets/sql.py | 203 +++-
.../providers/common/ai/utils/query_results.py | 86 +-
.../providers/common/ai/utils/sql_search.py | 85 ++
.../unit/common/ai/toolsets/test_datafusion.py | 5 +
.../ai/tests/unit/common/ai/toolsets/test_sql.py | 452 +++++++-
.../unit/common/ai/utils/test_query_results.py | 101 ++
.../tests/unit/common/ai/utils/test_sql_search.py | 70 ++
providers/common/messaging/docs/changelog.rst | 8 +
providers/common/messaging/docs/triggers.rst | 5 +
.../common/messaging/triggers/msg_queue.py | 54 +-
.../common/messaging/triggers/test_msg_queue.py | 78 +-
.../src/airflow/providers/common/sql/hooks/sql.py | 35 +
.../src/airflow/providers/common/sql/hooks/sql.pyi | 4 +
.../sql/tests/unit/common/sql/hooks/test_sql.py | 60 +
providers/dbt/cloud/docs/operators.rst | 38 +
providers/dbt/cloud/pyproject.toml | 2 +-
.../airflow/providers/dbt/cloud/operators/dbt.py | 180 ++-
.../tests/unit/dbt/cloud/operators/test_dbt.py | 235 +++-
.../fab/auth_manager/api_fastapi/routes/login.py | 35 +-
.../fab/auth_manager/api_fastapi/routes/roles.py | 17 +-
.../fab/auth_manager/api_fastapi/routes/users.py | 15 +-
.../fab/auth_manager/cli_commands/user_command.py | 5 +-
.../fab/auth_manager/security_manager/override.py | 41 +-
.../providers/fab/auth_manager/views/user.py | 10 +-
.../fab/src/airflow/providers/fab/www/package.json | 8 +-
.../src/airflow/providers/fab/www/pnpm-lock.yaml | 762 +++++++------
.../api_fastapi/routes/test_session_release.py | 117 ++
.../auth_manager/cli_commands/test_user_command.py | 28 +
.../auth_manager/security_manager/test_override.py | 161 +++
.../tests/unit/fab/auth_manager/test_security.py | 9 +-
.../tests/unit/fab/auth_manager/views/test_user.py | 36 +
providers/hashicorp/docs/index.rst | 2 +-
providers/hashicorp/pyproject.toml | 2 +-
.../docs/auth-manager/manage/permissions.rst | 29 +
providers/keycloak/provider.yaml | 12 +
.../providers/keycloak/auth_manager/constants.py | 2 +
.../keycloak/auth_manager/keycloak_auth_manager.py | 229 ++--
.../providers/keycloak/auth_manager/middleware.py | 30 +
.../keycloak/auth_manager/routes/login.py | 22 +-
.../providers/keycloak/get_provider_info.py | 7 +
.../keycloak/auth_manager/routes/test_login.py | 103 ++
.../auth_manager/test_keycloak_auth_manager.py | 91 ++
.../unit/keycloak/auth_manager/test_middleware.py | 157 ++-
providers/microsoft/azure/README.rst | 2 +-
providers/microsoft/azure/docs/changelog.rst | 8 +
providers/microsoft/azure/docs/index.rst | 2 +-
.../azure/docs/operators/adf_run_pipeline.rst | 28 +
providers/microsoft/azure/pyproject.toml | 2 +-
.../microsoft/azure/operators/data_factory.py | 78 +-
.../microsoft/azure/triggers/data_factory.py | 7 +-
.../microsoft/azure/operators/test_data_factory.py | 149 ++-
.../unit/microsoft/azure/operators/test_powerbi.py | 15 +-
.../azure/tests/unit/microsoft/azure/test_utils.py | 13 +
.../microsoft/azure/triggers/test_data_factory.py | 16 +-
pyproject.toml | 2 +-
scripts/ci/prek/check_imports_in_providers.py | 2 +-
scripts/ci/prek/compile_provider_assets.py | 2 +-
scripts/ci/prek/extract_permissions.py | 2 +-
scripts/ci/prek/ruff_format.py | 2 +-
.../ci/prek/validate_operators_init_exemptions.txt | 2 -
.../tests/ci/prek/test_compile_provider_assets.py | 6 +-
scripts/tools/setup_breeze | 2 +-
.../src/airflow_shared/module_loading/__init__.py | 21 +-
.../tests/module_loading/test_entry_points.py | 45 +-
.../tests/plugins_manager/test_plugins_manager.py | 10 +-
task-sdk/docs/api.rst | 2 +
task-sdk/docs/resumable-job-mixin.rst | 35 +-
task-sdk/docs/ts-bundle-spec.rst | 2 +-
task-sdk/src/airflow/sdk/__init__.py | 4 +-
task-sdk/src/airflow/sdk/__init__.pyi | 6 +-
.../src/airflow/sdk/api/datamodels/_generated.py | 2 +-
.../src/airflow/sdk/bases/resumablejobmixin.py | 154 +--
.../sdk/definitions/_internal/decorators.py | 64 +-
.../sdk/definitions/_internal/expandinput.py | 33 +-
task-sdk/src/airflow/sdk/definitions/xcom_arg.py | 80 +-
.../src/airflow/sdk/execution_time/task_runner.py | 5 -
.../tests/task_sdk/bases/test_resumablejobmixin.py | 59 +
.../definitions/_internal/test_decorators.py | 18 +
.../tests/task_sdk/definitions/test_xcom_arg.py | 37 +-
ts-sdk/DEVELOPMENT.md | 134 ++-
ts-sdk/README.md | 4 +-
ts-sdk/docs/index.md | 8 +-
ts-sdk/docs/package-lock.json | 4 +-
ts-sdk/docs/package.json | 2 +-
ts-sdk/docs/tests/deployment-checks.test.mjs | 4 +-
ts-sdk/example/package.json | 2 +-
ts-sdk/package.json | 5 +-
ts-sdk/src/coordinator/client.ts | 71 +-
ts-sdk/src/sdk/client-types.ts | 27 +-
ts-sdk/src/sdk/client.ts | 11 +-
ts-sdk/tests/coordinator/client.test.ts | 70 +-
ts-sdk/tests/public-api.test.ts | 12 +-
uv.lock | 1206 ++++++++++----------
370 files changed, 18199 insertions(+), 3731 deletions(-)
create mode 100644 airflow-core/newsfragments/76806.significant.rst
copy
airflow-core/src/airflow/migrations/versions/{0002_2_7_0_add_custom_operator_name_column.py
=> 0157_3_5_0_rename_trigger_owner_ref_to_used_by_ref.py} (59%)
create mode 100644
airflow-core/src/airflow/ui/src/components/Clear/Run/ClearRunDialog.test.tsx
create mode 100644
airflow-core/src/airflow/ui/src/components/FailingWatchersChip.test.tsx
create mode 100644
airflow-core/src/airflow/ui/src/components/FailingWatchersChip.tsx
create mode 100644
airflow-core/src/airflow/ui/src/components/FailingWatchersModal.tsx
create mode 100644
airflow-core/src/airflow/ui/src/components/Graph/AssetWatcherNode.test.tsx
copy airflow-core/src/airflow/ui/src/components/Graph/{AliasNode.tsx =>
AssetWatcherNode.tsx} (55%)
create mode 100644
airflow-core/src/airflow/ui/src/components/TriggerStatusBadge.test.tsx
create mode 100644
airflow-core/src/airflow/ui/src/components/TriggerStatusBadge.tsx
copy
airflow-core/src/airflow/{api_fastapi/auth/managers/simple/ui/rules/levels.js
=> ui/src/context/dagsListSearch/Context.ts} (81%)
create mode 100644
airflow-core/src/airflow/ui/src/context/dagsListSearch/DagsListSearchProvider.test.tsx
create mode 100644
airflow-core/src/airflow/ui/src/context/dagsListSearch/DagsListSearchProvider.tsx
copy airflow-core/src/airflow/ui/src/context/{gridSelection =>
dagsListSearch}/index.ts (95%)
copy airflow-core/src/airflow/ui/src/{components/StatsCard.test.tsx =>
layouts/DagsLayout.test.tsx} (61%)
copy airflow-core/src/airflow/ui/src/{utils/isOneOf.test.ts =>
layouts/Details/Grid/RunTypeLegend.test.tsx} (63%)
create mode 100644 airflow-core/src/airflow/ui/src/mocks/handlers/triggers.ts
create mode 100644
airflow-core/src/airflow/ui/src/pages/DagRuns/BulkClearDagRunsButton.test.tsx
copy airflow-core/src/airflow/ui/src/{components/StatsCard.test.tsx =>
pages/Dashboard/Stats/DagImportErrors.test.tsx} (53%)
create mode 100644
airflow-core/src/airflow/ui/src/pages/Dashboard/Stats/FailingTriggers.test.tsx
copy
airflow-core/src/airflow/ui/src/{components/DataTable/ToggleTableDisplay.tsx =>
pages/Dashboard/Stats/FailingTriggers.tsx} (50%)
copy airflow-core/src/airflow/ui/src/{components/StatsCard.test.tsx =>
pages/Dashboard/Stats/PluginImportErrors.test.tsx} (55%)
copy
airflow-core/src/airflow/ui/src/pages/{Connections/NothingFoundInfo.test.tsx =>
TaskInstance/TriggererInfo.test.tsx} (64%)
create mode 100644 airflow-core/src/airflow/ui/src/pages/Trigger/Details.tsx
create mode 100644
airflow-core/src/airflow/ui/src/pages/Trigger/ScheduledDags.tsx
create mode 100644
airflow-core/src/airflow/ui/src/pages/Trigger/Trigger.test.tsx
create mode 100644 airflow-core/src/airflow/ui/src/pages/Trigger/Trigger.tsx
create mode 100644 airflow-core/src/airflow/ui/src/pages/Trigger/UsedBy.tsx
copy airflow-core/src/airflow/ui/src/{components/Breadcrumb =>
pages/Trigger}/index.ts (88%)
create mode 100644
airflow-core/src/airflow/ui/src/pages/Triggers/TriggerUsedBy.tsx
create mode 100644
airflow-core/src/airflow/ui/src/pages/Triggers/Triggers.test.tsx
create mode 100644 airflow-core/src/airflow/ui/src/pages/Triggers/Triggers.tsx
copy airflow-core/src/airflow/ui/src/{layouts/Nav/LanguageModal.tsx =>
pages/Triggers/TriggersForbidden.tsx} (65%)
copy airflow-core/{docs/static/redirects.js =>
src/airflow/ui/src/pages/Triggers/getScheduledDagIds.ts} (68%)
copy airflow-core/src/airflow/ui/src/{components/ActionAccordion/index.tsx =>
pages/Triggers/getTriggerClassName.ts} (80%)
copy airflow-core/src/airflow/ui/src/{layouts/Details/Graph =>
pages/Triggers}/index.ts (95%)
create mode 100644 airflow-core/src/airflow/ui/tests/e2e/pages/TriggersPage.ts
create mode 100644 airflow-core/src/airflow/ui/tests/e2e/specs/triggers.spec.ts
create mode 100644
airflow-core/tests/unit/api_fastapi/execution_api/test_task_sdk_client_contract.py
copy airflow-core/{src/airflow/api/common/__init__.py =>
tests/unit/api_fastapi/known_api_server_threadpool_offloads.txt} (87%)
create mode 100644
airflow-core/tests/unit/api_fastapi/known_sync_db_on_event_loop.txt
create mode 100644
airflow-core/tests/unit/api_fastapi/test_event_loop_blocking.py
create mode 100644
airflow-core/tests/unit/migrations/test_0157_rename_trigger_owner_ref_to_used_by_ref.py
create mode 100644 airflow-ctl/src/airflowctl/ctl/utils/browser_login.py
create mode 100644
airflow-ctl/tests/airflow_ctl/ctl/utils/test_browser_login.py
create mode 100644
airflow-e2e-tests/tests/airflow_e2e_tests/basic_tests/test_task_loops.py
create mode 100644
airflow-e2e-tests/tests/airflow_e2e_tests/dags/example_task_loop_test.py
create mode 100644 dev/README_RELEASE_LANGUAGE_SDKS.md
create mode 100644
java-sdk/sdk/src/main/kotlin/org/apache/airflow/sdk/StoppableTask.kt
create mode 100644
java-sdk/sdk/src/main/kotlin/org/apache/airflow/sdk/execution/Cancellation.kt
create mode 100644
java-sdk/sdk/src/test/kotlin/org/apache/airflow/sdk/execution/CancellationTest.kt
create mode 100644
java-sdk/sdk/src/test/kotlin/org/apache/airflow/sdk/execution/LogSenderTest.kt
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/utils/sql_search.py
create mode 100644
providers/common/ai/tests/unit/common/ai/utils/test_sql_search.py
create mode 100644
providers/fab/tests/unit/fab/auth_manager/api_fastapi/routes/test_session_release.py