This is an automated email from the ASF dual-hosted git repository.
jason810496 pushed a change to branch jason/lang-sdk-e2e/07-java-sdk
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 249bbde1892 Java SDK: Pack each native Dag's source file into the
bundle JAR
discard 3c70a840f74 Java SDK: Record the class that declares each Dag and
describe it on request
discard e1152b21003 Java SDK: Serialize native Dags to DagSerialization v3 on
parse requests
discard f89b14bfa2d Java SDK: Declare a Dag's task graph with @Builder.Deps
discard 4e95890eb1b TS SDK: add triggerDagRun to the native Dag surface
discard 8135a770e55 TS SDK: add multi-way branching with dag.switch
discard 67265f632eb TS SDK: add conditional branching with dag.if
omit 82232048474 Stub Dag file discovery with DagFileInfo in the Lang-SDK
manager tests
omit cc3bd5c4164 Handle Dags nested at any depth in Dag archives
omit 25da3489de0 Migrating from filepath based Dag to DagDefinition
discovery
omit 6167d99ee05 Hand out the Node Dag importer through get_dag_importer
omit f4e0fb92c39 Pin the Code view to the entry module in Node bundle tests
omit 17714c8d2a8 Let NodeDagImporter source read errors reach the caller
omit 64743c38768 Import NodeDagImporter at the top of the Node coordinator
omit 4fead1b372c Warn against defining a Dag in both TypeScript and Python
omit 97b8d05b9b3 Align the TypeScript build docs with the Code view
omit 5ab90091a46 Say when the Dag processor needs Node.js for TypeScript
bundles
omit 55187c1eed0 Run a native TypeScript Dag's task from its own bundle
omit 74de1024b9b Share the bundle section mutation helper between Node tests
omit 6cb30660a5c Document parsing native TypeScript Dags
omit e4d42721628 Parse native TypeScript Dags with the Node coordinator
omit ffa20db10b2 Read Java Dag sources from the bundle's sources.json index
omit 1a83691279b Hand out the Java Dag importer through get_dag_importer
omit f04c85ec677 Keep the Java parse_dag test from changing the pytest
worker
omit 44df95f0f29 Stop promising that Java dependency JARs are not parsed
omit e8ed427d8e0 Reject a Java Dag JAR whose SDK cannot answer a parse
omit 3789dca6483 Run the JAR a native Java Dag was parsed from
omit 296625064c6 Report why a Java Dag JAR cannot be read
omit 04079e6b472 Pass the task's Dag file to the coordinator's command
builder
omit 72c27be559e Run a task on its run's version when dag_bundle_name names
its bundle
omit 606f57b5eb4 Document native Java Dag parsing
omit 8aadc5dc059 Name the JAR manifest attributes the Java coordinator reads
omit 268bb0f300e Test the Java Dag source placeholder for a JAR without a
manifest
omit 2c97b771a29 Treat an unreadable JAR like one without a manifest
omit e2821c281e2 Parse native Java Dags with their coordinator
omit a72469e307f Build the JVM command that parses a Dag JAR
omit 78099b8d9be Read JAR manifests per the JAR specification
omit 964f50b5f99 Let a Dag file processor run without a parse log file
omit a3bb832b891 Ignore the bagged Dag union in the external task sensor
test
omit 73f9d12a649 List the tasks of a native Lang-SDK Dag
omit fc9599900c5 Bag native Lang-SDK Dags in core, only when asked
omit 5501436667c Let a Dag file processor run without an API client
omit 8b7d78fdba5 Parse coordinator-claimed Dag files with their runtime in
a Dag bag
omit 22c2b156c13 Pass a parse log handle to the Lang-SDK processor in tests
omit 91e12cdf26a Find a native Dag's coordinator key through its importer
omit f978d579bdf Wait for the killed leftover in the Lang-SDK processor test
omit 1f7f2ae6245 Move the client-less Lang-SDK parse out of this change
omit 6366a8b229b Note in ADR-0010 that the manager routes claimed files for
now
omit 680f7db3cee Clear import errors after the native-file Dag bag sync test
omit 808f66c1371 Apply the multi-team task checks to Lang-SDK Dags
omit 403db14ca2b Spec the mocks of a hand-built Lang-SDK processor in tests
omit 9ef78a997b4 Name the setting in a Lang-SDK parse timeout error
omit 5d8cc694c2e Kill what a Lang-SDK runtime leaves in its process group
omit 2bdae62a32f Match the schema error's JSON path in a Lang-SDK parse test
omit d7684f3c95b Build each bundle's Dag importer registry before freezing
the heap
omit c64fbd6eca3 Fail a native Dag's task on a Python worker without retries
omit 2ec5a41e906 Find the claiming coordinator in the Task SDK and wrap it
in core
omit ff51e1d85a9 Start each Dag file processor with explicit arguments
omit 9acc7abea12 Drop callbacks for Lang-SDK Dag files before queuing the
file
omit 0736d24c011 Report a native Dag's task that reaches a Python worker
omit 8eab3c08506 Report a Lang-SDK parse past its import timeout as an
import error
omit 30cae48ebc8 Parse coordinator-claimed Dag files with their runtime in
the Dag processor
omit 63a5cd3a808 Explain dag_bundle_name by the coordinator that parses a
Dag file
omit 88b80ff7c67 Hand out a coordinator's Dag importer through
get_dag_importer alone
omit 89df05be5ea Say dag_bundle_name is only needed for two coordinators of
one class
omit 38d9f574563 Drop serves_bundle so get_parsed_bundles is the only answer
omit e2870bfa309 Check Dag file claims per bundle on the parse path
omit 51a30974ca1 Import the coordinator manager at the top of the importer
base
omit aba8fbb4439 Let a coordinator parse the Dag files of the bundles it
serves
omit c930dd6c297 Sync the Go SDK copy of the Dag schema
omit 4f3cecbd67d Sync the Java SDK copy of the Dag schema
omit f1791c6a224 Serialize the SDK Dag in tests that write a dag_maker Dag
omit ea4f7637ad9 Note in the parsing ADR that runtimes may omit
config-backed fields
omit 5c5ec770319 Check SDK Dags with the Dag processor's validation in
conformance
omit e154d35e338 Reject malformed task entries in a serialized Dag
omit 7211bbe7d58 Fill a serialized Dag's unset settings from the Airflow
config
omit 87b4b9c9fa3 Check that a serialized Dag can be stored and loaded
omit 9024fcd611a Keep the parse log handle required on the base Dag file
processor
omit 66508dba3c2 Move the Dag file processor's shared plumbing into a base
class
add bc15e1093b5 Close German Translation Gaps 2026-10-02 (#74088)
add 3045451b8b0 Treat an empty Dag run config as no config in the UI
(#74083)
add c31888641b1 Persist the match-anywhere search toggle in the URL
(#74019)
add 4803c0b3f79 Discover Dag definitions through the Task SDK importers
(#74020)
add f5283f3da9b Move the Dag file processor's shared plumbing into a base
class (#74040)
add e3dd28607b9 Document team-scoped plugins in multi-team mode (#73995)
add b62299ced8a Cap microsoft-kiota-http below 1.13 in the Microsoft Azure
provider (#74090)
add d7b672f44e0 Update docs and diagrams for the Airflow 3 Dag processor
(#74073)
add ec5b621a9cc Prepare ad-hoc providers release 2026-10-02 (#74097)
add 7800fc44c07 Fix scheduler crash on restart with queued or running Edge
tasks (#73832)
add 49a52987956 Stop version-check hooks from clobbering the committing
worktree's index (#74115)
add d7b88f36197 UI: Fix external plugin nav links not navigating on click
(#73913)
add 66d751bfd22 Skip already-released providers in
update-providers-next-version (#74098)
add 04194b1de1f Fix flaky Kafka trigger tests by awaiting the event
instead of a fixed sleep (#74124)
add 4c0ba9e41da Make Edge executor adoption test immune to executor_loader
reloads (#74122)
add 7a8ce83f385 Go SDK: reject a task function whose last result type is
not error (#74077)
add 9c14681a4a0 Add create and update support to Snowflake Cortex Agent
hook (#70703)
add e029fcef2bb Bump the registry-security-updates group across 1
directory with 3 updates (#74099)
add da28f1fcac4 Bump the auth-ui-package-updates group across 1 directory
with 5 updates (#74101)
add 971e8db54ea Bump the edge-ui-package-updates group across 1 directory
with 12 updates (#74107)
add 536f535d9dd Bump the core-ui-package-updates group across 1 directory
with 12 updates (#74105)
add 95826e38547 Bump the uv-dependency-updates group in /dev/breeze with 3
updates (#74100)
add df76e2e0d5e Bump the ui-plugin-template-package-updates group across 1
directory with 7 updates (#74102)
add 954d21df92d Bump vitest from 4.1.7 to 5.0.1 in /ts-sdk (#73483)
add 0adf1378017 Bump swagger-ui-dist from 5.32.15 to 5.33.0 in /registry
(#73480)
add e37a39aa34e Bump pyjwt from 2.14.0 to 2.15.0 in /dev/breeze (#73969)
add da53196d812 Time-box and retry pre-extras SDK downloads (#71544)
add 232c264968f Deprecate Dataproc ClusterGenerator helper class (#71427)
add b9c52951378 Create GCS folder markers as directories in
GCSToSFTPOperator (#73880)
add 91353550246 Honor download_num_attempts and upload_num_attempts in
GCSTimeSpanFileTransformOperator (#72953)
add 02f2c852c80 Shrink the CI image by skipping unused Rust docs and the
Go archive (#74076)
add 5523443d98c Set end date and duration on tasks skipped by a Dag run
timeout (#74128)
add 0f3a356e768 Add a user setting for the default search match mode
(#74021)
add 12ee0862774 Carry task attempt UUIDs through remote executor providers
(#73917)
add 867327c48dd Run only the tests that import a changed test helper
(#74055)
add da5af33fd02 Create the Athena Spark work group and results bucket in
the system test (#73929)
add c011b5960ac Install ibmmq from a wheel in IBM MQ lowest-dependency
tests (#74132)
add 855a2ce92f9 Isolate Edge job state by task attempt UUID (#73918)
add 79de1d48039 Fix `refresh_from_task` not applied on retries (#65932)
add bf558f6f29a Go SDK: add dag.If with Then and Else so native Dags can
branch (#74075)
add d21496f7581 Fetch existing task instances in instead of rebuilding
them in tests (#74146)
add 11d25a587ac Run leaking provider tests with providers changed after
them in CI (#74123)
add a89208e5405 Bump the github-actions-updates group across 1 directory
with 5 updates (#74110)
add 4ae133cd807 Bump @chakra-ui/react from 3.36.1 to 3.37.0 in
/airflow-core/src/airflow/ui (#72524)
add 484a87b54bc Add get_async_extra_dejson to the common.compat connection
helpers (#74147)
add e4736b46968 Pass ClientTimeout to aiohttp in Cloud Composer async hook
(#74164)
add f070997ba63 Go SDK: order tasks with Before, After and Label (#74119)
add b5e58c96bb4 Check that a serialized Dag can be stored and loaded
add 5bd6db26da1 Fill a serialized Dag's unset settings from the Airflow
config
add 9ee09fe33c2 Reject malformed task entries in a serialized Dag
add b44ff24cdb1 Check SDK Dags with the Dag processor's validation in
conformance
add 6866e98d3b0 Note in the parsing ADR that runtimes may omit
config-backed fields
add 8659361cd63 Serialize the SDK Dag in tests that write a dag_maker Dag
add 340063d8a97 Sync the Java SDK copy of the Dag schema
add c3113a96e4f Sync the Go SDK copy of the Dag schema
add 962acf2c16b Check a serialized Dag as the SDK Dag is checked and
return it
add 25b751285b7 Let a coordinator parse the Dag files of the bundles it
serves
add 1627decb9c5 Import the coordinator manager at the top of the importer
base
add 580781113f1 Check Dag file claims per bundle on the parse path
add 0f9651cd1d0 Drop serves_bundle so get_parsed_bundles is the only answer
add 5c266f4ed45 Say dag_bundle_name is only needed for two coordinators of
one class
add 1116deb6088 Hand out a coordinator's Dag importer through
get_dag_importer alone
add e781bd36a9d Explain dag_bundle_name by the coordinator that parses a
Dag file
add 52ded1289ac Find a Dag importer's coordinator from its class
add def439999a4 Say dag_bundle_name only names the stub task artifact
bundle
add cf492837534 Describe how a Dag importer finds its coordinator in
ADR-0010
add 003bfdaf617 Add a newsfragment for the removed coordinator artifact
roots
add f611b22c5d2 Say which failures fall back to a Python file in ADR-0010
add b9fcd4587b5 Break the new dag_bundle_name docs only at sentence ends
add 257e8c4d62f Parse coordinator-claimed Dag files with their runtime in
the Dag processor
add 0d7d8acdbe2 Report a Lang-SDK parse past its import timeout as an
import error
add 9f9efebc21a Report a native Dag's task that reaches a Python worker
add ba164a7f269 Drop callbacks for Lang-SDK Dag files before queuing the
file
add 58a1d752eb3 Start each Dag file processor with explicit arguments
add 79f3641e038 Find the claiming coordinator in the Task SDK and wrap it
in core
add 8207cfa68ef Fail a native Dag's task on a Python worker without retries
add 398f525e716 Match the schema error's JSON path in a Lang-SDK parse test
add 0dfd09a03c4 Kill what a Lang-SDK runtime leaves in its process group
add 98ed7c85083 Name the setting in a Lang-SDK parse timeout error
add 5e8be2de430 Spec the mocks of a hand-built Lang-SDK processor in tests
add e2fcdf9b3bd Apply the multi-team task checks to Lang-SDK Dags
add 11984e80e6e Clear import errors after the native-file Dag bag sync test
add 9c0dcdeaf8e Note in ADR-0010 that the manager routes claimed files for
now
add 0c33b14bf2c Move the client-less Lang-SDK parse out of this change
add 5ecad16b60b Wait for the killed leftover in the Lang-SDK processor test
add c7fbb065e8f Find a native Dag's coordinator key through its importer
add cfb9d230320 Pass a parse log handle to the Lang-SDK processor in tests
add c5e474438cf Stub Dag file discovery with DagFileInfo in the Lang-SDK
manager tests
add 6ecdfd2569b Name the coordinator class a native Dag task must be
routed to
add c6b30d95c4b Find a claiming Dag importer instead of its coordinator in
Dag processing
add 0d082d04877 Test the import errors of a bundle with several
coordinators of a class
add 031530130df Apply the team rules to the Dag that validation returns
add a2d4c67346d Parse coordinator-claimed Dag files with their runtime in
a Dag bag
add a7e12f14454 Let a Dag file processor run without an API client
add 7d29be11930 Bag native Lang-SDK Dags in core, only when asked
add 47f96439015 List the tasks of a native Lang-SDK Dag
add 1eed2e3c99b Ignore the bagged Dag union in the external task sensor
test
add ab169413c42 Let a Dag file processor run without a parse log file
add fe5a99ca14b Default a Dag file processor's parse log to os.devnull
add 0896b0bebf0 Read JAR manifests per the JAR specification
add b109ab2653f Build the JVM command that parses a Dag JAR
add ec4cf0244fe Parse native Java Dags with their coordinator
add 59a2da47776 Treat an unreadable JAR like one without a manifest
add 69e8733bcc1 Test the Java Dag source placeholder for a JAR without a
manifest
add c2d936e16b1 Name the JAR manifest attributes the Java coordinator reads
add f17eb2b1bf4 Document native Java Dag parsing
add 58f41c52736 Run a task on its run's version when dag_bundle_name names
its bundle
add dc422bae77f Pass the task's Dag file to the coordinator's command
builder
add 04c2f7c895f Report why a Java Dag JAR cannot be read
add 7473892cf33 Run the JAR a native Java Dag was parsed from
add 10a9287deb8 Reject a Java Dag JAR whose SDK cannot answer a parse
add a547e197f60 Stop promising that Java dependency JARs are not parsed
add caf65f05d2f Keep the Java parse_dag test from changing the pytest
worker
add 99014526fbc Hand out the Java Dag importer through get_dag_importer
add 358c61edc21 Read Java Dag sources from the bundle's sources.json index
add d888ce5765c Let the Java Dag importer find its coordinator
add 8c439799d9a Fail a task cleanly when its runtime cannot be launched
add 30e3bdf5cbc Run a native Dag's task from its own Dag file
add 59d1af63d80 Fail a native task cleanly when its file or coordinator
class cannot load
add 1eab5e1669e Say tasks list runs a native Java Dag's main class
add ef57bfa95e0 Parse native TypeScript Dags with the Node coordinator
add 2d4dedcc848 Document parsing native TypeScript Dags
add 0c178ae252a Share the bundle section mutation helper between Node tests
add a98180993e1 Run a native TypeScript Dag's task from its own bundle
add 41b2b00e76d Say when the Dag processor needs Node.js for TypeScript
bundles
add 62d8468d0a8 Align the TypeScript build docs with the Code view
add f6a5a080e4b Warn against defining a Dag in both TypeScript and Python
add 0c5d56cdf87 Import NodeDagImporter at the top of the Node coordinator
add a8419c066f2 Let NodeDagImporter source read errors reach the caller
add 2790c76e8fa Pin the Code view to the entry module in Node bundle tests
add 92148664518 Hand out the Node Dag importer through get_dag_importer
add 74c44c27df6 Let the Node Dag importer find its coordinator
add 00a85e05a36 Run a native TypeScript Dag's own bundle through the
native task branch
add e8b8ba161c2 Document how a NodeCoordinator is picked for parsing
TypeScript Dags
add a51934c9855 Say tasks list runs a native TypeScript Dag's bundle
add 57787e9bab9 TS SDK: add conditional branching with dag.if
add 3e214970cbb TS SDK: add multi-way branching with dag.switch
add d1ce32754b7 TS SDK: add triggerDagRun to the native Dag surface
add e3da52f4682 Java SDK: Declare a Dag's task graph with @Builder.Deps
add 490899870ff Java SDK: Serialize native Dags to DagSerialization v3 on
parse requests
add 3a9ac853727 Java SDK: Record the class that declares each Dag and
describe it on request
add 80f5c85f2cc Java SDK: Pack each native Dag's source file into the
bundle JAR
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (249bbde1892)
\
N -- N -- N refs/heads/jason/lang-sdk-e2e/07-java-sdk
(80f5c85f2cc)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../prepare-providers-documentation/SKILL.md | 6 +-
.github/workflows/ci-notification.yml | 2 +-
.github/workflows/codeql-analysis.yml | 6 +-
.github/workflows/java-sdk-dependency-security.yml | 6 +-
.github/workflows/notify-uv-lock-conflicts.yml | 2 +-
.github/workflows/registry-tests.yml | 2 +-
.../scheduled-verify-release-calendar.yml | 2 +-
Dockerfile | 5 +-
Dockerfile.ci | 7 +-
.../adr/lang-sdk/0010-native-dag-processing.md | 107 +-
.../cluster-policies.rst | 11 +-
.../modules_management.rst | 2 +-
.../docs/administration-and-deployment/plugins.rst | 172 +-
.../authoring-and-scheduling/language-sdks/go.rst | 21 +-
.../language-sdks/java.rst | 66 +-
.../language-sdks/typescript.rst | 96 +-
airflow-core/docs/best-practices.rst | 10 +-
airflow-core/docs/core-concepts/dags.rst | 6 +-
airflow-core/docs/core-concepts/multi-team.rst | 16 +-
airflow-core/docs/core-concepts/overview.rst | 4 +-
.../img/diagram_basic_airflow_architecture.md5sum | 2 +-
.../img/diagram_basic_airflow_architecture.png | Bin 116194 -> 127853
bytes
.../docs/img/diagram_basic_airflow_architecture.py | 9 +-
...agram_dag_processor_airflow_architecture.md5sum | 2 +-
.../diagram_dag_processor_airflow_architecture.png | Bin 237657 -> 237572
bytes
.../diagram_dag_processor_airflow_architecture.py | 23 +-
...diagram_distributed_airflow_architecture.md5sum | 2 +-
.../diagram_distributed_airflow_architecture.png | Bin 192497 -> 215541
bytes
.../diagram_distributed_airflow_architecture.py | 20 +-
airflow-core/newsfragments/74042.significant.rst | 8 +
.../auth/managers/simple/ui/package.json | 10 +-
.../auth/managers/simple/ui/pnpm-lock.yaml | 253 +--
.../src/airflow/config_templates/config.yml | 22 +-
airflow-core/src/airflow/dag_processing/dagbag.py | 4 +-
.../src/airflow/dag_processing/importer_routing.py | 20 +-
.../airflow/dag_processing/lang_sdk_processor.py | 27 +-
airflow-core/src/airflow/dag_processing/manager.py | 48 +-
.../src/airflow/dag_processing/processor.py | 10 +-
.../src/airflow/jobs/scheduler_job_runner.py | 3 +-
airflow-core/src/airflow/models/dagrun.py | 4 +
.../airflow/serialization/serialized_objects.py | 30 +-
airflow-core/src/airflow/ui/package.json | 26 +-
airflow-core/src/airflow/ui/pnpm-lock.yaml | 1891 +++++++++++---------
.../airflow/ui/public/i18n/locales/de/assets.json | 1 +
.../airflow/ui/public/i18n/locales/de/browse.json | 2 +-
.../airflow/ui/public/i18n/locales/de/common.json | 15 +-
.../ui/public/i18n/locales/de/components.json | 2 +-
.../airflow/ui/public/i18n/locales/de/dags.json | 6 +-
.../ui/public/i18n/locales/de/dashboard.json | 8 +-
.../airflow/ui/public/i18n/locales/en/common.json | 7 +
.../TriggerDag/TriggerDAGButton.test.tsx | 112 ++
.../src/components/TriggerDag/TriggerDAGButton.tsx | 7 +-
.../src/airflow/ui/src/constants/localStorage.ts | 1 +
.../src/airflow/ui/src/constants/searchParams.ts | 1 +
.../ui/src/hooks/useAdvancedSearch.test.tsx | 175 ++
.../src/airflow/ui/src/hooks/useAdvancedSearch.ts | 39 +-
.../airflow/ui/src/hooks/useUserSettings.test.tsx | 21 +
.../src/airflow/ui/src/hooks/useUserSettings.ts | 7 +
.../airflow/ui/src/layouts/Nav/NavButton.test.tsx | 14 +
.../src/airflow/ui/src/layouts/Nav/NavButton.tsx | 8 +-
.../src/airflow/ui/src/pages/DagRuns/DagRuns.tsx | 4 +-
.../src/airflow/ui/src/pages/Run/Details.tsx | 4 +-
.../ui/src/pages/Settings/Settings.test.tsx | 18 +
.../src/airflow/ui/src/pages/Settings/Settings.tsx | 16 +
...artitionKey.test.ts => hasDagRunConfig.test.ts} | 14 +-
.../levels.js => src/utils/hasDagRunConfig.ts} | 13 +-
airflow-core/src/airflow/ui/src/utils/index.ts | 1 +
airflow-core/src/airflow/utils/file.py | 4 -
.../tests/unit/always/test_project_structure.py | 1 -
.../tests/unit/dag_processing/fake_lang_sdk.py | 38 +-
.../tests/unit/dag_processing/test_dagbag.py | 23 +-
.../unit/dag_processing/test_importer_routing.py | 47 +-
.../unit/dag_processing/test_lang_sdk_processor.py | 90 +-
.../tests/unit/dag_processing/test_manager.py | 154 +-
.../tests/unit/dag_processing/test_processor.py | 24 +-
airflow-core/tests/unit/jobs/test_scheduler_job.py | 74 +-
airflow-core/tests/unit/models/test_dagrun.py | 73 +-
.../tests/unit/models/test_taskinstance.py | 25 +-
.../unit/serialization/test_dag_serialization.py | 85 +-
airflow-core/tests/unit/utils/test_file.py | 4 +-
contributing-docs/12_provider_distributions.rst | 14 +-
dev/README_RELEASE_PROVIDERS.md | 5 +-
dev/breeze/doc/ci/04_selective_checks.md | 33 +-
dev/breeze/src/airflow_breeze/utils/packages.py | 26 +
.../src/airflow_breeze/utils/selective_checks.py | 235 ++-
dev/breeze/tests/test_packages.py | 36 +
dev/breeze/tests/test_selective_checks.py | 343 +++-
dev/breeze/uv.lock | 44 +-
.../react_plugin_template/package.json | 14 +-
.../react_plugin_template/pnpm-lock.yaml | 369 ++--
generated/known_sdk_imports_in_core.txt | 2 +-
go-sdk/README.md | 7 +-
go-sdk/airflow/bundle.go | 15 +-
go-sdk/airflow/bundle_test.go | 54 +
go-sdk/airflow/dag.go | 106 +-
go-sdk/airflow/dag_test.go | 5 +
go-sdk/airflow/if.go | 228 +++
go-sdk/airflow/if_test.go | 693 +++++++
go-sdk/airflow/inputs.go | 51 +-
go-sdk/airflow/node.go | 383 ++++
go-sdk/airflow/node_test.go | 538 ++++++
go-sdk/airflow/task_handler_test.go | 9 +
go-sdk/airflow/task_option.go | 12 +-
.../{foreigntaskoption => foreignnode}/main.go | 19 +-
go-sdk/internal/bundle/task.go | 127 +-
go-sdk/internal/bundle/task_test.go | 242 +++
go-sdk/pkg/execution/client.go | 8 +
go-sdk/pkg/execution/client_test.go | 47 +
go-sdk/pkg/execution/integration_test.go | 124 ++
go-sdk/pkg/execution/task_runner.go | 1 +
java-sdk/README.md | 6 +-
.../kubernetes_tests/test_kubernetes_executor.py | 89 +-
providers/.last_release_date.txt | 2 +-
providers/amazon/docs/executors/batch-executor.rst | 4 +
providers/amazon/docs/executors/ecs-executor.rst | 4 +
providers/amazon/docs/executors/general.rst | 13 +
.../amazon/docs/executors/lambda-executor.rst | 5 +
.../aws/executors/aws_lambda/lambda_executor.py | 67 +-
.../amazon/aws/executors/batch/batch_executor.py | 15 +-
.../amazon/aws/executors/ecs/ecs_executor.py | 5 +-
.../system/amazon/aws/example_athena_spark.py | 52 +-
.../executors/aws_lambda/test_lambda_executor.py | 150 +-
.../aws/executors/batch/test_batch_executor.py | 105 +-
.../tests/unit/amazon/aws/executors/conftest.py} | 41 +-
.../amazon/aws/executors/ecs/test_ecs_executor.py | 135 +-
.../apache/kafka/triggers/test_await_message.py | 49 +-
.../unit/apache/kafka/triggers/test_msg_queue.py | 5 +-
providers/celery/docs/celery_executor.rst | 8 +
.../providers/celery/executors/celery_executor.py | 30 +-
.../integration/celery/test_celery_executor.py | 30 +-
.../unit/celery/executors/test_celery_executor.py | 258 ++-
providers/cncf/kubernetes/docs/changelog.rst | 5 +
.../cncf/kubernetes/docs/kubernetes_executor.rst | 9 +
providers/cncf/kubernetes/provider.yaml | 2 +-
.../kubernetes/executors/kubernetes_executor.py | 123 +-
.../executors/kubernetes_executor_types.py | 43 +-
.../executors/kubernetes_executor_utils.py | 37 +-
.../executors/test_kubernetes_executor.py | 818 ++++++++-
.../executors/test_kubernetes_executor_types.py | 89 +
.../providers/common/compat/connection/__init__.py | 30 +-
.../common/compat/connection/test_connection.py | 58 +-
providers/duckdb/provider.yaml | 2 +-
providers/edge3/docs/changelog.rst | 8 +
providers/edge3/docs/migrations-ref.rst | 4 +-
providers/edge3/provider.yaml | 14 +-
.../src/airflow/providers/edge3/cli/api_client.py | 14 +-
.../src/airflow/providers/edge3/cli/worker.py | 22 +-
.../providers/edge3/executors/edge_executor.py | 214 ++-
.../airflow/providers/edge3/get_provider_info.py | 12 +-
.../0006_5_0_0_add_task_instance_id_to_edge_job.py | 71 +
.../edge3/src/airflow/providers/edge3/models/db.py | 1 +
.../src/airflow/providers/edge3/models/edge_job.py | 10 +
.../www/openapi-gen/requests/schemas.gen.ts | 12 +
.../plugins/www/openapi-gen/requests/types.gen.ts | 10 +
.../providers/edge3/plugins/www/package.json | 24 +-
.../providers/edge3/plugins/www/pnpm-lock.yaml | 817 ++++-----
.../edge3/plugins/www/src/pages/JobsPage.test.tsx | 105 ++
.../edge3/plugins/www/src/pages/JobsPage.tsx | 17 +-
.../providers/edge3/plugins/www/vite.config.ts | 4 +-
.../providers/edge3/worker_api/datamodels.py | 7 +
.../providers/edge3/worker_api/datamodels_ui.py | 2 +
.../providers/edge3/worker_api/routes/jobs.py | 84 +-
.../providers/edge3/worker_api/routes/ui.py | 1 +
.../edge3/worker_api/v2-edge-generated.yaml | 39 +
.../edge3/tests/unit/edge3/cli/test_api_client.py | 76 +-
.../edge3/tests/unit/edge3/cli/test_worker.py | 46 +-
.../unit/edge3/executors/test_edge_executor.py | 456 ++++-
.../migrations/test_task_instance_identity.py | 170 ++
providers/edge3/tests/unit/edge3/models/test_db.py | 30 +-
.../unit/edge3/worker_api/routes/test_jobs.py | 144 +-
.../tests/unit/edge3/worker_api/routes/test_ui.py | 31 +
providers/google/docs/changelog.rst | 9 +
providers/google/docs/operators/cloud/dataproc.rst | 14 +-
.../providers/google/cloud/hooks/cloud_composer.py | 4 +-
.../providers/google/cloud/operators/dataproc.py | 19 +-
.../providers/google/cloud/operators/gcs.py | 24 +-
.../google/cloud/transfers/gcs_to_sftp.py | 55 +-
.../dataproc/example_dataproc_batch_persistent.py | 32 +-
.../dataproc/example_dataproc_cluster_generator.py | 156 --
.../unit/google/cloud/hooks/test_cloud_composer.py | 24 +
.../unit/google/cloud/operators/test_dataproc.py | 7 +-
.../tests/unit/google/cloud/operators/test_gcs.py | 135 ++
.../google/cloud/transfers/test_gcs_to_sftp.py | 72 +
providers/ibm/mq/docs/index.rst | 2 +-
providers/ibm/mq/pre_extras_install.yaml | 33 -
providers/ibm/mq/pyproject.toml | 4 +-
providers/ibm/mq/tests/conftest.py | 8 +-
providers/microsoft/azure/README.rst | 2 +-
providers/microsoft/azure/docs/index.rst | 2 +-
providers/microsoft/azure/pyproject.toml | 7 +-
.../snowflake/hooks/snowflake_cortex_agent.py | 176 ++
.../snowflake/hooks/test_snowflake_cortex_agent.py | 211 +++
registry/package.json | 2 +-
registry/pnpm-lock.yaml | 44 +-
scripts/ci/prek/check_execution_api_versions.py | 15 +-
.../ci/prek/check_supervisor_schemas_versions.py | 11 +-
scripts/ci/prek/common_prek_utils.py | 21 +
scripts/docker/entrypoint_ci.sh | 2 +-
scripts/docker/install_os_dependencies.sh | 5 +-
scripts/in_container/run_pre_extras_install.py | 64 +-
.../in_container/test_run_pre_extras_install.py | 142 ++
.../src/airflow/sdk/coordinators/_dag_importer.py | 88 +-
.../src/airflow/sdk/coordinators/_subprocess.py | 180 +-
.../sdk/coordinators/executable/coordinator.py | 4 +-
.../airflow/sdk/coordinators/java/_dag_importer.py | 21 +-
.../airflow/sdk/coordinators/java/coordinator.py | 62 +-
.../airflow/sdk/coordinators/node/_dag_importer.py | 11 +-
.../airflow/sdk/coordinators/node/coordinator.py | 47 +-
.../src/airflow/sdk/execution_time/coordinator.py | 192 +-
.../src/airflow/sdk/execution_time/supervisor.py | 94 +-
.../src/airflow/sdk/execution_time/task_runner.py | 26 +-
task-sdk/src/airflow/sdk/importers/base.py | 67 +-
.../src/airflow/sdk/importers/python_importer.py | 22 +-
.../task_sdk/coordinators/java/test_coordinator.py | 132 +-
.../coordinators/java/test_dag_importer.py | 119 +-
.../task_sdk/coordinators/node/test_coordinator.py | 166 +-
.../coordinators/node/test_dag_importer.py | 108 +-
.../task_sdk/coordinators/test_dag_importer.py | 172 +-
.../tests/task_sdk/coordinators/test_subprocess.py | 431 ++++-
.../task_sdk/execution_time/test_coordinator.py | 384 ++--
.../task_sdk/execution_time/test_supervisor.py | 257 +++
.../task_sdk/execution_time/test_task_runner.py | 60 +-
.../task_sdk/importers/test_python_importer.py | 20 +
task-sdk/tests/task_sdk/importers/test_registry.py | 130 +-
ts-sdk/README.md | 8 +-
ts-sdk/example/README.md | 6 +-
ts-sdk/package.json | 2 +-
ts-sdk/pnpm-lock.yaml | 413 +----
uv.lock | 10 +-
229 files changed, 13298 insertions(+), 3861 deletions(-)
create mode 100644 airflow-core/newsfragments/74042.significant.rst
create mode 100644
airflow-core/src/airflow/ui/src/components/TriggerDag/TriggerDAGButton.test.tsx
create mode 100644
airflow-core/src/airflow/ui/src/hooks/useAdvancedSearch.test.tsx
copy airflow-core/src/airflow/ui/src/utils/{partitionKey.test.ts =>
hasDagRunConfig.test.ts} (64%)
copy airflow-core/src/airflow/ui/{rules/levels.js =>
src/utils/hasDagRunConfig.ts} (68%)
create mode 100644 go-sdk/airflow/if.go
create mode 100644 go-sdk/airflow/if_test.go
create mode 100644 go-sdk/airflow/node.go
create mode 100644 go-sdk/airflow/node_test.go
copy go-sdk/airflow/testdata/{foreigntaskoption => foreignnode}/main.go (64%)
copy providers/{keycloak/tests/unit/keycloak/auth_manager/test_user.py =>
amazon/tests/unit/amazon/aws/executors/conftest.py} (56%)
create mode 100644
providers/cncf/kubernetes/tests/unit/cncf/kubernetes/executors/test_kubernetes_executor_types.py
create mode 100644
providers/edge3/src/airflow/providers/edge3/migrations/versions/0006_5_0_0_add_task_instance_id_to_edge_job.py
create mode 100644
providers/edge3/src/airflow/providers/edge3/plugins/www/src/pages/JobsPage.test.tsx
create mode 100644
providers/edge3/tests/unit/edge3/migrations/test_task_instance_identity.py
delete mode 100644
providers/google/tests/system/google/cloud/dataproc/example_dataproc_cluster_generator.py
delete mode 100644 providers/ibm/mq/pre_extras_install.yaml
create mode 100644 scripts/tests/in_container/test_run_pre_extras_install.py
