This is an automated email from the ASF dual-hosted git repository.
jason810496 pushed a change to branch jason/lang-sdk-e2e/08-native-e2e
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit cb570f37d53 Read a native Dag example's served Dags with bundleDags
omit babee8c1491 Say which coordinator runs the native e2e Java tasks
omit b045272e0f8 Drop the dag_bundle_name reason from the k8s native
TypeScript skip
omit 70c16aaa6cb Parse native Dags in the e2e by class, not by Dag bundle
name
omit 992962b0c64 Name the skipped-branch e2e test after what it checks
omit 7bec8a81753 Document how the TypeScript example's native Dag gets
parsed
omit b1bf44a9097 Explain why the k8s native TypeScript Dag test is skipped
omit e98e6bbd6a2 Pack the TypeScript example against the built SDK
omit 8026cadaf32 Build the TypeScript SDK before packing the k8s example
bundle
omit 8f4acac7000 Key the Lang-SDK e2e jobs on native Dag modules only
omit 26e9ff56e1f Build the k8s TypeScript artifacts only for the native Dag
test
omit 639977af2ed Share the Dag run lookup and the native Java queue name
omit 38b4a5592de Run the Lang-SDK e2e jobs when native Dag parsing changes
omit dca334a64be Add a native Java Dag to the compose e2e
omit d1a6a6e7076 Keep the containerized Java build's Maven repository on
the host
omit 84c7176b92d Check the native TypeScript Dag's source and triggered run
omit a08db5864e6 Parse the native TypeScript Dag in the compose e2e
omit 565fa36ed1b TS SDK: cover native TypeScript Dags end to end
omit 80f5c85f2cc Java SDK: Pack each native Dag's source file into the
bundle JAR
omit 3a9ac853727 Java SDK: Record the class that declares each Dag and
describe it on request
omit 490899870ff Java SDK: Serialize native Dags to DagSerialization v3 on
parse requests
omit e3da52f4682 Java SDK: Declare a Dag's task graph with @Builder.Deps
omit d1ce32754b7 TS SDK: add triggerDagRun to the native Dag surface
omit 3e214970cbb TS SDK: add multi-way branching with dag.switch
omit 57787e9bab9 TS SDK: add conditional branching with dag.if
omit a51934c9855 Say tasks list runs a native TypeScript Dag's bundle
omit e8b8ba161c2 Document how a NodeCoordinator is picked for parsing
TypeScript Dags
omit 00a85e05a36 Run a native TypeScript Dag's own bundle through the
native task branch
omit 74c44c27df6 Let the Node Dag importer find its coordinator
omit 92148664518 Hand out the Node Dag importer through get_dag_importer
omit 2790c76e8fa Pin the Code view to the entry module in Node bundle tests
omit a8419c066f2 Let NodeDagImporter source read errors reach the caller
omit 0c5d56cdf87 Import NodeDagImporter at the top of the Node coordinator
omit f6a5a080e4b Warn against defining a Dag in both TypeScript and Python
omit 62d8468d0a8 Align the TypeScript build docs with the Code view
omit 41b2b00e76d Say when the Dag processor needs Node.js for TypeScript
bundles
omit a98180993e1 Run a native TypeScript Dag's task from its own bundle
omit 0c178ae252a Share the bundle section mutation helper between Node tests
omit 2d4dedcc848 Document parsing native TypeScript Dags
omit ef57bfa95e0 Parse native TypeScript Dags with the Node coordinator
omit 1eab5e1669e Say tasks list runs a native Java Dag's main class
omit 59d1af63d80 Fail a native task cleanly when its file or coordinator
class cannot load
omit 30e3bdf5cbc Run a native Dag's task from its own Dag file
omit 8c439799d9a Fail a task cleanly when its runtime cannot be launched
omit d888ce5765c Let the Java Dag importer find its coordinator
omit 358c61edc21 Read Java Dag sources from the bundle's sources.json index
omit 99014526fbc Hand out the Java Dag importer through get_dag_importer
omit caf65f05d2f Keep the Java parse_dag test from changing the pytest
worker
omit a547e197f60 Stop promising that Java dependency JARs are not parsed
omit 10a9287deb8 Reject a Java Dag JAR whose SDK cannot answer a parse
omit 7473892cf33 Run the JAR a native Java Dag was parsed from
omit 04c2f7c895f Report why a Java Dag JAR cannot be read
omit dc422bae77f Pass the task's Dag file to the coordinator's command
builder
omit 58f41c52736 Run a task on its run's version when dag_bundle_name names
its bundle
omit f17eb2b1bf4 Document native Java Dag parsing
omit c2d936e16b1 Name the JAR manifest attributes the Java coordinator reads
omit 69e8733bcc1 Test the Java Dag source placeholder for a JAR without a
manifest
omit 59a2da47776 Treat an unreadable JAR like one without a manifest
omit ec4cf0244fe Parse native Java Dags with their coordinator
omit b109ab2653f Build the JVM command that parses a Dag JAR
omit 0896b0bebf0 Read JAR manifests per the JAR specification
omit fe5a99ca14b Default a Dag file processor's parse log to os.devnull
omit ab169413c42 Let a Dag file processor run without a parse log file
omit 1eed2e3c99b Ignore the bagged Dag union in the external task sensor
test
omit 47f96439015 List the tasks of a native Lang-SDK Dag
omit 7d29be11930 Bag native Lang-SDK Dags in core, only when asked
omit a7e12f14454 Let a Dag file processor run without an API client
omit a2d4c67346d Parse coordinator-claimed Dag files with their runtime in
a Dag bag
omit 031530130df Apply the team rules to the Dag that validation returns
omit 0d082d04877 Test the import errors of a bundle with several
coordinators of a class
omit c6b30d95c4b Find a claiming Dag importer instead of its coordinator in
Dag processing
omit 6ecdfd2569b Name the coordinator class a native Dag task must be
routed to
omit c5e474438cf Stub Dag file discovery with DagFileInfo in the Lang-SDK
manager tests
omit cfb9d230320 Pass a parse log handle to the Lang-SDK processor in tests
omit c7fbb065e8f Find a native Dag's coordinator key through its importer
omit 5ecad16b60b Wait for the killed leftover in the Lang-SDK processor test
omit 0c33b14bf2c Move the client-less Lang-SDK parse out of this change
omit 9c0dcdeaf8e Note in ADR-0010 that the manager routes claimed files for
now
omit 11984e80e6e Clear import errors after the native-file Dag bag sync test
omit e2fcdf9b3bd Apply the multi-team task checks to Lang-SDK Dags
omit 5e8be2de430 Spec the mocks of a hand-built Lang-SDK processor in tests
omit 98ed7c85083 Name the setting in a Lang-SDK parse timeout error
omit 0dfd09a03c4 Kill what a Lang-SDK runtime leaves in its process group
omit 398f525e716 Match the schema error's JSON path in a Lang-SDK parse test
omit 8207cfa68ef Fail a native Dag's task on a Python worker without retries
omit 79f3641e038 Find the claiming coordinator in the Task SDK and wrap it
in core
omit 58a1d752eb3 Start each Dag file processor with explicit arguments
omit ba164a7f269 Drop callbacks for Lang-SDK Dag files before queuing the
file
omit 9f9efebc21a Report a native Dag's task that reaches a Python worker
omit 0d7d8acdbe2 Report a Lang-SDK parse past its import timeout as an
import error
omit 257e8c4d62f Parse coordinator-claimed Dag files with their runtime in
the Dag processor
omit b9fcd4587b5 Break the new dag_bundle_name docs only at sentence ends
omit f611b22c5d2 Say which failures fall back to a Python file in ADR-0010
omit 003bfdaf617 Add a newsfragment for the removed coordinator artifact
roots
omit cf492837534 Describe how a Dag importer finds its coordinator in
ADR-0010
omit def439999a4 Say dag_bundle_name only names the stub task artifact
bundle
omit 52ded1289ac Find a Dag importer's coordinator from its class
omit e781bd36a9d Explain dag_bundle_name by the coordinator that parses a
Dag file
omit 1116deb6088 Hand out a coordinator's Dag importer through
get_dag_importer alone
omit 5c266f4ed45 Say dag_bundle_name is only needed for two coordinators of
one class
omit 0f9651cd1d0 Drop serves_bundle so get_parsed_bundles is the only answer
omit 580781113f1 Check Dag file claims per bundle on the parse path
omit 1627decb9c5 Import the coordinator manager at the top of the importer
base
omit 25b751285b7 Let a coordinator parse the Dag files of the bundles it
serves
add a729bf8866d Report a schema error's path the same way under every
jsonschema version
add f3e86043885 Let a coordinator parse the Dag files of the bundles it
serves
add 1210fcd1a4f Import the coordinator manager at the top of the importer
base
add 95195316931 Check Dag file claims per bundle on the parse path
add b1bc98b2ad3 Drop serves_bundle so get_parsed_bundles is the only answer
add 59252221619 Say dag_bundle_name is only needed for two coordinators of
one class
add 62cd77cdb5c Hand out a coordinator's Dag importer through
get_dag_importer alone
add d32ba4d51fd Explain dag_bundle_name by the coordinator that parses a
Dag file
add 724ed151e0c Find a Dag importer's coordinator from its class
add 0d425b4c442 Say dag_bundle_name only names the stub task artifact
bundle
add a123aea9f61 Describe how a Dag importer finds its coordinator in
ADR-0010
add 5dd8b0a6392 Add a newsfragment for the removed coordinator artifact
roots
add f4fcbf2b6f0 Say which failures fall back to a Python file in ADR-0010
add 3dfc4d471ab Break the new dag_bundle_name docs only at sentence ends
add ec5f8dfc077 Parse coordinator-claimed Dag files with their runtime in
the Dag processor
add a28778cd7f2 Report a Lang-SDK parse past its import timeout as an
import error
add 8b9abbac1a7 Report a native Dag's task that reaches a Python worker
add bda4e74cd73 Drop callbacks for Lang-SDK Dag files before queuing the
file
add f536faef515 Start each Dag file processor with explicit arguments
add 3b340d6c82a Find the claiming coordinator in the Task SDK and wrap it
in core
add 8174afac07c Fail a native Dag's task on a Python worker without retries
add 711162c0aa8 Match the schema error's JSON path in a Lang-SDK parse test
add 4b34b45fc40 Kill what a Lang-SDK runtime leaves in its process group
add fb033be47ff Name the setting in a Lang-SDK parse timeout error
add 41af74c7be4 Spec the mocks of a hand-built Lang-SDK processor in tests
add 8b0574fc678 Apply the multi-team task checks to Lang-SDK Dags
add fa9d50f6484 Clear import errors after the native-file Dag bag sync test
add 0aeaf24fc03 Note in ADR-0010 that the manager routes claimed files for
now
add ccaee070e64 Move the client-less Lang-SDK parse out of this change
add 1b8cc7c615b Wait for the killed leftover in the Lang-SDK processor test
add fab8b8fb084 Find a native Dag's coordinator key through its importer
add c6a79932394 Pass a parse log handle to the Lang-SDK processor in tests
add 6f1246adc45 Stub Dag file discovery with DagFileInfo in the Lang-SDK
manager tests
add 2c260883398 Name the coordinator class a native Dag task must be
routed to
add 696f7aaef03 Find a claiming Dag importer instead of its coordinator in
Dag processing
add f3114556f4b Test the import errors of a bundle with several
coordinators of a class
add e9b28933f3f Apply the team rules to the Dag that validation returns
add 98288bf696c Parse coordinator-claimed Dag files with their runtime in
a Dag bag
add 1a017d1fe62 Let a Dag file processor run without an API client
add 55740382162 Bag native Lang-SDK Dags in core, only when asked
add 914bc6dd1e6 List the tasks of a native Lang-SDK Dag
add ea855e04b42 Ignore the bagged Dag union in the external task sensor
test
add 926d36dbc8c Let a Dag file processor run without a parse log file
add 29de12f6fc5 Default a Dag file processor's parse log to os.devnull
add 3cff355370c Read JAR manifests per the JAR specification
add 91c8d6718b8 Build the JVM command that parses a Dag JAR
add 75a733ff3da Parse native Java Dags with their coordinator
add df77c208129 Treat an unreadable JAR like one without a manifest
add 896f1329a12 Test the Java Dag source placeholder for a JAR without a
manifest
add 2bb04552f0e Name the JAR manifest attributes the Java coordinator reads
add 3f7cf73089a Document native Java Dag parsing
add baa3e44dc84 Run a task on its run's version when dag_bundle_name names
its bundle
add 7c6a7f6ba0e Pass the task's Dag file to the coordinator's command
builder
add 9fc166ab56b Report why a Java Dag JAR cannot be read
add 584f622b073 Run the JAR a native Java Dag was parsed from
add b5a60ca6a98 Reject a Java Dag JAR whose SDK cannot answer a parse
add fa437ca7ad1 Stop promising that Java dependency JARs are not parsed
add 000f79db82c Keep the Java parse_dag test from changing the pytest
worker
add 956f8447789 Hand out the Java Dag importer through get_dag_importer
add 602d8dc4768 Read Java Dag sources from the bundle's sources.json index
add 7a2c426e4ab Let the Java Dag importer find its coordinator
add 0ff2507da68 Fail a task cleanly when its runtime cannot be launched
add 97f4756b71a Run a native Dag's task from its own Dag file
add 2d13b88e551 Fail a native task cleanly when its file or coordinator
class cannot load
add 8ff7078eec8 Say tasks list runs a native Java Dag's main class
add 7ba89026917 Parse native TypeScript Dags with the Node coordinator
add 2923d3d23fb Document parsing native TypeScript Dags
add 2f38cbbd7e6 Share the bundle section mutation helper between Node tests
add a86fa3bf226 Run a native TypeScript Dag's task from its own bundle
add 2309acf4a77 Say when the Dag processor needs Node.js for TypeScript
bundles
add 5d138188dd7 Align the TypeScript build docs with the Code view
add f90e51eaaed Warn against defining a Dag in both TypeScript and Python
add eea084aeb11 Import NodeDagImporter at the top of the Node coordinator
add 11c02b2c2ff Let NodeDagImporter source read errors reach the caller
add 6c483cba316 Pin the Code view to the entry module in Node bundle tests
add f1c18570acf Hand out the Node Dag importer through get_dag_importer
add b6bea6d5243 Let the Node Dag importer find its coordinator
add d43deb2a4d1 Run a native TypeScript Dag's own bundle through the
native task branch
add 9480391cfd0 Document how a NodeCoordinator is picked for parsing
TypeScript Dags
add 20879c2cd24 Say tasks list runs a native TypeScript Dag's bundle
add d28612dcd00 TS SDK: add conditional branching with dag.if
add d88414a75b2 TS SDK: add multi-way branching with dag.switch
add 4566666cce3 TS SDK: add triggerDagRun to the native Dag surface
add 6c3e4efe3cf Java SDK: Declare a Dag's task graph with @Builder.Deps
add 81d802f2398 Java SDK: Serialize native Dags to DagSerialization v3 on
parse requests
add da70899d839 Java SDK: Record the class that declares each Dag and
describe it on request
add 6b854af4e7d Java SDK: Pack each native Dag's source file into the
bundle JAR
add 711f1bb95e2 TS SDK: cover native TypeScript Dags end to end
add 133d51bce5c Parse the native TypeScript Dag in the compose e2e
add 6c8d90f440f Check the native TypeScript Dag's source and triggered run
add 65c1f21883b Keep the containerized Java build's Maven repository on
the host
add 3bec862b1c9 Add a native Java Dag to the compose e2e
add 4b67db88aae Run the Lang-SDK e2e jobs when native Dag parsing changes
add 26142beca1d Share the Dag run lookup and the native Java queue name
add 23a5c90d642 Build the k8s TypeScript artifacts only for the native Dag
test
add c77970e676a Key the Lang-SDK e2e jobs on native Dag modules only
add 5225d4ae020 Build the TypeScript SDK before packing the k8s example
bundle
add 90459bc800f Pack the TypeScript example against the built SDK
add bff8f389ada Explain why the k8s native TypeScript Dag test is skipped
add f8b70a1b067 Document how the TypeScript example's native Dag gets
parsed
add 16d57d38e3e Name the skipped-branch e2e test after what it checks
add add43941c48 Parse native Dags in the e2e by class, not by Dag bundle
name
add 63f88e77861 Drop the dag_bundle_name reason from the k8s native
TypeScript skip
add 91c7017eb98 Say which coordinator runs the native e2e Java tasks
add c72be4b4ece Read a native Dag example's served Dags with bundleDags
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (cb570f37d53)
\
N -- N -- N refs/heads/jason/lang-sdk-e2e/08-native-e2e
(c72be4b4ece)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
airflow-core/src/airflow/serialization/serialized_objects.py | 12 +++++++++++-
.../tests/unit/serialization/test_dag_serialization.py | 6 +++---
2 files changed, 14 insertions(+), 4 deletions(-)
