This is an automated email from the ASF dual-hosted git repository.
jason810496 pushed a change to branch jason/lang-sdk-e2e/08-native-e2e
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 35b38c90a6c Keep the k8s lang-SDK values comment within the YAML line
limit
discard 7dd6d50fcd1 Read a native Dag example's served Dags with bundleDags
discard 6fd1bc66c05 Say which coordinator runs the native e2e Java tasks
discard 77bfd008b42 Drop the dag_bundle_name reason from the k8s native
TypeScript skip
discard f9d3161a24e Parse native Dags in the e2e by class, not by Dag bundle
name
discard 4cdb0d5ae18 Name the skipped-branch e2e test after what it checks
discard 914250c4ec6 Document how the TypeScript example's native Dag gets
parsed
discard 1dfae623464 Explain why the k8s native TypeScript Dag test is skipped
discard adabe49410f Pack the TypeScript example against the built SDK
discard 6eb1c4d5ab9 Build the TypeScript SDK before packing the k8s example
bundle
discard 6e7abe412a4 Key the Lang-SDK e2e jobs on native Dag modules only
discard c426f2a6405 Build the k8s TypeScript artifacts only for the native Dag
test
discard e3c778e7ae6 Share the Dag run lookup and the native Java queue name
discard 7524b15a9a7 Run the Lang-SDK e2e jobs when native Dag parsing changes
discard f483e458e17 Add a native Java Dag to the compose e2e
discard 33df82e9409 Keep the containerized Java build's Maven repository on
the host
discard 9919bbc4932 Check the native TypeScript Dag's source and triggered run
discard 4c9642280de Parse the native TypeScript Dag in the compose e2e
discard de24213b556 TS SDK: cover native TypeScript Dags end to end
discard 981651c3f85 Java SDK: Pack each native Dag's source file into the
bundle JAR
discard 63e90456cc8 Java SDK: Record the class that declares each Dag and
describe it on request
discard 4f8a7d03396 Java SDK: Serialize native Dags to DagSerialization v3 on
parse requests
discard 085453fd50e Java SDK: Declare a Dag's task graph with @Builder.Deps
discard 9ca9a2397e4 TS SDK: add triggerDagRun to the native Dag surface
discard fee79f90c3e TS SDK: add multi-way branching with dag.switch
discard 489d03c9f45 TS SDK: add conditional branching with dag.if
discard 6ce49055da4 Say tasks list runs a native TypeScript Dag's bundle
discard a9518585425 Document how a NodeCoordinator is picked for parsing
TypeScript Dags
discard fedfaafce74 Run a native TypeScript Dag's own bundle through the
native task branch
discard 4d445a87d9e Let the Node Dag importer find its coordinator
discard 68b1f5dd516 Hand out the Node Dag importer through get_dag_importer
discard 0db68395bbc Pin the Code view to the entry module in Node bundle tests
discard c58c6d6e3d6 Let NodeDagImporter source read errors reach the caller
discard e2973a763ac Import NodeDagImporter at the top of the Node coordinator
discard b960c6be5be Warn against defining a Dag in both TypeScript and Python
discard ec24bd1b93e Align the TypeScript build docs with the Code view
discard dca36121099 Say when the Dag processor needs Node.js for TypeScript
bundles
discard 8d8141877ce Run a native TypeScript Dag's task from its own bundle
discard a522c50c6b4 Share the bundle section mutation helper between Node tests
discard bf702a0fb6d Document parsing native TypeScript Dags
discard acb5fc0011f Parse native TypeScript Dags with the Node coordinator
discard 92aa2285207 Say a JRE parses native Java Dags, and keep main's bundle
test mocks
discard 116b5ceff10 Say tasks list runs a native Java Dag's main class
discard c31f319efa4 Fail a native task cleanly when its file or coordinator
class cannot load
discard 060109090e7 Run a native Dag's task from its own Dag file
discard 512c6885e21 Fail a task cleanly when its runtime cannot be launched
discard d896e079969 Let the Java Dag importer find its coordinator
discard a27ca4c81d3 Read Java Dag sources from the bundle's sources.json index
discard f78c5f0965d Hand out the Java Dag importer through get_dag_importer
discard bb6bb6f8052 Keep the Java parse_dag test from changing the pytest
worker
discard 8fe831d0c14 Stop promising that Java dependency JARs are not parsed
discard ab89ee7f01b Reject a Java Dag JAR whose SDK cannot answer a parse
discard 2abb68edad9 Run the JAR a native Java Dag was parsed from
discard 6f31a7c1282 Report why a Java Dag JAR cannot be read
discard 7245c001b1e Pass the task's Dag file to the coordinator's command
builder
discard 9a5c3eca2bc Run a task on its run's version when dag_bundle_name names
its bundle
discard b2674bc5886 Document native Java Dag parsing
discard edb8a583f79 Name the JAR manifest attributes the Java coordinator reads
discard c600b788fd9 Test the Java Dag source placeholder for a JAR without a
manifest
discard 9ad69e847b3 Treat an unreadable JAR like one without a manifest
discard 9ea7124c7d8 Parse native Java Dags with their coordinator
discard 22208dae655 Build the JVM command that parses a Dag JAR
discard 2ff465d6b09 Read JAR manifests per the JAR specification
discard 77a24d4ee6d Default a Dag file processor's parse log to os.devnull
discard 29d2fa7090a Let a Dag file processor run without a parse log file
discard ff9e8d23f10 Ignore the bagged Dag union in the external task sensor
test
discard e77020e65bd List the tasks of a native Lang-SDK Dag
discard 16099c61f3c Bag native Lang-SDK Dags in core, only when asked
discard 2855834d2bf Let a Dag file processor run without an API client
discard d747c98f701 Parse coordinator-claimed Dag files with their runtime in
a Dag bag
add cb9d1e9ee3d Catch a runtime's dead connection when its parse request
is sent
add adc8a1139f1 Parse coordinator-claimed Dag files with their runtime in
a Dag bag
add 6c7606ed591 Let a Dag file processor run without an API client
add d6d9f16bb81 Bag native Lang-SDK Dags in core, only when asked
add 124cd3b8e37 List the tasks of a native Lang-SDK Dag
add c9f3b5c6cf5 Ignore the bagged Dag union in the external task sensor
test
add 72c6990dbf9 Let a Dag file processor run without a parse log file
add e88645e4355 Default a Dag file processor's parse log to os.devnull
add e0d458d078d Read JAR manifests per the JAR specification
add d89ef663004 Build the JVM command that parses a Dag JAR
add 5b01319aa9d Parse native Java Dags with their coordinator
add 1f284da999b Treat an unreadable JAR like one without a manifest
add 630a1ace317 Test the Java Dag source placeholder for a JAR without a
manifest
add 0f3419c6003 Name the JAR manifest attributes the Java coordinator reads
add 22f8deb00c6 Document native Java Dag parsing
add 57608c10c75 Run a task on its run's version when dag_bundle_name names
its bundle
add 6dd1d7e51be Pass the task's Dag file to the coordinator's command
builder
add cafdd50a702 Report why a Java Dag JAR cannot be read
add 896ca55a16c Run the JAR a native Java Dag was parsed from
add 47994663aec Reject a Java Dag JAR whose SDK cannot answer a parse
add b31a55269be Stop promising that Java dependency JARs are not parsed
add d65628d1389 Keep the Java parse_dag test from changing the pytest
worker
add 7f6a9bf43d1 Hand out the Java Dag importer through get_dag_importer
add 3d69ad70225 Read Java Dag sources from the bundle's sources.json index
add 4730ebcb2ec Let the Java Dag importer find its coordinator
add 36dd9ba46fc Fail a task cleanly when its runtime cannot be launched
add fdc6419f944 Run a native Dag's task from its own Dag file
add 3cac0914bf2 Fail a native task cleanly when its file or coordinator
class cannot load
add a29362e2222 Say tasks list runs a native Java Dag's main class
add 6ea3559be1f Say a JRE parses native Java Dags, and keep main's bundle
test mocks
add 88e664abce4 Parse native TypeScript Dags with the Node coordinator
add 1250325386f Document parsing native TypeScript Dags
add ca29303c831 Share the bundle section mutation helper between Node tests
add 8291c5f7d5e Run a native TypeScript Dag's task from its own bundle
add 00f8e4fb806 Say when the Dag processor needs Node.js for TypeScript
bundles
add 3868f2bf8c4 Align the TypeScript build docs with the Code view
add 6c34a8c3474 Warn against defining a Dag in both TypeScript and Python
add d3fee16ecba Import NodeDagImporter at the top of the Node coordinator
add f575d0881d4 Let NodeDagImporter source read errors reach the caller
add 5d55239c61b Pin the Code view to the entry module in Node bundle tests
add 4a9614c4d60 Hand out the Node Dag importer through get_dag_importer
add 3b501289acd Let the Node Dag importer find its coordinator
add 974f317a53e Run a native TypeScript Dag's own bundle through the
native task branch
add 0154593f57f Document how a NodeCoordinator is picked for parsing
TypeScript Dags
add 2c701f77683 Say tasks list runs a native TypeScript Dag's bundle
add a99b678ed9c TS SDK: add conditional branching with dag.if
add 92e3b28fc1e TS SDK: add multi-way branching with dag.switch
add 20cece79b0d TS SDK: add triggerDagRun to the native Dag surface
add 167cdbbc767 Java SDK: Declare a Dag's task graph with @Builder.Deps
add 7385c7ae3c9 Java SDK: Serialize native Dags to DagSerialization v3 on
parse requests
add ed5a48933ac Java SDK: Record the class that declares each Dag and
describe it on request
add 587f7209160 Java SDK: Pack each native Dag's source file into the
bundle JAR
add b8701ae34f1 TS SDK: cover native TypeScript Dags end to end
add d2d7331c345 Parse the native TypeScript Dag in the compose e2e
add cf995cb75d3 Check the native TypeScript Dag's source and triggered run
add 4146734259a Keep the containerized Java build's Maven repository on
the host
add dde70006a02 Add a native Java Dag to the compose e2e
add 6331ba256a5 Run the Lang-SDK e2e jobs when native Dag parsing changes
add 27973b88874 Share the Dag run lookup and the native Java queue name
add 0b9f172aede Build the k8s TypeScript artifacts only for the native Dag
test
add 39a13a294b9 Key the Lang-SDK e2e jobs on native Dag modules only
add 60730e21699 Build the TypeScript SDK before packing the k8s example
bundle
add 9926a831c0b Pack the TypeScript example against the built SDK
add 17963c419f5 Explain why the k8s native TypeScript Dag test is skipped
add 31f32f8a7b2 Document how the TypeScript example's native Dag gets
parsed
add 09c092b0d00 Name the skipped-branch e2e test after what it checks
add 8bf59281cfe Parse native Dags in the e2e by class, not by Dag bundle
name
add 90aa054175b Drop the dag_bundle_name reason from the k8s native
TypeScript skip
add 42a86a553cb Say which coordinator runs the native e2e Java tasks
add 50d85b5224d Read a native Dag example's served Dags with bundleDags
add 43cf4970f36 Keep the k8s lang-SDK values comment within the YAML line
limit
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (35b38c90a6c)
\
N -- N -- N refs/heads/jason/lang-sdk-e2e/08-native-e2e
(43cf4970f36)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../src/airflow/dag_processing/lang_sdk_processor.py | 8 +++++++-
.../tests/unit/dag_processing/test_lang_sdk_processor.py | 13 +++++++++++++
2 files changed, 20 insertions(+), 1 deletion(-)
