This is an automated email from the ASF dual-hosted git repository.
jason810496 pushed a change to branch jason/lang-sdk-e2e/08-native-e2e
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 01cd6f0e71c Rework the lang-SDK k8s harness for mixed-language and
native Dag tests
discard 43cf4970f36 Keep the k8s lang-SDK values comment within the YAML line
limit
discard 50d85b5224d Read a native Dag example's served Dags with bundleDags
discard 42a86a553cb Say which coordinator runs the native e2e Java tasks
discard 90aa054175b Drop the dag_bundle_name reason from the k8s native
TypeScript skip
discard 8bf59281cfe Parse native Dags in the e2e by class, not by Dag bundle
name
discard 09c092b0d00 Name the skipped-branch e2e test after what it checks
discard 31f32f8a7b2 Document how the TypeScript example's native Dag gets
parsed
discard 17963c419f5 Explain why the k8s native TypeScript Dag test is skipped
discard 9926a831c0b Pack the TypeScript example against the built SDK
discard 60730e21699 Build the TypeScript SDK before packing the k8s example
bundle
discard 39a13a294b9 Key the Lang-SDK e2e jobs on native Dag modules only
discard 0b9f172aede Build the k8s TypeScript artifacts only for the native Dag
test
discard 27973b88874 Share the Dag run lookup and the native Java queue name
discard 6331ba256a5 Run the Lang-SDK e2e jobs when native Dag parsing changes
discard dde70006a02 Add a native Java Dag to the compose e2e
discard 4146734259a Keep the containerized Java build's Maven repository on
the host
discard cf995cb75d3 Check the native TypeScript Dag's source and triggered run
discard d2d7331c345 Parse the native TypeScript Dag in the compose e2e
discard b8701ae34f1 TS SDK: cover native TypeScript Dags end to end
discard 587f7209160 Java SDK: Pack each native Dag's source file into the
bundle JAR
discard ed5a48933ac Java SDK: Record the class that declares each Dag and
describe it on request
discard 7385c7ae3c9 Java SDK: Serialize native Dags to DagSerialization v3 on
parse requests
discard 167cdbbc767 Java SDK: Declare a Dag's task graph with @Builder.Deps
discard 20cece79b0d TS SDK: add triggerDagRun to the native Dag surface
discard 92e3b28fc1e TS SDK: add multi-way branching with dag.switch
discard a99b678ed9c TS SDK: add conditional branching with dag.if
discard 2c701f77683 Say tasks list runs a native TypeScript Dag's bundle
discard 0154593f57f Document how a NodeCoordinator is picked for parsing
TypeScript Dags
discard 974f317a53e Run a native TypeScript Dag's own bundle through the
native task branch
discard 3b501289acd Let the Node Dag importer find its coordinator
discard 4a9614c4d60 Hand out the Node Dag importer through get_dag_importer
discard 5d55239c61b Pin the Code view to the entry module in Node bundle tests
discard f575d0881d4 Let NodeDagImporter source read errors reach the caller
discard d3fee16ecba Import NodeDagImporter at the top of the Node coordinator
discard 6c34a8c3474 Warn against defining a Dag in both TypeScript and Python
discard 3868f2bf8c4 Align the TypeScript build docs with the Code view
discard 00f8e4fb806 Say when the Dag processor needs Node.js for TypeScript
bundles
discard 8291c5f7d5e Run a native TypeScript Dag's task from its own bundle
discard ca29303c831 Share the bundle section mutation helper between Node tests
discard 1250325386f Document parsing native TypeScript Dags
discard 88e664abce4 Parse native TypeScript Dags with the Node coordinator
discard 6ea3559be1f Say a JRE parses native Java Dags, and keep main's bundle
test mocks
discard a29362e2222 Say tasks list runs a native Java Dag's main class
discard 3cac0914bf2 Fail a native task cleanly when its file or coordinator
class cannot load
discard fdc6419f944 Run a native Dag's task from its own Dag file
discard 36dd9ba46fc Fail a task cleanly when its runtime cannot be launched
discard 4730ebcb2ec Let the Java Dag importer find its coordinator
discard 3d69ad70225 Read Java Dag sources from the bundle's sources.json index
discard 7f6a9bf43d1 Hand out the Java Dag importer through get_dag_importer
discard d65628d1389 Keep the Java parse_dag test from changing the pytest
worker
discard b31a55269be Stop promising that Java dependency JARs are not parsed
discard 47994663aec Reject a Java Dag JAR whose SDK cannot answer a parse
discard 896ca55a16c Run the JAR a native Java Dag was parsed from
discard cafdd50a702 Report why a Java Dag JAR cannot be read
discard 6dd1d7e51be Pass the task's Dag file to the coordinator's command
builder
discard 57608c10c75 Run a task on its run's version when dag_bundle_name names
its bundle
discard 22f8deb00c6 Document native Java Dag parsing
discard 0f3419c6003 Name the JAR manifest attributes the Java coordinator reads
discard 630a1ace317 Test the Java Dag source placeholder for a JAR without a
manifest
discard 1f284da999b Treat an unreadable JAR like one without a manifest
discard 5b01319aa9d Parse native Java Dags with their coordinator
discard d89ef663004 Build the JVM command that parses a Dag JAR
discard e0d458d078d Read JAR manifests per the JAR specification
omit e88645e4355 Default a Dag file processor's parse log to os.devnull
omit 72c6990dbf9 Let a Dag file processor run without a parse log file
omit c9f3b5c6cf5 Ignore the bagged Dag union in the external task sensor
test
omit 124cd3b8e37 List the tasks of a native Lang-SDK Dag
omit d6d9f16bb81 Bag native Lang-SDK Dags in core, only when asked
omit 6c7606ed591 Let a Dag file processor run without an API client
omit adc8a1139f1 Parse coordinator-claimed Dag files with their runtime in
a Dag bag
omit cb9d1e9ee3d Catch a runtime's dead connection when its parse request
is sent
omit 9007b91ed18 Apply the team rules to the Dag that validation returns
omit 302b4e0c7b5 Test the import errors of a bundle with several
coordinators of a class
omit 18744e8f554 Find a claiming Dag importer instead of its coordinator in
Dag processing
omit e62a4815b8f Name the coordinator class a native Dag task must be
routed to
omit 435e639a5e9 Stub Dag file discovery with DagFileInfo in the Lang-SDK
manager tests
omit 4ad06144a0e Pass a parse log handle to the Lang-SDK processor in tests
omit eb258495592 Find a native Dag's coordinator key through its importer
omit 0e680a3b2e2 Wait for the killed leftover in the Lang-SDK processor test
omit e434a396ff7 Move the client-less Lang-SDK parse out of this change
omit 22cd5aac3cd Note in ADR-0010 that the manager routes claimed files for
now
omit 913e53620c5 Clear import errors after the native-file Dag bag sync test
omit 58c66651378 Apply the multi-team task checks to Lang-SDK Dags
omit b5ed50699b4 Spec the mocks of a hand-built Lang-SDK processor in tests
omit 19810c730b3 Name the setting in a Lang-SDK parse timeout error
omit 303b0be7821 Kill what a Lang-SDK runtime leaves in its process group
omit 1169dbb91fa Match the schema error's JSON path in a Lang-SDK parse test
omit 2d6dd214ff5 Fail a native Dag's task on a Python worker without retries
omit 17f65afef02 Find the claiming coordinator in the Task SDK and wrap it
in core
omit a6359232b06 Start each Dag file processor with explicit arguments
omit 18de8bfa32d Drop callbacks for Lang-SDK Dag files before queuing the
file
omit bbea6488ded Report a native Dag's task that reaches a Python worker
omit c8a3306646d Report a Lang-SDK parse past its import timeout as an
import error
omit f1070b3884e Parse coordinator-claimed Dag files with their runtime in
the Dag processor
add 94a677e8f87 Keep callback triggers assigned to healthy triggerers
(#72848)
add 4e1f2aca67f Keep the Dag trigger button one-click when a run has
config (#74039)
add bfe84598a52 Fix destination path validation in GCS-to-SFTP transfers
(#74186)
add 8239997bf20 Scope UI next_run_assets endpoint to assets the caller may
read (#72862)
add 7df6f0e69cc Parse native Lang-SDK Dags in the Dag processor with their
runtime (#74035)
add cffc14d173b Parse native Lang-SDK Dags in a Dag bag (#74043)
add 9c6cd0e3396 Read JAR manifests per the JAR specification
add 1f361c2bcbc Build the JVM command that parses a Dag JAR
add c1a0bd225e1 Parse native Java Dags with their coordinator
add f6b87a7cae4 Treat an unreadable JAR like one without a manifest
add bb23794a6af Test the Java Dag source placeholder for a JAR without a
manifest
add 1e85316e871 Name the JAR manifest attributes the Java coordinator reads
add a28bdee1c03 Document native Java Dag parsing
add 45761df8bb7 Run a task on its run's version when dag_bundle_name names
its bundle
add 801e5a1f843 Pass the task's Dag file to the coordinator's command
builder
add 4c9eaf9b573 Report why a Java Dag JAR cannot be read
add e6933d81c5b Run the JAR a native Java Dag was parsed from
add 1e5f033d9fc Reject a Java Dag JAR whose SDK cannot answer a parse
add cb7ff0320fb Stop promising that Java dependency JARs are not parsed
add 2f3c1b7271c Keep the Java parse_dag test from changing the pytest
worker
add f950fb8b502 Hand out the Java Dag importer through get_dag_importer
add 3cd507c37b9 Read Java Dag sources from the bundle's sources.json index
add e63ffc3be9e Let the Java Dag importer find its coordinator
add d1ffa7d818d Fail a task cleanly when its runtime cannot be launched
add 03ac85138ab Run a native Dag's task from its own Dag file
add b5f144dc0ad Fail a native task cleanly when its file or coordinator
class cannot load
add 7a243c19d33 Say tasks list runs a native Java Dag's main class
add 3b6a9d0d48b Say a JRE parses native Java Dags, and keep main's bundle
test mocks
add 12307d82ea3 Parse native TypeScript Dags with the Node coordinator
add d1821478b82 Document parsing native TypeScript Dags
add 761ce1ab1af Share the bundle section mutation helper between Node tests
add db26372198b Run a native TypeScript Dag's task from its own bundle
add 7be05790dd6 Say when the Dag processor needs Node.js for TypeScript
bundles
add 2485d7c38c3 Align the TypeScript build docs with the Code view
add 58cf8d1a3e6 Warn against defining a Dag in both TypeScript and Python
add 861ffd6e9ef Import NodeDagImporter at the top of the Node coordinator
add fce03d56bcc Let NodeDagImporter source read errors reach the caller
add aac11e6a559 Pin the Code view to the entry module in Node bundle tests
add 881795f9d20 Hand out the Node Dag importer through get_dag_importer
add 158894e8564 Let the Node Dag importer find its coordinator
add 2b606617e9a Run a native TypeScript Dag's own bundle through the
native task branch
add 02f1e5169c0 Document how a NodeCoordinator is picked for parsing
TypeScript Dags
add 1e09e5fdfbe Say tasks list runs a native TypeScript Dag's bundle
add 1e2ed16c033 TS SDK: add conditional branching with dag.if
add b4a8b236277 TS SDK: add multi-way branching with dag.switch
add 698fae9d4e1 TS SDK: add triggerDagRun to the native Dag surface
add 6ef5cf3ca07 Java SDK: Declare a Dag's task graph with @Builder.Deps
add 4e24713ecfa Java SDK: Serialize native Dags to DagSerialization v3 on
parse requests
add 10d8f689db6 Java SDK: Record the class that declares each Dag and
describe it on request
add e87621078ba Java SDK: Pack each native Dag's source file into the
bundle JAR
add 57b3bdfcfbe TS SDK: cover native TypeScript Dags end to end
add 07b996c2878 Parse the native TypeScript Dag in the compose e2e
add 91419a9354d Check the native TypeScript Dag's source and triggered run
add 32a2f578da0 Keep the containerized Java build's Maven repository on
the host
add 242a4aeaf14 Add a native Java Dag to the compose e2e
add c5e8e4629c0 Run the Lang-SDK e2e jobs when native Dag parsing changes
add b8b62b3f095 Share the Dag run lookup and the native Java queue name
add 13cdecd622d Build the k8s TypeScript artifacts only for the native Dag
test
add 022fa493fc5 Key the Lang-SDK e2e jobs on native Dag modules only
add b0482d2f459 Build the TypeScript SDK before packing the k8s example
bundle
add baeb27354c1 Pack the TypeScript example against the built SDK
add d0a8c315fdb Explain why the k8s native TypeScript Dag test is skipped
add 6e6dd63f7ed Document how the TypeScript example's native Dag gets
parsed
add f8c09c9850b Name the skipped-branch e2e test after what it checks
add 49b905f6a94 Parse native Dags in the e2e by class, not by Dag bundle
name
add 65c3da24a2d Drop the dag_bundle_name reason from the k8s native
TypeScript skip
add 93d59326e6c Say which coordinator runs the native e2e Java tasks
add 78f1e76f095 Read a native Dag example's served Dags with bundleDags
add e78500da2e0 Keep the k8s lang-SDK values comment within the YAML line
limit
add bccf01269f5 Rework the lang-SDK k8s harness for mixed-language and
native Dag tests
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (01cd6f0e71c)
\
N -- N -- N refs/heads/jason/lang-sdk-e2e/08-native-e2e
(bccf01269f5)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../api_fastapi/core_api/routes/ui/assets.py | 1 +
airflow-core/src/airflow/models/trigger.py | 1 +
.../ui/public/i18n/locales/en/components.json | 4 +-
.../TriggerDag/TriggerDAGButton.test.tsx | 102 +++++++++++--
.../src/components/TriggerDag/TriggerDAGButton.tsx | 167 ++++++++++++---------
.../ui/src/system-components/Menu/MenuTrigger.tsx | 2 +-
.../api_fastapi/core_api/routes/ui/test_assets.py | 79 ++++++++++
airflow-core/tests/unit/models/test_trigger.py | 45 ++++++
.../google/cloud/transfers/gcs_to_sftp.py | 29 ++--
.../google/cloud/transfers/test_gcs_to_sftp.py | 50 ++++--
10 files changed, 372 insertions(+), 108 deletions(-)
