This is an automated email from the ASF dual-hosted git repository.
jason810496 pushed a change to branch jason/lang-sdk-e2e/05-node-dag-importer
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit 2c701f77683 Say tasks list runs a native TypeScript Dag's bundle
omit 0154593f57f Document how a NodeCoordinator is picked for parsing
TypeScript Dags
omit 974f317a53e Run a native TypeScript Dag's own bundle through the
native task branch
omit 3b501289acd Let the Node Dag importer find its coordinator
omit 4a9614c4d60 Hand out the Node Dag importer through get_dag_importer
omit 5d55239c61b Pin the Code view to the entry module in Node bundle tests
omit f575d0881d4 Let NodeDagImporter source read errors reach the caller
omit d3fee16ecba Import NodeDagImporter at the top of the Node coordinator
omit 6c34a8c3474 Warn against defining a Dag in both TypeScript and Python
omit 3868f2bf8c4 Align the TypeScript build docs with the Code view
omit 00f8e4fb806 Say when the Dag processor needs Node.js for TypeScript
bundles
omit 8291c5f7d5e Run a native TypeScript Dag's task from its own bundle
omit ca29303c831 Share the bundle section mutation helper between Node tests
omit 1250325386f Document parsing native TypeScript Dags
omit 88e664abce4 Parse native TypeScript Dags with the Node coordinator
omit 6ea3559be1f Say a JRE parses native Java Dags, and keep main's bundle
test mocks
omit a29362e2222 Say tasks list runs a native Java Dag's main class
omit 3cac0914bf2 Fail a native task cleanly when its file or coordinator
class cannot load
omit fdc6419f944 Run a native Dag's task from its own Dag file
omit 36dd9ba46fc Fail a task cleanly when its runtime cannot be launched
omit 4730ebcb2ec Let the Java Dag importer find its coordinator
omit 3d69ad70225 Read Java Dag sources from the bundle's sources.json index
omit 7f6a9bf43d1 Hand out the Java Dag importer through get_dag_importer
omit d65628d1389 Keep the Java parse_dag test from changing the pytest
worker
omit b31a55269be Stop promising that Java dependency JARs are not parsed
omit 47994663aec Reject a Java Dag JAR whose SDK cannot answer a parse
omit 896ca55a16c Run the JAR a native Java Dag was parsed from
omit cafdd50a702 Report why a Java Dag JAR cannot be read
omit 6dd1d7e51be Pass the task's Dag file to the coordinator's command
builder
omit 57608c10c75 Run a task on its run's version when dag_bundle_name names
its bundle
omit 22f8deb00c6 Document native Java Dag parsing
omit 0f3419c6003 Name the JAR manifest attributes the Java coordinator reads
omit 630a1ace317 Test the Java Dag source placeholder for a JAR without a
manifest
omit 1f284da999b Treat an unreadable JAR like one without a manifest
omit 5b01319aa9d Parse native Java Dags with their coordinator
omit d89ef663004 Build the JVM command that parses a Dag JAR
omit e0d458d078d Read JAR manifests per the JAR specification
omit e88645e4355 Default a Dag file processor's parse log to os.devnull
omit 72c6990dbf9 Let a Dag file processor run without a parse log file
omit c9f3b5c6cf5 Ignore the bagged Dag union in the external task sensor
test
omit 124cd3b8e37 List the tasks of a native Lang-SDK Dag
omit d6d9f16bb81 Bag native Lang-SDK Dags in core, only when asked
omit 6c7606ed591 Let a Dag file processor run without an API client
omit adc8a1139f1 Parse coordinator-claimed Dag files with their runtime in
a Dag bag
omit cb9d1e9ee3d Catch a runtime's dead connection when its parse request
is sent
omit 9007b91ed18 Apply the team rules to the Dag that validation returns
omit 302b4e0c7b5 Test the import errors of a bundle with several
coordinators of a class
omit 18744e8f554 Find a claiming Dag importer instead of its coordinator in
Dag processing
omit e62a4815b8f Name the coordinator class a native Dag task must be
routed to
omit 435e639a5e9 Stub Dag file discovery with DagFileInfo in the Lang-SDK
manager tests
omit 4ad06144a0e Pass a parse log handle to the Lang-SDK processor in tests
omit eb258495592 Find a native Dag's coordinator key through its importer
omit 0e680a3b2e2 Wait for the killed leftover in the Lang-SDK processor test
omit e434a396ff7 Move the client-less Lang-SDK parse out of this change
omit 22cd5aac3cd Note in ADR-0010 that the manager routes claimed files for
now
omit 913e53620c5 Clear import errors after the native-file Dag bag sync test
omit 58c66651378 Apply the multi-team task checks to Lang-SDK Dags
omit b5ed50699b4 Spec the mocks of a hand-built Lang-SDK processor in tests
omit 19810c730b3 Name the setting in a Lang-SDK parse timeout error
omit 303b0be7821 Kill what a Lang-SDK runtime leaves in its process group
omit 1169dbb91fa Match the schema error's JSON path in a Lang-SDK parse test
omit 2d6dd214ff5 Fail a native Dag's task on a Python worker without retries
omit 17f65afef02 Find the claiming coordinator in the Task SDK and wrap it
in core
omit a6359232b06 Start each Dag file processor with explicit arguments
omit 18de8bfa32d Drop callbacks for Lang-SDK Dag files before queuing the
file
omit bbea6488ded Report a native Dag's task that reaches a Python worker
omit c8a3306646d Report a Lang-SDK parse past its import timeout as an
import error
omit f1070b3884e Parse coordinator-claimed Dag files with their runtime in
the Dag processor
add 94a677e8f87 Keep callback triggers assigned to healthy triggerers
(#72848)
add 4e1f2aca67f Keep the Dag trigger button one-click when a run has
config (#74039)
add bfe84598a52 Fix destination path validation in GCS-to-SFTP transfers
(#74186)
add 8239997bf20 Scope UI next_run_assets endpoint to assets the caller may
read (#72862)
add 7df6f0e69cc Parse native Lang-SDK Dags in the Dag processor with their
runtime (#74035)
add cffc14d173b Parse native Lang-SDK Dags in a Dag bag (#74043)
add 9c6cd0e3396 Read JAR manifests per the JAR specification
add 1f361c2bcbc Build the JVM command that parses a Dag JAR
add c1a0bd225e1 Parse native Java Dags with their coordinator
add f6b87a7cae4 Treat an unreadable JAR like one without a manifest
add bb23794a6af Test the Java Dag source placeholder for a JAR without a
manifest
add 1e85316e871 Name the JAR manifest attributes the Java coordinator reads
add a28bdee1c03 Document native Java Dag parsing
add 45761df8bb7 Run a task on its run's version when dag_bundle_name names
its bundle
add 801e5a1f843 Pass the task's Dag file to the coordinator's command
builder
add 4c9eaf9b573 Report why a Java Dag JAR cannot be read
add e6933d81c5b Run the JAR a native Java Dag was parsed from
add 1e5f033d9fc Reject a Java Dag JAR whose SDK cannot answer a parse
add cb7ff0320fb Stop promising that Java dependency JARs are not parsed
add 2f3c1b7271c Keep the Java parse_dag test from changing the pytest
worker
add f950fb8b502 Hand out the Java Dag importer through get_dag_importer
add 3cd507c37b9 Read Java Dag sources from the bundle's sources.json index
add e63ffc3be9e Let the Java Dag importer find its coordinator
add d1ffa7d818d Fail a task cleanly when its runtime cannot be launched
add 03ac85138ab Run a native Dag's task from its own Dag file
add b5f144dc0ad Fail a native task cleanly when its file or coordinator
class cannot load
add 7a243c19d33 Say tasks list runs a native Java Dag's main class
add 3b6a9d0d48b Say a JRE parses native Java Dags, and keep main's bundle
test mocks
add 12307d82ea3 Parse native TypeScript Dags with the Node coordinator
add d1821478b82 Document parsing native TypeScript Dags
add 761ce1ab1af Share the bundle section mutation helper between Node tests
add db26372198b Run a native TypeScript Dag's task from its own bundle
add 7be05790dd6 Say when the Dag processor needs Node.js for TypeScript
bundles
add 2485d7c38c3 Align the TypeScript build docs with the Code view
add 58cf8d1a3e6 Warn against defining a Dag in both TypeScript and Python
add 861ffd6e9ef Import NodeDagImporter at the top of the Node coordinator
add fce03d56bcc Let NodeDagImporter source read errors reach the caller
add aac11e6a559 Pin the Code view to the entry module in Node bundle tests
add 881795f9d20 Hand out the Node Dag importer through get_dag_importer
add 158894e8564 Let the Node Dag importer find its coordinator
add 2b606617e9a Run a native TypeScript Dag's own bundle through the
native task branch
add 02f1e5169c0 Document how a NodeCoordinator is picked for parsing
TypeScript Dags
add 1e09e5fdfbe Say tasks list runs a native TypeScript Dag's bundle
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (2c701f77683)
\
N -- N -- N refs/heads/jason/lang-sdk-e2e/05-node-dag-importer
(1e09e5fdfbe)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../api_fastapi/core_api/routes/ui/assets.py | 1 +
airflow-core/src/airflow/models/trigger.py | 1 +
.../ui/public/i18n/locales/en/components.json | 4 +-
.../TriggerDag/TriggerDAGButton.test.tsx | 102 +++++++++++--
.../src/components/TriggerDag/TriggerDAGButton.tsx | 167 ++++++++++++---------
.../ui/src/system-components/Menu/MenuTrigger.tsx | 2 +-
.../api_fastapi/core_api/routes/ui/test_assets.py | 79 ++++++++++
airflow-core/tests/unit/models/test_trigger.py | 45 ++++++
.../google/cloud/transfers/gcs_to_sftp.py | 29 ++--
.../google/cloud/transfers/test_gcs_to_sftp.py | 50 ++++--
10 files changed, 372 insertions(+), 108 deletions(-)
