uranusjr commented on code in PR #73518: URL: https://github.com/apache/airflow/pull/73518#discussion_r4129974418
########## airflow-core/adr/lang-sdk/0011-bundle-metadata-and-cache-digest.md: ########## @@ -0,0 +1,122 @@ +<!-- + Licensed to the Apache Software Foundation (ASF) under one + or more contributor license agreements. See the NOTICE file + distributed with this work for additional information + regarding copyright ownership. The ASF licenses this file + to you under the Apache License, Version 2.0 (the + "License"); you may not use this file except in compliance + with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, + software distributed under the License is distributed on an + "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY + KIND, either express or implied. See the License for the + specific language governing permissions and limitations + under the License. + --> + +# ADR-0011: Bundle Metadata — Retiring the Build-Time Inventory, Converging on a Cache Digest + +## Status + +Proposed + +## Context + +[ADR-0010](0010-persisted-task-handler-bindings.md) resolves a stub task to its artifact during Dag +processing and persists the result, so nothing searches for an artifact at execution time. Two +consequences land on the artifact format: the build-time Dag inventory loses its only purpose, and +the Dag processor gains a new need — a stable value it can compare cheaply to decide whether +re-validation is required. + +Today that artifact carries a build-time inventory of the Dag and task ids it exposes. This is what +`airflow-go-pack` emits, and what the published schema requires +([`$id`](https://github.com/apache/airflow/blob/79991cd4db0c9346a28b23c453377f6df0c6b4ed/task-sdk/docs/airflow-metadata.schema.json#L3), +[`required`](https://github.com/apache/airflow/blob/79991cd4db0c9346a28b23c453377f6df0c6b4ed/task-sdk/docs/airflow-metadata.schema.json#L7)): + +```yaml +airflow_bundle_metadata_version: "1.0" +sdk: + language: "go" + version: "0.1.0" + supervisor_schema_version: "2026-06-16" +source: "main.go" +dags: # <-- frozen when the artifact was built + etl: + tasks: + - "extract" + - "transform" + reporting: + tasks: + - "publish" +``` + +## Decision + +### The artifact carries no Dag or task identifiers + +After this change an artifact contains exactly three things: + +``` +┌─────────────────────────────────────────────────────────────────────────┐ +│ compiled artifact the executable, JAR, or bundled code │ +│ entrypoint source the authored source, verbatim, for display │ +│ metadata only what is needed to launch and to trust │ +└─────────────────────────────────────────────────────────────────────────┘ +``` + +and the metadata region is reduced to this: + +```yaml +airflow_bundle_metadata_version: "1.0" Review Comment: Do we need to bump this if `dags` is now removed? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
