Lee-W commented on code in PR #68889: URL: https://github.com/apache/airflow/pull/68889#discussion_r3473309594
########## airflow-core/docs/authoring-and-scheduling/assets.rst: ########## @@ -523,6 +523,30 @@ creates asset events with a partition key on each run. Partitioned events are intended for partition-aware downstream scheduling, and do not trigger non-partition-aware Dags. +Partitioned vs runtime-partitioned timetables +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +Two orthogonal timetable flags control how partition keys are produced: + +* ``partitioned=True`` — the partition key is determined by the timetable before + the task runs. The scheduler uses partition mappers to match upstream keys to + downstream keys and triggers partition-based Dag runs. + :class:`~airflow.sdk.CronPartitionTimetable` (producer) sets this flag; so does + :class:`~airflow.sdk.PartitionedAssetTimetable` (consumer). + +* ``partitioned_at_runtime=True`` — partition selection is deferred to task runtime: + the producing task records key(s) via ``outlet_events[self].add_partitions(...)``. + :class:`~airflow.sdk.PartitionAtRuntime` sets this flag and never schedules on its Review Comment: Makes sense. Thanks! Did not catch it back in PR review 🤦♂️ Let me create another PR (so this PR is doc only) to rename it to `PartitionedAtRuntime`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
