GitHub user wolfgesbro added a comment to the discussion: Sequential Execution 
of Dynamic Mapped Task

> No. dynamic tasks are run in parallel and that's the only reason why you 
> would like to use them this way. If you want to process your file 
> sequentially, it makes completely no sense to make it Dynamic Tasks.

I do not agree - dynamic tasks make sense to me also with sequential 
processing: They appear on the UI, and you can inspect their status without 
reading logs.

Thanks to the introduction of [the `max_active_tis_per_dagrun` 
parameter](https://stackoverflow.com/a/76279569) you can now easily limit the 
dynamic tasks to sequential scheduling (by setting that parameter to 1).


GitHub link: 
https://github.com/apache/airflow/discussions/26093#discussioncomment-13947007

----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]

Reply via email to