da-tubi commented on issue #31013: URL: https://github.com/apache/airflow/issues/31013#issuecomment-1643568519
> My team is trying to move towards "reactive" DAGs, where we don't want to schedule downstreams DAGs and use sensors. This is because we are trying to reduce redundant DAG executions, and it's easier for the team to manually retrigger failed DAG runs. (Just trigger upstream, and it will automatically run downstream DAGs) We need "reactive" DAGs too. In my option, we need a Dataset with a logical start date. For example: | dataset | logical date | |-------------|------------------| | example dataset 1 | 2023/01/01 01:00:00 | | example dataset 2 | 2023/01/01 02:00:00 | | example dataset 3 | 2023/01/01 03:00:00 | The above three dataset events should trigger the dag_run. But if there are not in the same logical date, it will not trigger the dag_run. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
