I see. You may want to look at task mapping <https://airflow.apache.org/docs/apache-airflow/2.3.0/concepts/dynamic-task-mapping.html>. I.e. have one task find out which files there are to process, then map over them, creating an instance of the task for each object. I.e. instead of creating a new dag run for each (though that can work too). I'm not sure what you struggled to retrieve with trigger dag run op but... if you want to give more details go ahead.
- TriggerDagRunOperator: name of the DAG that trig... Hervé Ballans
- Re: TriggerDagRunOperator: name of the DAG ... Jarek Potiuk
- Re: TriggerDagRunOperator: name of the ... Daniel Standish via users
- Re: TriggerDagRunOperator: name of ... Hervé Ballans
- Re: TriggerDagRunOperator: name... Daniel Standish via users
- Re: TriggerDagRunOperator:... Niki Kim
