GitHub user FelipeRamos-neuro edited a discussion: Can't clear only a single map index from a dynamic mapped task without clearing the other map indexes as well. Known limitation or bug?
I'm using Airflow 2.10.4 and my dynamic task also makes use of setup and teardown tasks to create AWS EMR clusters. Each map index is responsible for creating a cluster, executing a script on it as an EMR step, monitoring its status and terminating the resource at the end. In case one of the jobs fails, I would like to retry only that map index but Airflow ends up re-executing all map indexes and creating all clusters again :( GitHub link: https://github.com/apache/airflow/discussions/46566 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
