vladimirbinshtok commented on issue #52943: URL: https://github.com/apache/airflow/issues/52943#issuecomment-3057233054
@fweilun The code currently doesn't attempt to retry the task; it only retries the `_check_success_task` function call (which is pointless). The implemented retry mechanism doesn't support `deferrable` and `wait_for_completion` flags, which would be pretty complicated to add, as you would need to pass the current retry number to the new task outside of the standard Airflow retry policy. No other Amazon operator has a retry policy for task failed to start errors (any service can have initialization issues), so I suggest aligning the same approach with the ECS operator. As mentioned in the document you attached, the solution to solve the Fargate start task error is to use Step Function (Step Function operator in Airflow), which will allow an independent retry mechanism. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
