GitHub user vitstransky added a comment to the discussion: DataprocCreateBatchOperator: Retry on 5xx errors for deferrable
Hello, thank you for your answer and suggestion. We currently generate unique batch_id for each task run, even for retries, so this would not work for us. The same issue was already solved for Dataflow and Cloud Run. https://github.com/apache/airflow/pull/66293 https://github.com/apache/airflow/pull/67219 Would it be possible to implement the same retry logic in DataprocCreateBatchOperator? Best regards, Vit GitHub link: https://github.com/apache/airflow/discussions/73675#discussioncomment-18605482 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
