Re: [I] KubernetesJobOperator Duplicate Pod Race Condition [airflow]
rachthree commented on issue #58496: URL: https://github.com/apache/airflow/issues/58496#issuecomment-3661937126 Thank you both, @stephen-bracken and @SameerMesiah97 ! Just took a look at the PR, will leave a comment. Hope that's alright! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] KubernetesJobOperator Duplicate Pod Race Condition [airflow]
stephen-bracken commented on issue #58496: URL: https://github.com/apache/airflow/issues/58496#issuecomment-3660386220 From what I understand this bug has always existed with the KubernetesJobOperator, but it is only exposed by the race condition when the Job Controller is slow to create the pod. The recent refactor fixed this for cases where `parallelism > 1`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] KubernetesJobOperator Duplicate Pod Race Condition [airflow]
SameerMesiah97 commented on issue #58496: URL: https://github.com/apache/airflow/issues/58496#issuecomment-3620431405 Might get fixed by PR #53368 (still under review). It's general fix for Kubernetes Jobs that take longer than expected to spawn Pods but I believe that it applies to your use case as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] KubernetesJobOperator Duplicate Pod Race Condition [airflow]
boring-cyborg[bot] commented on issue #58496: URL: https://github.com/apache/airflow/issues/58496#issuecomment-3553741432 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
