[PR] Implement wait_job_until_complete parameter for KubernetesJobOperator [airflow]

2024-03-08 Thread via GitHub
moiseenkov opened a new pull request, #37998: URL: https://github.com/apache/airflow/pull/37998 PR introduces the optional `wait_job_until_complete` parameter for the `KubernetesJobOperator` that blocks execution until the created job is complete. The default value is `False` thus behavio

Re: [PR] Implement wait_job_until_complete parameter for KubernetesJobOperator [airflow]

2024-03-11 Thread via GitHub
dirrao commented on code in PR #37998: URL: https://github.com/apache/airflow/pull/37998#discussion_r1519522639 ## airflow/providers/cncf/kubernetes/hooks/kubernetes.py: ## @@ -512,6 +513,36 @@ def get_job(self, job_name: str, namespace: str) -> V1Job: """ retu

Re: [PR] Implement wait_job_until_complete parameter for KubernetesJobOperator [airflow]

2024-03-11 Thread via GitHub
dirrao commented on code in PR #37998: URL: https://github.com/apache/airflow/pull/37998#discussion_r1519522639 ## airflow/providers/cncf/kubernetes/hooks/kubernetes.py: ## @@ -512,6 +513,36 @@ def get_job(self, job_name: str, namespace: str) -> V1Job: """ retu

Re: [PR] Implement wait_job_until_complete parameter for KubernetesJobOperator [airflow]

2024-03-12 Thread via GitHub
moiseenkov commented on code in PR #37998: URL: https://github.com/apache/airflow/pull/37998#discussion_r1521429853 ## airflow/providers/cncf/kubernetes/hooks/kubernetes.py: ## @@ -512,6 +513,36 @@ def get_job(self, job_name: str, namespace: str) -> V1Job: """

Re: [PR] Implement wait_job_until_complete parameter for KubernetesJobOperator [airflow]

2024-03-12 Thread via GitHub
eladkal commented on code in PR #37998: URL: https://github.com/apache/airflow/pull/37998#discussion_r1518051764 ## airflow/providers/cncf/kubernetes/hooks/kubernetes.py: ## @@ -512,6 +513,36 @@ def get_job(self, job_name: str, namespace: str) -> V1Job: """ ret

Re: [PR] Implement wait_job_until_complete parameter for KubernetesJobOperator [airflow]

2024-03-12 Thread via GitHub
moiseenkov commented on code in PR #37998: URL: https://github.com/apache/airflow/pull/37998#discussion_r1521550867 ## airflow/providers/cncf/kubernetes/hooks/kubernetes.py: ## @@ -512,6 +514,33 @@ def get_job(self, job_name: str, namespace: str) -> V1Job: """

Re: [PR] Implement wait_job_until_complete parameter for KubernetesJobOperator [airflow]

2024-03-12 Thread via GitHub
dirrao commented on code in PR #37998: URL: https://github.com/apache/airflow/pull/37998#discussion_r1521811359 ## airflow/providers/cncf/kubernetes/operators/job.py: ## @@ -135,6 +144,18 @@ def execute(self, context: Context): ti.xcom_push(key="job_name", value=self.jo

Re: [PR] Implement wait_job_until_complete parameter for KubernetesJobOperator [airflow]

2024-03-12 Thread via GitHub
moiseenkov commented on code in PR #37998: URL: https://github.com/apache/airflow/pull/37998#discussion_r1521820110 ## airflow/providers/cncf/kubernetes/operators/job.py: ## @@ -135,6 +144,18 @@ def execute(self, context: Context): ti.xcom_push(key="job_name", value=sel

Re: [PR] Implement wait_job_until_complete parameter for KubernetesJobOperator [airflow]

2024-03-12 Thread via GitHub
moiseenkov commented on code in PR #37998: URL: https://github.com/apache/airflow/pull/37998#discussion_r1521820110 ## airflow/providers/cncf/kubernetes/operators/job.py: ## @@ -135,6 +144,18 @@ def execute(self, context: Context): ti.xcom_push(key="job_name", value=sel