Re: [PR] check sagemaker training job status before deferring SageMakerTrainingOperator [airflow]

2024-02-04 Thread via GitHub
phanikumv merged PR #36685: URL: https://github.com/apache/airflow/pull/36685 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

Re: [PR] check sagemaker training job status before deferring SageMakerTrainingOperator [airflow]

2024-01-31 Thread via GitHub
Lee-W commented on code in PR #36685: URL: https://github.com/apache/airflow/pull/36685#discussion_r1473735134 ## airflow/providers/amazon/aws/operators/sagemaker.py: ## @@ -1085,8 +1089,50 @@ def execute(self, context: Context) -> dict: raise AirflowException(f"Sag

Re: [PR] check sagemaker training job status before deferring SageMakerTrainingOperator [airflow]

2024-01-30 Thread via GitHub
pankajkoti commented on code in PR #36685: URL: https://github.com/apache/airflow/pull/36685#discussion_r1471079764 ## airflow/providers/amazon/aws/operators/sagemaker.py: ## @@ -1085,8 +1089,50 @@ def execute(self, context: Context) -> dict: raise AirflowException(

Re: [PR] check sagemaker training job status before deferring SageMakerTrainingOperator [airflow]

2024-01-30 Thread via GitHub
Lee-W commented on code in PR #36685: URL: https://github.com/apache/airflow/pull/36685#discussion_r1471055969 ## airflow/providers/amazon/aws/operators/sagemaker.py: ## @@ -1085,8 +1089,50 @@ def execute(self, context: Context) -> dict: raise AirflowException(f"Sag

Re: [PR] check sagemaker training job status before deferring SageMakerTrainingOperator [airflow]

2024-01-30 Thread via GitHub
Lee-W commented on code in PR #36685: URL: https://github.com/apache/airflow/pull/36685#discussion_r1471055450 ## airflow/providers/amazon/aws/hooks/sagemaker.py: ## @@ -1300,3 +1300,13 @@ def create_auto_ml_job( if "BestCandidate" in res: return re

Re: [PR] check sagemaker training job status before deferring SageMakerTrainingOperator [airflow]

2024-01-18 Thread via GitHub
pankajkoti commented on code in PR #36685: URL: https://github.com/apache/airflow/pull/36685#discussion_r1458515289 ## airflow/providers/amazon/aws/hooks/sagemaker.py: ## @@ -1300,3 +1300,13 @@ def create_auto_ml_job( if "BestCandidate" in res: retu

[PR] check sagemaker training job status before deferring SageMakerTrainingOperator [airflow]

2024-01-09 Thread via GitHub
Lee-W opened a new pull request, #36685: URL: https://github.com/apache/airflow/pull/36685 While running a sagemaker training job in deferrable mode, the condition might already be met before we defer the task into the trigger. This PR intends to check the job status before deferring the ta