Bas Harenslak created AIRFLOW-5825:
--------------------------------------
Summary: SageMakerEndpointOperator is not idempotent
Key: AIRFLOW-5825
URL: https://issues.apache.org/jira/browse/AIRFLOW-5825
Project: Apache Airflow
Issue Type: Improvement
Components: aws
Affects Versions: 2.0.0, 1.10.7
Reporter: Bas Harenslak
The SageMakerEndpointOperator currently taken an argument "operation" with
value "create"/"update" which determines whether to create or update a
SageMaker endpoint. However this doesn't work in the following situation:
* DAG run #1 create the endpoint
* Following DAG runs will update the endpoint created by DAG run #1
Which should be a very valid use case IMO.
The SageMakerEndpointOperator should check itself if an endpoint with name X
already exists and overwrite it (configurable desired by the user).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
