jonathanleek commented on issue #68908: URL: https://github.com/apache/airflow/issues/68908#issuecomment-4785480159
Based on my understanding of how things work, there are two ways to make an operator deferrable: 1) The operator passes a handle or execution id of some kind to the triggerer, which then polls a status endpoint until the job completes. We can't follow this pattern for Cloud functions, as there is no handle, and no status endpoint. 2) The open HTTP request is moved to the triggerer, which holds the idle connection open until it either gets a response or times out. I don't believe this works for this use case either, because the connection closes immediately after being sent. We could potentially implement this for synchronous long-running functions, but I don't believe it would solve @BarBuccianti 's use case as written. This is the pattern the `HttpTrigger` uses -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
