Subham-KRLX commented on issue #64213: URL: https://github.com/apache/airflow/issues/64213#issuecomment-4131948901
I think the root cause for that silent 403 it’s a classic cross thread event loop mismatch in the Triggerer Basically when AwsBaseHook pushes the connection lookup to a worker thread via sync_to_async TriggerCommsDecoder.send() tries to grab main thread loop objects from the worker thread's loop That’s what’s triggering the RuntimeError We need to make TriggerCommsDecoder thread aware by storing the main loop and using run_coroutine_threadsafe in the send() method also I think we should broaden ExecutionAPISecretsBackend to catch any cross-loop RuntimeError generally rather than just doing a string match since this affects all deferrable sync lookups it makes the most sense to bake the fix directly into the Task SDK. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
