Subham-KRLX commented on issue #63760: URL: https://github.com/apache/airflow/issues/63760#issuecomment-4072367666
I have analyzed this issue and it's a valid regression in Airflow 3. The DatabricksExecutionTrigger crashes because it accesses synchronous cached_propertys (like databricks_conn) from within an async event loop. This triggers a sync connection lookup in the Task SDK that uses async_to_sync, leading to the reported RuntimeError. The fix is straightforward: we can asynchronously pre-populate the connection cache in BaseDatabricksHook.__aenter__ before the polling loop starts. I have a solution ready and would be happy to submit a PR with this fix and accompanying tests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
