gopidesupavan commented on issue #50185: URL: https://github.com/apache/airflow/issues/50185#issuecomment-2908470186
Looks like the lock inside sync_to_async function causing issues, its likely messing up with threads acquired in side the sync_to_async. We use get_ti_count, get_task_states, get_dr_count from the `RuntimeTaskInstance`. likely this is not a good choice. I have Moved those functions to async version without using sync_to_async and working fine, did some stress test around 400 triggers nothing locked everything running fine. @ArvidMartensRenson we may not need async client. i will raise changes for moving the functions to async, please test it once i raised? async client type also would be good , but in this case i dont see any need. its working without async client. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
