hussein-awala commented on PR #36492: URL: https://github.com/apache/airflow/pull/36492#issuecomment-1872652191
> > Ok. As @hussein-awala said, it's worth trying accessing DB using async. This is a healthy discussion. Thank you @potiuk. > > Yep. I am waiting to see it 👀 Therea are two problems: > > * for MetaData DB we use sqlalchemy and I **think** async only works well for Postgres (and only in newer drivers). Or at least that was the case so far.. And SyncToAsync is not necessarily a good solution (@Taragolis had a lot to say about it in the past) > * for Secrets Managers it's worse - because we would have to implement a new async/await interface for them and even if we will implement it for some (all?) of our Secret Managers this will not work for custom mangers that were implemented before by our users. I opened #36504 to share the initial result of my POC; I'm also working on a new executor that uses the async sessions, and so far, it works without any issues (I tested it with SQLite and Postgres). We can discuss all the concerns there. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org