dabla commented on PR #44240: URL: https://github.com/apache/airflow/pull/44240#issuecomment-2505710114
> What was the stactrace of such issue @dabla -> I have a hard time to figure out what race/parallelism could have caused it. Don't know if I still have the stacktrace, I'm afraid not, but the error was the one from the title, namely AttributeError: '_thread._local' object has no attribute 'callers' in ExecutorSafeguard. But as I explained, we only have this error because we are doing mulithreading (not multiprocessing as this isn't possible due to the fact that tasks are already executed in dedicated processes within the worker) using our inhouse StreamedOperator instead of expand for some DAG's, I'm quite certain (but cannot back this of course) when using Airflow with regular operators and expand that you won't encounter this issue. I was also a bit surprised to encounter this as you would expect that the thread local would be initialised anyway as it was written originally. Or maybe this is a bug in the Python 3.9 implementation of threadlocal? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
