ignacioparicio commented on PR #70280: URL: https://github.com/apache/airflow/pull/70280#issuecomment-5152796600
Not a review, just something I ran into that seems relevant. I think this PR does more than add a per-task override. The config fallback in `_should_use_exec_for_task` also makes `[core] execute_tasks_new_python_interpreter` work again for CeleryExecutor and LocalExecutor, which has had no effect since 3.0. The Celery code that reads it sits behind an `if not AIRFLOW_V_3_0_PLUS:` gate, and as far as I can tell the Edge worker is the only thing still honouring it on 3.x. I opened https://github.com/apache/airflow/pull/70901 in parallel to document that and get `airflow config lint` to flag it (happy to rework it if this lands first). So if this merges it's a behaviour change for anyone still running Celery or Local with `execute_tasks_new_python_interpreter` set to `True`, which might deserve a newsfragment of its own. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
