I-am-Uchenna commented on issue #47160:
URL: https://github.com/apache/airflow/issues/47160#issuecomment-4602968427

   I looked into this and the warning comes from two places in `listener.py`:
   
   1. `_fork_execute` calling `os.fork()` directly for task instance events
   2. `ProcessPoolExecutor` in the `executor` property defaulting to `fork` 
start method on Linux
   
   For the `ProcessPoolExecutor`, switching to `forkserver` context is 
straightforward since all callables and arguments passed through 
`submit_callable` are already picklable.
   
   For `_fork_execute`, the fork is intentional because the child runs 
user-provided extractors that may not be picklable (ruling out 
spawn/forkserver). The code already takes precautions for safe forking (ORM 
reconfiguration, os._exit), so suppressing the specific DeprecationWarning is 
the right approach here.
   
   Opening a PR with the fix now.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to