sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r367435592
########## File path: airflow/utils/dag_processing.py ########## @@ -388,12 +415,20 @@ def _run_processor_manager(dag_directory, processor_factory, processor_timeout, signal_conn, - async_mode): + dag_ids, + pickle_dags, + async_mode, + inherited_conf=None): # Make this process start as a new process group - that makes it easy # to kill all sub-process of this at the OS-level, rather than having # to iterate the child processes os.setpgid(0, 0) + if inherited_conf is not None: # pylint: disable=too-many-nested-blocks + for section in inherited_conf: + for key, value in inherited_conf[section].items(): + if value not in conf: + conf.set(section, key, value.replace("%", "%%")) Review comment: @ashb If only `test_reload_module` needs to dynamically change the configuration and propagate it to child processes, I'll remove `inherited_conf` and its related code. What do you think? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services