ashb commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error
occurs when the scheduler tries to run on macOS.
URL: https://github.com/apache/airflow/pull/7128#discussion_r367406479
##########
File path: airflow/utils/dag_processing.py
##########
@@ -388,12 +415,20 @@ def _run_processor_manager(dag_directory,
processor_factory,
processor_timeout,
signal_conn,
- async_mode):
+ dag_ids,
+ pickle_dags,
+ async_mode,
+ inherited_conf=None):
# Make this process start as a new process group - that makes it easy
# to kill all sub-process of this at the OS-level, rather than having
# to iterate the child processes
os.setpgid(0, 0)
+ if inherited_conf is not None: # pylint:
disable=too-many-nested-blocks
+ for section in inherited_conf:
+ for key, value in inherited_conf[section].items():
+ if value not in conf:
+ conf.set(section, key, value.replace("%", "%%"))
Review comment:
This looks suspect. What's going on here?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
