James Coder created AIRFLOW-5177: ------------------------------------ Summary: scheduler_job command passes scheduler dag location Key: AIRFLOW-5177 URL: https://issues.apache.org/jira/browse/AIRFLOW-5177 Project: Apache Airflow Issue Type: Bug Components: scheduler Affects Versions: 1.10.4, 1.10.3 Reporter: James Coder
There seems to be somewhere or inconsistency in one of these items. In my airflow set up the DAG location is not consistent across the scheduler and the workers. Meaning DAGS in the scheduler reside in /home/usr/airflow/... where as on my workers the DAGS may exist in /home/user/123... The issue I'm seeing is that when scheduler job call generate_commad, it uses SimpleDag, which only has full_filepath, and sends the command out with the -sd param as /home/usr/airflow..., then when the worker picks it up, it fails because the dag actually exists somewhere else (AIRFLOW_HOME is set as env variable). It looks like it should replace /home/usr/airflow with DAGS_FOLDER/, or some other handling. -- This message was sent by Atlassian JIRA (v7.6.14#76016)