James Coder created AIRFLOW-5177:
------------------------------------

             Summary: scheduler_job command passes scheduler dag location
                 Key: AIRFLOW-5177
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5177
             Project: Apache Airflow
          Issue Type: Bug
          Components: scheduler
    Affects Versions: 1.10.4, 1.10.3
            Reporter: James Coder


There seems to be somewhere or inconsistency in one of these items. In my 
airflow set up the DAG location is not consistent across the scheduler and the 
workers. Meaning DAGS in the scheduler reside in /home/usr/airflow/... where as 
on my workers the DAGS may exist in /home/user/123... The issue I'm seeing is 
that when scheduler job call generate_commad, it uses SimpleDag, which only has 
full_filepath, and sends the command out with the -sd param as 
/home/usr/airflow..., then when the worker picks it up, it fails because the 
dag actually exists somewhere else (AIRFLOW_HOME is set as env variable). 
It looks like it should replace /home/usr/airflow with DAGS_FOLDER/, or some 
other handling. 

 

 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Reply via email to