[GitHub] [airflow] KKcorps commented on issue #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready
KKcorps commented on issue #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#issuecomment-553223976 @kaxil @potiuk what is the difference between processor_poll_interval & min_file_process_interval Which of these control how frequently a DAG will be parsed? In my opinion, it should be min_file_process_interval but it has a default value of 0 in default-airflow.cfg This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [airflow] KKcorps commented on issue #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready
KKcorps commented on issue #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#issuecomment-551902906 I was also thinking to actually place this doc in the main section and name is **Best Practices** or something similar. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [airflow] KKcorps commented on issue #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready
KKcorps commented on issue #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#issuecomment-551690166 @potiuk Yes, I am all for it. Personally, I also faced this issue. I have mentioned in the documentation that you shouldn't write a lot of code outside the DAG because of frequent parsing but I'll this point as well. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [airflow] KKcorps commented on issue #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready
KKcorps commented on issue #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#issuecomment-551142274 Surge UI - http://airflow.kharekartik-prod-dag.surge.sh/howto/dags-in-production.html This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services