[VOTE] Release Apache Airflow 1.10.8 based on 1.10.8rc1

2020-02-03 Thread Kaxil Naik
Hello Airflow Community, This is a call for the vote to release Apache Airflow version 1.10.8. The release candidate: https://dist.apache.org/repos/dist/dev/airflow/1.10.8rc1/ *apache-airflow-1.10.8rc1-source.tar.gz* is a source release that comes with INSTALL instructions. *apache-airflow-1.10.

Re: [DISCUSS] Airflow functional DAGs

2020-02-03 Thread Daniel Imberman
I like this idea a lot. We could create something similar to an “executor_config” so people can pre-populate most of the parameters necessary for a python_operator and pass it in e.g. Config = AirflowPythonConfig(…) @airflow.make_python_operator(config) def my_func(): On Mon, Feb 3, 2020 a

Re: [DISCUSS] Airflow functional DAGs

2020-02-03 Thread Dan Davydov
I like it : ). I think the difficulty in creating operators and chaining them together is one of the most common complaints about Airflow compared to other frameworks. Would be curious to see a comparison to other interfaces e.g. Dagster as well. I would be curious to see what other committers like

Re: Failing Master

2020-02-03 Thread Jarek Potiuk
Thanks for asking ! Really appreciated!. I think adding better diagnostics for docker containers might be a good idea. At this point seems that most of the builds are passing. Yesterday we had some failures due to an old PR merged (but it was quickly fixed by Kaxil !). We still have intermittent

Re: Call for presentations for ApacheCon North America 2020 now open

2020-02-03 Thread Jarek Potiuk
IMHO it depends on the subject. I plan to have talks about Community with some learnings from Apache Airflow community. I think also Observability for some areas of Airflow such as lineage might be a good fit. Content Delivery is general enough to cover a lot of topics related to Airflow. And yes