Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-04-22 Thread Gerard Casas Saez
Re: https://github.com/apache/airflow/issues/8052 I am okay with Databand starting to take on this. I plan to contribute some bits as well as I get more bandwidth and will definitely be reviewing PRs (even though my review is not binding). Also posted to Airflow Slack to have a thread there on

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-04-21 Thread Kaxil Naik
I think if we plan to have call let's make it public so whoever else wants to work on it can join too. We definitely can wait too if you will have more bandwidth in coming week or two :) Your call - since you created the AIP On Wed, Apr 22, 2020 at 12:57 AM Gerard Casas Saez wrote: > Yup, also

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-04-21 Thread Gerard Casas Saez
Yup, also happy to call w Evgeny for this. Most of the GitHub issues include context and enough information on what tickets need to be tackled first. So it should be easy to take on. I will also keep an eye for comments and we can discuss further there. I also hope to be more unlocked soon and

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-04-21 Thread Ash Berlin-Taylor
Before anyone starts cutting code for this, checkout the proof-of-concept that Gerard made here https://github.com/casassg/corrent/ -a On Apr 21 2020, at 8:40 pm, Evgeny Shulman wrote: > Hey Gerard and others, > > This AIP looks very relevant and interesting for me and my team. Tomorrow > we

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-04-21 Thread Evgeny Shulman
Hey Gerard and others, This AIP looks very relevant and interesting for me and my team. Tomorrow we will start to review AIP tasks and will take a few of them into development. We are missing this functionality a lot and we have a lot of experience implementing a similar approach. Hopefully, this

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-04-21 Thread Gerard Casas Saez
Hi Kaxil, Sorry, mainly blocked w other work at the moment. Hope to be able to take on this soonish rather than later. If someone has more bandwidth and wants to go ahead and start implementing, that would be great! Gerard Casas Saez Twitter | Cortex | @casassaez On Apr 21, 2020, 5:40 AM -0600,

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-04-21 Thread Kaxil Naik
Hi Gerard, Do you need anything from us to help get you started on Functional DAGs? Let us know, would love to see this started :) Regards, Kaxil On Thu, Apr 2, 2020 at 5:23 PM Kaxil Naik wrote: > I have assigned it to. > > On Thu, Apr 2, 2020 at 5:20 PM Gerard Casas Saez > wrote: > >> I wish

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-04-02 Thread Kaxil Naik
I have assigned it to. On Thu, Apr 2, 2020 at 5:20 PM Gerard Casas Saez wrote: > I wish, it seems I have no permissions to assign issues to myself. > > I was thinking on taking from 8052 to 8055 since they are all closely > related. I can take on more once those are finished. > > Gerard Casas Sa

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-04-02 Thread Gerard Casas Saez
I wish, it seems I have no permissions to assign issues to myself. I was thinking on taking from 8052 to 8055 since they are all closely related. I can take on more once those are finished. Gerard Casas Saez Twitter | Cortex | @casassaez On Apr 1, 2020, 9:35 PM -0600, Kaxil Naik , wrote: > Thank

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-04-01 Thread Kaxil Naik
Thanks for creating those issues. Can you assign the issues you plan to work by yourself. So that others who are interested can work on the remaining issues. Regards, Kaxil On Thu, Apr 2, 2020, 04:13 Gerard Casas Saez wrote: > Started to break down some tasks in GitHub, please find them here: >

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-04-01 Thread Gerard Casas Saez
Started to break down some tasks in GitHub, please find them here:  https://github.com/apache/airflow/issues?q=is%3Aissue+AIP-31+ I preferred to fall on the too small issues over the overloaded issues so there are quite a few of them. Some issues are more detailed than others. Any feedback on th

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-03-30 Thread Tomasz Urbaszek
Hi all, This vote has passed with: - 9 +1 votes (binding) - 0 -1 votes Thanks, everyone! Can't wait to help in implementing this AIP :) Keep safe, Tomek On Thu, Mar 26, 2020 at 11:48 PM Ash Berlin-Taylor wrote: > > +1 (binding) -- this will be a nice little polish to writing DAGs. > > -a > >

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-03-26 Thread Ash Berlin-Taylor
+1 (binding) -- this will be a nice little polish to writing DAGs. -a On Thu Mar 26, 2020 at 3:46 PM, Kamil Breguła wrote: > +1 binding > > > On Thu, Mar 26, 2020 at 3:41 PM Daniel Imberman > wrote: > > > > +1 binding. I volunteer to help implement as well :D > > On Mar 26, 2020, 7:15 AM -0700,

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-03-26 Thread Kamil Breguła
+1 binding On Thu, Mar 26, 2020 at 3:41 PM Daniel Imberman wrote: > > +1 binding. I volunteer to help implement as well :D > On Mar 26, 2020, 7:15 AM -0700, Jarek Potiuk , > wrote: > > +1 binding > > > > On Thu, Mar 26, 2020 at 8:59 AM Sumit Maheshwari > > wrote: > > > > > +1 binding > > > > >

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-03-26 Thread Daniel Imberman
+1 binding. I volunteer to help implement as well :D On Mar 26, 2020, 7:15 AM -0700, Jarek Potiuk , wrote: > +1 binding > > On Thu, Mar 26, 2020 at 8:59 AM Sumit Maheshwari > wrote: > > > +1 binding > > > > On Thu, Mar 26, 2020 at 9:50 AM Chao-Han Tsai > > wrote: > > > > > +1 binding > > > > > >

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-03-26 Thread Jarek Potiuk
+1 binding On Thu, Mar 26, 2020 at 8:59 AM Sumit Maheshwari wrote: > +1 binding > > On Thu, Mar 26, 2020 at 9:50 AM Chao-Han Tsai > wrote: > > > +1 binding > > > > On Wed, Mar 25, 2020 at 1:56 PM Kaxil Naik wrote: > > > > > +1 binding > > > > > > On Wed, Mar 25, 2020 at 8:55 PM Dan Davydov >

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-03-26 Thread Sumit Maheshwari
+1 binding On Thu, Mar 26, 2020 at 9:50 AM Chao-Han Tsai wrote: > +1 binding > > On Wed, Mar 25, 2020 at 1:56 PM Kaxil Naik wrote: > > > +1 binding > > > > On Wed, Mar 25, 2020 at 8:55 PM Dan Davydov > > > wrote: > > > > > Sorry +1 (binding) :). > > > > > > On Wed, Mar 25, 2020 at 4:53 PM Dan

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-03-25 Thread Chao-Han Tsai
+1 binding On Wed, Mar 25, 2020 at 1:56 PM Kaxil Naik wrote: > +1 binding > > On Wed, Mar 25, 2020 at 8:55 PM Dan Davydov > wrote: > > > Sorry +1 (binding) :). > > > > On Wed, Mar 25, 2020 at 4:53 PM Dan Davydov > wrote: > > > > > +1 > > > > > > On Wed, Mar 25, 2020 at 4:40 PM Tomasz Urbaszek

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-03-25 Thread Kaxil Naik
+1 binding On Wed, Mar 25, 2020 at 8:55 PM Dan Davydov wrote: > Sorry +1 (binding) :). > > On Wed, Mar 25, 2020 at 4:53 PM Dan Davydov wrote: > > > +1 > > > > On Wed, Mar 25, 2020 at 4:40 PM Tomasz Urbaszek < > > tomasz.urbas...@polidea.com> wrote: > > > >> Hello everyone! > >> > >> This email

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-03-25 Thread Dan Davydov
Sorry +1 (binding) :). On Wed, Mar 25, 2020 at 4:53 PM Dan Davydov wrote: > +1 > > On Wed, Mar 25, 2020 at 4:40 PM Tomasz Urbaszek < > tomasz.urbas...@polidea.com> wrote: > >> Hello everyone! >> >> This email calls for a vote on the design proposed in AIP-31: >> >> https://cwiki.apache.org/confl

Re: [VOTE] AIP-31: Airflow functional DAG definition

2020-03-25 Thread Dan Davydov
+1 On Wed, Mar 25, 2020 at 4:40 PM Tomasz Urbaszek wrote: > Hello everyone! > > This email calls for a vote on the design proposed in AIP-31: > > https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-31:+Airflow+functional+DAG+definition > > Discussion threads: > > https://lists.apache.org/thr

[VOTE] AIP-31: Airflow functional DAG definition

2020-03-25 Thread Tomasz Urbaszek
Hello everyone! This email calls for a vote on the design proposed in AIP-31: https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-31:+Airflow+functional+DAG+definition Discussion threads: https://lists.apache.org/thread.html/ra3bf1b20584ef1e4e0fb9b00f5b246d7f18b7c796edde8c807a8d86a%40%3Cdev