Re: [VOTE] Airflow Backport Providers 2020.10.5rc1

2020-10-05 Thread Kamil BreguĊ‚a
Is there any time pressure or any other pressure for us to release this package now? I think Kubernetes is highly anticipated by users and it is worth considering the arguments that motivate us to make a given decision. -1 to release without cncf.kubernetes and an incomplete google package (withou

Re: [VOTE] Airflow Backport Providers 2020.10.5rc1

2020-10-05 Thread Kaxil Naik
+1 to release without cncf.kubernetes On Mon, Oct 5, 2020 at 6:27 PM Jarek Potiuk wrote: > (though of course releasing it without Kubernetes might be a little less > exciting Daniel ;) > > On Mon, Oct 5, 2020 at 7:25 PM Jarek Potiuk > wrote: > >> We have 2 +1s now and the comment about the 'cnc

Re: [VOTE] Airflow Backport Providers 2020.10.5rc1

2020-10-05 Thread Jarek Potiuk
(though of course releasing it without Kubernetes might be a little less exciting Daniel ;) On Mon, Oct 5, 2020 at 7:25 PM Jarek Potiuk wrote: > We have 2 +1s now and the comment about the 'cncf.kubernetes" not yet > working. > > My proposal: > > * we continue with the voting (hopefully one more

Re: [VOTE] Airflow Backport Providers 2020.10.5rc1

2020-10-05 Thread Jarek Potiuk
We have 2 +1s now and the comment about the 'cncf.kubernetes" not yet working. My proposal: * we continue with the voting (hopefully one more +1) and release all the sources + backport but do nto publish the cncf.kubernetes one. * we fix (who can take a look?) the cncf.kubernetes one and release

[Reminder] Airflow 2.0 Dev call Today

2020-10-05 Thread Kaxil Naik
Hi all, I would like to remind whoever is interested in helping in Airflow 2.0 Release process that we will have our weekly developer call today: *Airflow 2.0 Dev Call Calendar Link*: https://calendar.google.com/calendar/embed?src=c_dhdh3bdjc42c4ngtnpg7ovcs9g%40group.calendar.google.com&ctz=Europ

Re: Improvements in the optimised CI builds

2020-10-05 Thread Jarek Potiuk
It was indeed quite annoying. A better solution is in place now (Just merged it). You will see Build Image steps with link as "checks" if you need them and in case "Build Image" fails, the bot will post a comment with link where you will be able to find out the reason. J. On Mon, Oct 5, 2020 at

Re: [DISCUSS] Removing Pickling from Airflow 2.0

2020-10-05 Thread Kaxil Naik
Thank You for the thoughts. I will create a VOTE thread at some point today / early tomorrow. Regards, Kaxil On Mon, Sep 21, 2020 at 6:11 PM Jarek Potiuk wrote: > Happy to kill pickling for 2.0. While starting to review the HA, I see > that more and more we rely on Serialization and there are s

[DISCUSS] Task trigger rules: exit code based

2020-10-05 Thread Ashok Kumar rathore
Hi All, I created this small doc for AIP. Wanted to discuss the feasibility as well as my understanding of the problem/solution. *TLDR; Feasibility to use task exit code as branching condition for downstream task scheduling* Thank you in advance. https://docs.google.com/document/d/1OGwnF9igWS5b6

Airflow Kubernetes Integration

2020-10-05 Thread Vara Pradeep Ravula
Dear Good Day !! We have a plan to run Airflow on Kubernetes Operators but the documentation is limited to start the setup on Ubuntu 18.x. So, could you please share the required steps in details to proceed further. *Best Regards* *Vara*

Re: Improvements in the optimised CI builds

2020-10-05 Thread Jarek Potiuk
OK. I found a better solution :) . PR is coming :). On Mon, Oct 5, 2020 at 9:21 AM Jarek Potiuk wrote: > Hello everyone, > > Based on comments of people and questions asked at Slack, I've added a few > improvements to t our optimized CI builds but I would like to ask for > help/opinion. > > 1) I

Improvements in the optimised CI builds

2020-10-05 Thread Jarek Potiuk
Hello everyone, Based on comments of people and questions asked at Slack, I've added a few improvements to t our optimized CI builds but I would like to ask for help/opinion. 1) I've fixed a problem where we were building slightly different build than the "merged commit" in PR. Github performs a