Fwd: Looking for a facilitator for a contributor workshop for Airflow

2019-07-24 Thread Aizhamal Nurmamat kyzy
Hello Airflow community, Gris is an Open Source Strategist at Google (my manager, in fact:)). She is organizing a summit for open source contributors in Guadalajara, Mexico. It is a big event geared to bringing new contributors to open source projects. They are looking for a person to guide a work

Re: [DISCUSS] AIP-12 Persist DAG into DB

2019-07-24 Thread Gabriel Silk
I'm really excited about this feature, and I'd love to be able to provide feedback on the proposed design. On Thu, Jul 18, 2019 at 10:21 AM Tao Feng wrote: > Thanks Ash. This will be huge! > > On Thu, Jul 18, 2019 at 4:00 AM Jarek Potiuk > wrote: > > > Cool! > > > > On Thu, Jul 18, 2019 at 11:4

Re: [VOTE] Release Airflow 1.10.4 from RC3

2019-07-24 Thread Ash Berlin-Taylor
James and I debugged a bit and we tracked down the problem to the multiprocessing.Manager process leaking. So I've removed the Manager entirely here https://github.com/apache/airflow/pull/5615 (whilst also not using a mp.Queue and the problems we had with unpredictable behaviour around it.) Onc

Reminder - Webinar/Screencast tomorrow "How to easily Develop Apache Airflow"

2019-07-24 Thread Jarek Potiuk
Just a reminder - tomorrow together with Ash a screencast/webinar on developing Airflow. It will be available here: https://www.youtube.com/watch?v=MvqhJPrPMA4 Time: Tthursday 6.30 PM CEST (5.30pm London, 12.30pm New York, 9.30 pm San Francisco, 2.30am :( Sydney ) There will be Hangouts-on-Air

Re: [Discuss] AIP-23 Proposal "Migration out of Travis CI"

2019-07-24 Thread Jarek Potiuk
Of course ! One of the considerations is to keep travis CI build intact - so that anyone will be able to have their own Travis Fork for the time being. I will also do it in the way that once you have your own GCP account and your own GKE cluster, you will be able to replicate it as well (there wil

Re: [VOTE] Changes in import paths

2019-07-24 Thread Driesprong, Fokko
Thanks Kamil for putting the document together. I wasn't able to respond earlier since I was giving Airflow workshops throughout Europe :-) *Case 1: *Solution A → Remove everything from contrib into a single package. To make it easier to the end-user, my preference would be to get rid of the cont

Re: [Discuss] AIP-23 Proposal "Migration out of Travis CI"

2019-07-24 Thread Chao-Han Tsai
Thanks Jarek for putting this together. We really need a stable and fast CI. Question: will we still be able to build our personal fork of Airflow on our own Travis? Chao-Han On Tue, Jul 23, 2019 at 1:00 PM Jarek Potiuk wrote: > > > > Question - what is the purpose of introducing kaniko instea