Re: Airflow for Google Season of Docs 2019

2019-03-18 Thread Gerard Toonstra
This sounds interesting. I set up the site "ETL with airflow" ages ago and it's still getting daily forks / stars on github. I'm not a tech writer, but have good experience writing documentation and would like to learn about the scope and objectives and what the docs have to cover that's not alrea

Re: Airflow for Google Season of Docs 2019

2019-03-18 Thread Gerardo Curiel
Hi Aizhamal, Yes, it would be amazing if we could get some help around documentation. There's a few Jira tickets related to this as well. Who would like to be a mentor? On 13 March 2019 at 8:29:41 am, Aizhamal Nurmamat kyzy ( aizha...@google.com.invalid) wrote: Hello everyone, TL;DR Google Sea

Re: [RFC] Prototype for an Airflow landing page

2019-03-18 Thread Pablo Estrada
Hi Max, The repo is here: https://github.com/aijamalnk/airflow-website Best -P. On Mon, Mar 18, 2019 at 5:32 PM Maxime Beauchemin < maximebeauche...@gmail.com> wrote: > I'm curious to see the source, do you mind sharing the repo? > > Side note: I used Gatsby recently and thought it was pretty ama

Re: Graduated from the Incubator but Releases remain in Incubator Dist SVN

2019-03-18 Thread William Guo
Hi Dave, Thanks for the reminder, we have removed griffin release from incubator. Thanks, William On Fri, Mar 15, 2019 at 2:01 AM Dave Fisher wrote: > Hi - > > You still have releases in the Incubator’s area of SVN - > https://dist.apache.org/repos/dist/release/incubator/ < > https://dist.apac

Re: [RFC] Prototype for an Airflow landing page

2019-03-18 Thread Maxime Beauchemin
I'm curious to see the source, do you mind sharing the repo? Side note: I used Gatsby recently and thought it was pretty amazing for building static sites and beyond. Quick nit-picky comments: * logo is too small height:50px (along with margin-top: -10px) looks much better * dark footer needs pad

Re: Welcome Daniel Imberman as a new committer!

2019-03-18 Thread jiajie zhong
Congratulations, Daniel! -jiajie Sent from my iPhone > On Mar 19, 2019, at 07:45, Daniel Imberman wrote: > > Thank you everyone 🙂. Excited for this opportunity! > >> On Mon, Mar 18, 2019, 4:20 PM Kaxil Naik wrote: >> >> Congratulations Daniel 🎉 .. Well deserved. >> >> Regards, >> Kaxil >>

[RFC] Prototype for an Airflow landing page

2019-03-18 Thread Aizhamal Nurmamat kyzy
Hello all, As suggested previously , I have been working with Pablo (ccd) on the landing page for Apache Airflow. The site is ready and you can see at https://aijamalnk.github.io/airflow-website/

Re: Welcome Daniel Imberman as a new committer!

2019-03-18 Thread Daniel Imberman
Thank you everyone 🙂. Excited for this opportunity! On Mon, Mar 18, 2019, 4:20 PM Kaxil Naik wrote: > Congratulations Daniel 🎉 .. Well deserved. > > Regards, > Kaxil > > On Mon, Mar 18, 2019, 23:10 Deng Xiaodong wrote: > > > Congrats Daniel! > > > > XD > > > > On Tue, Mar 19, 2019 at 06:56 Kevi

Re: Welcome Daniel Imberman as a new committer!

2019-03-18 Thread Kaxil Naik
Congratulations Daniel 🎉 .. Well deserved. Regards, Kaxil On Mon, Mar 18, 2019, 23:10 Deng Xiaodong wrote: > Congrats Daniel! > > XD > > On Tue, Mar 19, 2019 at 06:56 Kevin Yang wrote: > > > Well deserved, congrats! > > > > Jarek Potiuk 于2019年3月18日 周一下午3:46写道: > > > > > Welcome Daniel! > > > >

Re: Welcome Daniel Imberman as a new committer!

2019-03-18 Thread Deng Xiaodong
Congrats Daniel! XD On Tue, Mar 19, 2019 at 06:56 Kevin Yang wrote: > Well deserved, congrats! > > Jarek Potiuk 于2019年3月18日 周一下午3:46写道: > > > Welcome Daniel! > > > > On Mon, Mar 18, 2019 at 11:43 PM Tao Feng wrote: > > > > > Hellow Airflowers, > > > > > > Please join the Apache Airflow PMC in

Re: Mutli-layered official image for Airflow

2019-03-18 Thread Jarek Potiuk
After some initial discussion and suggestion from Daniel, I split the change into three separate PRs which can be reviewed and merged separately: - AIRFLOW-4115 JIRA , PR - Docker file for

Re: Welcome Daniel Imberman as a new committer!

2019-03-18 Thread Kevin Yang
Well deserved, congrats! Jarek Potiuk 于2019年3月18日 周一下午3:46写道: > Welcome Daniel! > > On Mon, Mar 18, 2019 at 11:43 PM Tao Feng wrote: > > > Hellow Airflowers, > > > > Please join the Apache Airflow PMC in welcoming our newest committer: > > Daniel Imberman (a.k.a. dimberman

Re: Welcome Daniel Imberman as a new committer!

2019-03-18 Thread Jarek Potiuk
Welcome Daniel! On Mon, Mar 18, 2019 at 11:43 PM Tao Feng wrote: > Hellow Airflowers, > > Please join the Apache Airflow PMC in welcoming our newest committer: > Daniel Imberman (a.k.a. dimberman ). > > Daniel has been a key contributor on the Airflow K8S integratio

Re: Welcome Daniel Imberman as a new committer!

2019-03-18 Thread Aizhamal Nurmamat kyzy
Congratulations, Daniel! Excited to have you on board :) -Aizhamal On Mon, Mar 18, 2019 at 3:43 PM Tao Feng wrote: > Hellow Airflowers, > > Please join the Apache Airflow PMC in welcoming our newest committer: > Daniel Imberman (a.k.a. dimberman ). > > Daniel has b

Welcome Daniel Imberman as a new committer!

2019-03-18 Thread Tao Feng
Hellow Airflowers, Please join the Apache Airflow PMC in welcoming our newest committer: Daniel Imberman (a.k.a. dimberman ). Daniel has been a key contributor on the Airflow K8S integration and has been helping the community for a long time. Welcome Daniel, great t

Re: Multiple Schedulers - "scheduler_lock"

2019-03-18 Thread Ash Berlin-Taylor
Does anything change about your proposal if you do t assume that workers have “quick access” to the DAG files - i.e. what if we are on kube executors and the task spin up time plus git sync time is 30-60s? (Perhaps this is an extreme case, but we are talking about extreme cases) > On 18 Mar 201

Re: Multiple Schedulers - "scheduler_lock"

2019-03-18 Thread Bas Harenslak
Peter, The numbers you mention seem to come out of the blue. I think you’re oversimplifying it and cannot simply state 180/36 = 5 minutes. Throwing in numbers without explanation creates confusion. I have some questions when reading your AIP. I have to make lots of assumptions and think explai