Re: [DISCUSS] Donating Airflow k8s Operator

Some doc or content about what is it and potential use cases and why we should use this would be great. Thanks for everything! On Fri, Jan 17, 2020 at 1:04 AM Jiajie Zhong wrote: > It’s great for community, I can see the repo in > https://github.com/apache/airflow-on-k8s-operator < > https://gi

Re: Google Summer of Code Announced. Interested?

Hello everyone, I have added some 40+ issues to gsoc issues (by labelling them in JIRA as hinted by Pablo). I've also subscribed to "mentors" list and looking forward to further actions Maybe other commiters/PMC members who would like to take part in it can review the list : https://issues.apach

QCon, Data Council & other venues for Data Engineering stories

Hi Folks! Hope you are well. As some of you may know, I co-chair a conference series known as QCon . If you are unfamiliar with QCon, ours is a global family of practitioner-driven conferences with annual events in SF, NY, Lond

Re: [DISCUSS] Improving security by decoupling the CLI from the database

One comment on all of this: I'm not a fan of a _requiring_ separate api server component to be run - for smaller deployments (of which there are a lot!) this increases the memory requirements by a noticeable fraction. -ash On 19 January 2020 19:58:34 GMT+03:00, Jarek Potiuk wrote: >Some comm

Re: Remove Dask Executor in Airflow 2.0 ?

Seems like there is an interest https://github.com/dask/dask/issues/5803 :). Let's see where it gets us. J. On Sat, Jan 18, 2020 at 9:46 PM Jarek Potiuk wrote: > Following discussion Dask's gitter, I created an issue in Dask's github : > https://github.com/dask/dask/issues/5803 > > Let's see i

Re: Google Summer of Code Announced. Interested?

Hello Jarek, Thankyou so much. Really appreciate it. Regards Yajna. On Fri, 17 Jan, 2020, 3:24 AM Jarek Potiuk, wrote: > Hello Yajna, > > I think this is a very valid point - we have no place whatsoever to ask > "newbie questions" - and where people who are new are not intimidated. > > Or rathe

Re: [DISCUSS] Improving security by decoupling the CLI from the database

Some comments from my side: Bolke: Direct database access for users is a no go. Direct queries that in anyway > manipulate the database or any state in Airfl ow (trigger dags, connections > etc) from the CLI should be prevented. Absolutely agree in principle. But we have to discuss and accept p