Re: [Discuss] Improving AIP process documentation

2020-08-24 Thread Gerard Casas Saez
Thanks Max for sharing. I will take a look and check what we should reuse from there as well. I also took a pass to the comments and edited + accepted suggestions. Let me know: https://docs.google.com/document/d/1hJDodc1xl4ixswPzAV4IAQu74sLnOOKjqecPgthLta4/edit Will try to read the document sent

Re: Move "Who uses Airflow?" (to Ecosystem? or new "users" page)?

2020-08-24 Thread Ry Walker
I do think it’s one of the fun and impressive things about airflow, and an easy first commit that can lead to more. As long as it’s near the bottom it’s not doing any harm. -Ry On Mon, Aug 24, 2020 at 7:55 PM Jarek Potiuk wrote: > I think README.md for Airflow should contain some most importa

Move "Who uses Airflow?" (to Ecosystem? or new "users" page)?

2020-08-24 Thread Jarek Potiuk
I think README.md for Airflow should contain some most important topics. I started to wonder if the README file is the best place for the list of companies using Airflow? I have no strong opinion either way but it feels a bit awkward to keep such a long list in README (especially that it becomes a

Re: [Discuss] Improving AIP process documentation

2020-08-24 Thread Maxime Beauchemin
For reference, here's SIP-0 (Superset Improvement Proposal 0) which defines the SIP process for Apache Superset: https://github.com/apache/incubator-superset/issues/5602 We also have a GitHub issue template for it: https://github.com/apache/incubator-superset/blob/master/.github/ISSUE_TEMPLATE/sip

Re: [DISCUSS] Enable Github Discussions on Apache Airflow Github Repo

2020-08-24 Thread Kaxil Naik
I mean I wouldn't want to drop Slack, it is so convenient for quick conversations, especially between committers too. I think Slack can co-exist with Github Discussions (GD), GD just replaces us...@airflow.apache.org On Mon, Aug 24, 2020, 21:14 Jarek Potiuk wrote: > I am all for moving especiall

Re: [DISCUSS] Enable Github Discussions on Apache Airflow Github Repo

2020-08-24 Thread Jarek Potiuk
I am all for moving especially looking at the roadmap: https://github.com/github/roadmap/issues/104 (Q4 2020). The question is whether it will serve all the purposes that slack serves now and whether we can just abandon slack in one go? J, On Mon, Aug 24, 2020 at 7:30 PM Tomasz Urbaszek wrote:

Re: [DISCUSS] Enable Github Discussions on Apache Airflow Github Repo

2020-08-24 Thread Tomasz Urbaszek
We had a small chat about this on slack: https://apache-airflow.slack.com/archives/CCPRP7943/p159838037700 I personally think that if our request for paid Slack is not accepted we should consider moving to Github Discussion. Even if we got paid plan, I would be in favor of migrating as we don'

Re: [DISCUSS] Enable Github Discussions on Apache Airflow Github Repo

2020-08-24 Thread Kaxil Naik
I agree and I share the same concern. But I see it as a drop-in replacement for the us...@airflow.apache.org list and is mostly similar to a forum which will be indexed by Search engine unlike Slack. Also as we are on a free plan with Slack, we can't see history :( -- We have asked Slack if they c

Re: [DISCUSS] Enable Github Discussions on Apache Airflow Github Repo

2020-08-24 Thread Deng Xiaodong
The only concern I can think of is it seems serving identical purpose of what Slack is serving at this moment (correct me if I’m wrong please). Then attentions (especially from folks who nicely volunteer to answer questions in community) would be distributed unnecessarily. XD > On 24 Aug 2020

[DISCUSS] Enable Github Discussions on Apache Airflow Github Repo

2020-08-24 Thread Kaxil Naik
Hi all, I know most of us might have already heard or read about Github Discussions . I noticed Apache Couchdb has been already using it: https://github.co

Re: Optimize KuberneteExecutor pod labels to task instance key

2020-08-24 Thread Daniel Imberman
Hi Ping, I think that’s a great idea! Would be glad to help merge this. via Newton Mail [https://cloudmagic.com/k/d/mailapp?ct=dx&cv=10.0.50&pv=10.15.5&source=email_footer_2] On Sun, Aug 23, 2020 at 11:33 PM, Ping Zhang wrote: Hi everyone, I was evaluating using *KubernetesExcutor* and found t

Re: Simplifying the KubernetesExecutor

2020-08-24 Thread Daniel Imberman
Hi Ping, This looks great! The only change I might suggest is maybe we check the “queue” field and set the router to KubernetesExecutor is “queue=‘kubernetes’”. What do you think? via Newton Mail [https://cloudmagic.com/k/d/mailapp?ct=dx&cv=10.0.50&pv=10.15.5&source=email_footer_2] On Mon, Aug

Re: Faster builds on CI + increased stability + easier to reproduce CI problems

2020-08-24 Thread Maxime Beauchemin
Great work! Investments in CI pay dividends to the whole community. On Sat, Aug 22, 2020 at 8:12 AM Jarek Potiuk wrote: > Hello everyone, > > Just wanted to let you know that we merged last week quite an overhaul of > the CI architecture we have in Github Actions. > > TL;DR; It should be faster,

[Reminder] Airflow 2.0 Dev call Today

2020-08-24 Thread Kaxil Naik
Hi all, I would like to remind whoever is interested in helping in Airflow 2.0 Release process that we will have our 2nd developer call today: *Airflow 2.0 Dev Call Calendar Link*: https://calendar.google.com/calendar?cid=Y19kaGRoM2JkamM0MmM0bmd0bnBnN292Y3M5Z0Bncm91cC5jYWxlbmRhci5nb29nbGUuY29t *T

Re: Remove Questions & Support Request template from github issues?

2020-08-24 Thread Jarek Potiuk
This has been fixed during the weekend - Tomek found out that we can have an external link defined rather than "Button" - we now have "Questions and Support" redirecting people to Airflow slack's signup page. On Wed, Jul 8, 2020 at 5:14 PM Tomasz Urbaszek wrote: > +1 for the first option, the bo

Re: Simplifying the KubernetesExecutor

2020-08-24 Thread Ping Zhang
ah, did not know that. Thanks for letting me know. The image is not that important, all the important information is in the gist: https://gist.github.com/pingzh/cc44c97336560b658d012c225a2242cc#file-jobdispatcherexecutor-py Best wishes Ping Zhang On Sun, Aug 23, 2020 at 11:59 PM Deng Xiaodong