More flexible unit tests for the Helm Chart

2020-10-23 Thread Kamil BreguĊ‚a
Hello, I want to highlight the change we are talking about on Github. It does not significantly impact Apache Airflow, but I think it is a significant change in one of our "sub-projects" - Helm Chart for Apache Airflow. https://github.com/apache/airflow/issues/11657 In this change, I proposed mi

Re: Add /ready-to-test bot to airflow CI

2020-10-23 Thread Daniel Imberman
+1000! via Newton Mail [https://cloudmagic.com/k/d/mailapp?ct=dx&cv=10.0.51&pv=10.15.6&source=email_footer_2] On Fri, Oct 23, 2020 at 8:22 AM, Jarek Potiuk wrote: Thanks Tobiasz :). fantastic. I prepared a very short and simple design doc https://docs.google.com/document/d/16rwyCfyDpKWN-DrLYbhj

Re: [DISCUSS] Documentation Improvements for Airflow 2.0

2020-10-23 Thread Kaxil Naik
Thanks all, I am going to go through all the feedback and get something actionable soon. On Fri, Oct 23, 2020 at 11:54 PM Leah Cole wrote: > Hey! Sorry I'm so late to this party. My email management in 2020 is not > quite what I want it to be. If you're still looking for opinions I know I > have

Re: [DISCUSS] Documentation Improvements for Airflow 2.0

2020-10-23 Thread Leah Cole
Hey! Sorry I'm so late to this party. My email management in 2020 is not quite what I want it to be. If you're still looking for opinions I know I have some about operator documentation, and if they're not relevant now, I'm sending them in case they're useful in the future! I'm looking at the docum

Re: Much more stable CI tests (hopefully!)

2020-10-23 Thread Jarek Potiuk
I re-enabled all the optimizations yesterday - as of this morning all PRs that are only touching some "areas" of the code - should only run relevant tests and nothing else - so they should be faster than usual. We are still fighting with the "job limit" the whole ASF has and we applied for some cre

Re: Add /ready-to-test bot to airflow CI

2020-10-23 Thread Jarek Potiuk
Thanks Tobiasz :). fantastic. I prepared a very short and simple design doc https://docs.google.com/document/d/16rwyCfyDpKWN-DrLYbhjU0B1D58T1RFYan5ltmw4DQg/edit# where we can collaborate. I also added you as collaborator to https://github.com/potiuk/get-workflow-origin that we already use, and I

Re: Supported Postgres Versions in Airflow 2.0

2020-10-23 Thread Jarek Potiuk
9.6 and 13 sound like a good plan :) On Fri, Oct 23, 2020 at 1:51 PM Ash Berlin-Taylor wrote: > Given my experience with Postgres in the past, I've never noticed any > regressions between versions, not for the kind of run-of-the-mill usage we > are doing, so I would vote for testing oldest versi

Re: Supported Postgres Versions in Airflow 2.0

2020-10-23 Thread Ash Berlin-Taylor
Given my experience with Postgres in the past, I've never noticed any regressions between versions, not for the kind of run-of-the-mill usage we are doing, so I would vote for testing oldest version we want to support (to make sure the features we use are in that version) and the latest stable.

Supported Postgres Versions in Airflow 2.0

2020-10-23 Thread Jarek Potiuk
Following the discussions in Slack: https://apache-airflow.slack.com/archives/CCQ7EGB1P/p1603448752476900 Which versions of Postgres we should support and use in Airlfow 2.0? According to: https://www.postgresql.org/support/versioning/ Version Current minor Supported First Release Final Release

Re: [Reminder] Airflow Issue Triage process call today

2020-10-23 Thread Ash Berlin-Taylor
Hey, Vikram's off today, but yes there were notes taken, and we'll get them published Monday or Tuesday, sorry for the delay! -a On Oct 23 2020, at 8:51 am, Jarek Potiuk wrote: > Hey Vikram, > > Are there any meeting notes? I could not take part the last time as I was > preparing for a customer

Re: [Reminder] Airflow Issue Triage process call today

2020-10-23 Thread Jarek Potiuk
Hey Vikram, Are there any meeting notes? I could not take part the last time as I was preparing for a customer training, but I am rather interested in taking more active part in it in the future. I think this is super important topic to solve now and for the future. J. On Tue, Oct 20, 2020 at 4