Re: [DISCUSS] Guidelines for Releasing Providers packages

2021-04-14 Thread Daniel Standish
The proposal to bump major for all providers with every core minor version seems like a reasonable solution to me, and it sounds like there may be consensus on that? Though eventially the version numbers may get pretty large :) This discussion came to my attiontion from engagement with the vault

Re: Triage role for Jed Cunnigham

2021-04-14 Thread Kaxil Naik
Forgot to update: Jed has confirmed he has the necessary issue triage perms. On Mon, Apr 12, 2021 at 2:25 PM Kaxil Naik wrote: > Thank you all. > > I have raised a ticket with ASF Infra and will let you'll know the > progress by EOD today. > > Regards, > Kaxil > > On Mon, Apr 12, 2021 at 2:19

Re: Searchable Slack archives are now here -- if we want it.

2021-04-14 Thread Ash Berlin-Taylor
Hi Tao, It's written with being able to support multiple workspaces in mind, but the code may not work 100%, so I'll need to take a look :) Roughly it's get a data export as an admin, and then install the slack app in your workspace, and then I make some config changes on the install.

Re: [DISCUSS] AIP-1 and Airflow multi-tenancy

2021-04-14 Thread Daniel Imberman
Thank you Ian, I’ve invited everyone on this thread to the meeting with that zoom link. Anyone else who wants to join can add the calendar event here https://calendar.google.com/event?action=TEMPLATE=Mm4zN2Q3MnFwNnBqbW9hMmNocXMyNzJpdHYgZGFuaWVsQGFzdHJvbm9tZXIuaW8=daniel%40astronomer.io On Wed,

Re: [DISCUSS] AIP-1 and Airflow multi-tenancy

2021-04-14 Thread Ian Buss
If this works for everyone, here's a zoom link for Thursday 8AM PST: https://cloudera.zoom.us/j/99928254235?pwd=VTFlQk4vQjQ5Z2JzUDM3ZWZKKy9MQT09 Happy to move or use an alternate method as needed. On Wed, Apr 14, 2021 at 6:58 PM Daniel Imberman wrote: > Thursday works for me! > > On Wed, Apr

Re: [DISCUSS] AIP-1 and Airflow multi-tenancy

2021-04-14 Thread Daniel Imberman
Thursday works for me! On Wed, Apr 14, 2021 at 10:05 AM, Ian Buss wrote: Hi all, I actually can’t do Wednesday next week as I’m moving house :) Any chance we could do Thursday or Friday at the same time? Cheers Ian On 14 Apr 2021, 17:49 +0100, Kaxil Naik , wrote: Just few comments here:

Re: Searchable Slack archives are now here -- if we want it.

2021-04-14 Thread Tao Feng
Hey Ash, That's great! I am interested in using for my other open source project ( https://github.com/amundsen-io/amundsen) which is currently hitting the 10k message limit as well. I wonder what it takes to setup/enable for other slack workspace? Thanks, -Tao On Wed, Apr 14, 2021 at 5:40 AM

Re: [DISCUSS] AIP-1 and Airflow multi-tenancy

2021-04-14 Thread Ian Buss
Hi all, I actually can’t do Wednesday next week as I’m moving house :) Any chance we could do Thursday or Friday at the same time? Cheers Ian On 14 Apr 2021, 17:49 +0100, Kaxil Naik , wrote: > Just few comments here: > > Currently -- atleast for the foreseeable future Airflow workers will need

Re: [DISCUSS] AIP-1 and Airflow multi-tenancy

2021-04-14 Thread Kaxil Naik
Just few comments here: Currently -- atleast for the foreseeable future Airflow workers will need access to the DAG Files, so workers can not run using the Serialized DAGs. Also serialized DAGs do not even have all the info needed for it to run it. Currently the serialization happens in the

Re: [DISCUSS] AIP-1 and Airflow multi-tenancy

2021-04-14 Thread Andrew Godwin
I'd quite like to be involved as well since this is something I'm very interested in getting in - 8am PST on the 21st works fine, as well. Andrew On Wed, Apr 14, 2021 at 10:35 AM Daniel Imberman wrote: > How about Wednesday, April 21 at 8:00AM PST? > > On Wed, Apr 14, 2021 at 9:33 AM, Xinbin

Re: [DISCUSS] AIP-1 and Airflow multi-tenancy

2021-04-14 Thread Daniel Imberman
How about Wednesday, April 21 at 8:00AM PST? On Wed, Apr 14, 2021 at 9:33 AM, Xinbin Huang wrote: I am available any days. On Wed, Apr 14, 2021, 9:32 AM Daniel Imberman < daniel.imber...@gmail.com [daniel.imber...@gmail.com] > wrote: Hi everyone! Would people be available around 8AM/9AM PST

Re: [DISCUSS] AIP-1 and Airflow multi-tenancy

2021-04-14 Thread Xinbin Huang
I am available any days. On Wed, Apr 14, 2021, 9:32 AM Daniel Imberman wrote: > Hi everyone! > > Would people be available around 8AM/9AM PST some point next week? I’m in > PST and Ian is UTC+1 so would be great to find a timezone that accomodates > everyone. > > Daniel > On Wed, Apr 14, 2021

Re: [DISCUSS] AIP-1 and Airflow multi-tenancy

2021-04-14 Thread Daniel Imberman
Hi everyone! Would people be available around 8AM/9AM PST some point next week? I’m in PST and Ian is UTC+1 so would be great to find a timezone that accomodates everyone. Daniel On Wed, Apr 14, 2021 at 6:26 AM, Ryan Hatter wrote: I’d also like to be added please :) On Apr 13, 2021, at 21:27,

Re: Searchable Slack archives are now here -- if we want it.

2021-04-14 Thread Sumit Maheshwari
Great work Ash, +1 from my side on keeping this. Also liked the domain "slack-archives.org" :) On Wed, Apr 14, 2021 at 6:10 PM Ash Berlin-Taylor wrote: > Hello everyone, > > Thanks to prompting from Sumit, I have "resurrected" a project I started > back in 2019, and have got searchable slack

Re: [DISCUSS] AIP-1 and Airflow multi-tenancy

2021-04-14 Thread Ryan Hatter
I’d also like to be added please :) > On Apr 13, 2021, at 21:27, Xinbin Huang wrote: > >  > Hi Daniel & Ian, > > I am also interested in the idea of a serialization representation that can > be executed by workers directly. Can you also add me to the call? > > Thanks > Bin > >> On Tue,

Re: [LAZY CONSENSUS] Policy for supporting K8S versions

2021-04-14 Thread Ash Berlin-Taylor
I guess it wasn't quite clear what "finish" means, particularly how it interacts with SemVer and Airflow releases. Lets take Python 3.6 as a concrete example -- it is end of life at the end of this year, 23rd Dec, 202 1 <> Does dropping support for Python 3.6,

Searchable Slack archives are now here -- if we want it.

2021-04-14 Thread Ash Berlin-Taylor
Hello everyone, Thanks to prompting from Sumit, I have "resurrected" a project I started back in 2019, and have got searchable slack archives available: (This is a fancy looking URL, there is nothing else on the domain yet. Any other projects

Re: New Committers: Qian Yu & Xinbin Huang

2021-04-14 Thread Yu Qian
Thank you everyone! On Mon, Apr 12, 2021 at 10:25 AM Vikram Koka wrote: > Awesome! > Congratulations to both of you! > > > On Fri, Apr 9, 2021 at 1:27 PM Aizhamal Nurmamat kyzy > wrote: > >> Congratulations to both of you! Looking forward to seeing more >> contributions :) >> >> On Thu, Apr 8,

Re: [VOTE] Release Airflow Python Client 2.0.0 based on 2.0.0rc2

2021-04-14 Thread Sumit Maheshwari
Thanks for the confirmation Jarek. I would create a new Voting thread, hence closing this one. On Wed, Apr 14, 2021 at 1:21 PM Jarek Potiuk wrote: > correct > > On Wed, Apr 14, 2021 at 6:05 AM Sumit Maheshwari > wrote: > >> Thanks, Jarek and Kaxil for catching this before it went live. >> >>

Re: [VOTE] Release Airflow Python Client 2.0.0 based on 2.0.0rc2

2021-04-14 Thread Jarek Potiuk
correct On Wed, Apr 14, 2021 at 6:05 AM Sumit Maheshwari wrote: > Thanks, Jarek and Kaxil for catching this before it went live. > > So if I understand correctly, the package name would be > *apache-airflow-client*, which means users would be able to install it > via *pip install