Re: [VOTE] AIP-8 Split Providers into Separate Packages for Airflow 2.0

2020-09-16 Thread Ash Berlin-Taylor
Yup, sorry for not replying, happy with this - we can work out exact details in a few weeks! -a On 16 September 2020 19:03:42 BST, Jarek Potiuk wrote: >Unless Ash has still some objections to my answer the vote has passed >with >5 "+1" votes. > >On Mon, Sep 14, 2020 at 1:23 PM Jarek Potiuk >w

Re: [VOTE] AIP-8 Split Providers into Separate Packages for Airflow 2.0

2020-09-16 Thread Jarek Potiuk
Unless Ash has still some objections to my answer the vote has passed with 5 "+1" votes. On Mon, Sep 14, 2020 at 1:23 PM Jarek Potiuk wrote: > Thanks Ash. > > Some good points Indeed. I am more and more convinced to SEMVER. I do > agree that consistently following SEMVER has some really nice pro

Re: [VOTE] AIP-8 Split Providers into Separate Packages for Airflow 2.0

2020-09-14 Thread Jarek Potiuk
Thanks Ash. Some good points Indeed. I am more and more convinced to SEMVER. I do agree that consistently following SEMVER has some really nice properties and makes user decisions easier. CALVER kind of passes the problem to the users rather than solve it by the maintainers. But the problem remain

Re: [VOTE] AIP-8 Split Providers into Separate Packages for Airflow 2.0

2020-09-14 Thread Ash Berlin-Taylor
On Sep 14 2020, at 11:01 am, Jarek Potiuk wrote: >> >> >> > We have to make sure that we have no dependencies core -> providers >> >> How do we handle writing logs to S3/GCS/Azure Blob storage, which >> depends on the hook from the provider to work? >> > > Good point. I will make sure tha

Re: [VOTE] AIP-8 Split Providers into Separate Packages for Airflow 2.0

2020-09-14 Thread Jarek Potiuk
I added the point about logging to the AIP. I'd love to hear more thoughts on how the SEMVER process might work for those numerous packages - Ash I'd love to understand what scheme you think is the best. One more comment for my options - I really like the point that Vikram made about the "lack" o

Re: [VOTE] AIP-8 Split Providers into Separate Packages for Airflow 2.0

2020-09-14 Thread Jarek Potiuk
> > > > We have to make sure that we have no dependencies core -> providers > > How do we handle writing logs to S3/GCS/Azure Blob storage, which > depends on the hook from the provider to work? > Good point. I will make sure that I address it in the PR as well. I think those should only work when

Re: [VOTE] AIP-8 Split Providers into Separate Packages for Airflow 2.0

2020-09-14 Thread Ash Berlin-Taylor
Two unanswered questions from me I'd like to see resolved first. In the AIP you say: > We have to make sure that we have no dependencies core -> providers How do we handle writing logs to S3/GCS/Azure Blob storage, which depends on the hook from the provider to work? > Versioning proposal is C

Re: [VOTE] AIP-8 Split Providers into Separate Packages for Airflow 2.0

2020-09-13 Thread Vikram Koka
+1 non-binding On Sun, Sep 13, 2020 at 2:20 PM Kaxil Naik wrote: > +1 binding > > On Sun, Sep 13, 2020 at 10:18 PM Daniel Imberman < > daniel.imber...@gmail.com> > wrote: > > > +1 (binding). > > > > via Newton Mail > > [ > > > https://cloudmagic.com/k/d/mailapp?ct=dx&cv=10.0.50&pv=10.15.6&sourc

Re: [VOTE] AIP-8 Split Providers into Separate Packages for Airflow 2.0

2020-09-13 Thread Kaxil Naik
+1 binding On Sun, Sep 13, 2020 at 10:18 PM Daniel Imberman wrote: > +1 (binding). > > via Newton Mail > [ > https://cloudmagic.com/k/d/mailapp?ct=dx&cv=10.0.50&pv=10.15.6&source=email_footer_2 > ] > On Sun, Sep 13, 2020 at 1:57 PM, Kevin Yang wrote: > +1 (binding) > > On Sun, Sep 13, 2020 at 1

Re: [VOTE] AIP-8 Split Providers into Separate Packages for Airflow 2.0

2020-09-13 Thread Daniel Imberman
+1 (binding). via Newton Mail [https://cloudmagic.com/k/d/mailapp?ct=dx&cv=10.0.50&pv=10.15.6&source=email_footer_2] On Sun, Sep 13, 2020 at 1:57 PM, Kevin Yang wrote: +1 (binding) On Sun, Sep 13, 2020 at 1:29 PM Jarek Potiuk wrote: > Hello Everyone, > > Last week, at the Airflow 2.0 meetin

Re: [VOTE] AIP-8 Split Providers into Separate Packages for Airflow 2.0

2020-09-13 Thread Kevin Yang
+1 (binding) On Sun, Sep 13, 2020 at 1:29 PM Jarek Potiuk wrote: > Hello Everyone, > > Last week, at the Airflow 2.0 meeting the people involved made a decision > that we are releasing Airlow 2.0 as a set of separate "core" and > "providers" packages - similarly to the 1.10 "backport providers"

[VOTE] AIP-8 Split Providers into Separate Packages for Airflow 2.0

2020-09-13 Thread Jarek Potiuk
Hello Everyone, Last week, at the Airflow 2.0 meeting the people involved made a decision that we are releasing Airlow 2.0 as a set of separate "core" and "providers" packages - similarly to the 1.10 "backport providers" packages. This decision effectively implements the "spirit" of the AIP-8 pro