Re: New PMC Member: Jarek Potiuk

Well deserved Jarek and see you next week at ApacheCon! Cheers, Fokko Op za 19 okt. 2019 om 04:42 schreef Ishan Rastogi : > Congratulations Jarek :) > > On Sat, Oct 19, 2019 at 4:16 AM Jarek Potiuk > wrote: > > > Happy to become a PMC member for such awesome community and see all the > >

Re: [VOTE] Release 1.10.6 from 1.10.6rc1

Thank you Jarek for the clarification, that make sense! I might be ignorant but do we have an official place stating the python version we support? People might not be keep tracking of the Python version in CI and use breeze doc as a reference. Do you think it make sense to update breeze doc to

Re: New PMC Member: Jarek Potiuk

Congratulations Jarek :) On Sat, Oct 19, 2019 at 4:16 AM Jarek Potiuk wrote: > Happy to become a PMC member for such awesome community and see all the > congrats :) > > It's an even greater responsibility than I had so far, and I am really > excited to bear it. > > That's about the right time -

Re: [VOTE] Release 1.10.6 from 1.10.6rc1

This is really what's intended. 1.10 supports officialy 2.7/3.5/3.6. See for example here where we do not test against 3.7 https://travis-ci.org/apache/airflow/builds/599638353 On the other hand 2.0.*/master should support 3.5, 3.6, 3.7 (and we test against all those versions): for example here -

Re: Announcing SIG-Knative/ The Monthly Knative Executor Meetup/Call-for-contributers

Haha yeah finding a time that works with PST and Central Europe is a bit rough . We will definitely record/take notes! On Fri, Oct 18, 2019 at 7:45pm, Kevin Yang < yrql...@gmail.com [yrql...@gmail.com] > wrote:  Thank you. On Fri, Oct 18, 2019 at 3:41 PM Kaxil Naik wrote: > Either we would

Re: New PMC Member: Jarek Potiuk

Happy to become a PMC member for such awesome community and see all the congrats :) It's an even greater responsibility than I had so far, and I am really excited to bear it. That's about the right time - next week I am at Apache Con Berlin - speaking about Airflow and running a workshop for -

Re: Announcing SIG-Knative/ The Monthly Knative Executor Meetup/Call-for-contributers

 Thank you. On Fri, Oct 18, 2019 at 3:41 PM Kaxil Naik wrote: > Either we would record or have meeting notes :) > > On Fri, Oct 18, 2019 at 11:27 PM Kevin Yang wrote: > > > Sry that I didn't notice the event is 8am-9am. Can we the events recorded > > by any chance? > > > > On Thu, Oct 17,

Re: [VOTE] Release 1.10.6 from 1.10.6rc1

Just started to play with it for a bit and seems like we got a small bit inconsistency between what version of python breeze supports. The code would allow only `2.7, 3.5, 3.6` but we claim we support `3.5, 3.6, 3.7`

Re: Announcing SIG-Knative/ The Monthly Knative Executor Meetup/Call-for-contributers

Either we would record or have meeting notes :) On Fri, Oct 18, 2019 at 11:27 PM Kevin Yang wrote: > Sry that I didn't notice the event is 8am-9am. Can we the events recorded > by any chance? > > On Thu, Oct 17, 2019 at 11:10 PM Maxime Beauchemin < > maximebeauche...@gmail.com> wrote: > > >

Re: Announcing SIG-Knative/ The Monthly Knative Executor Meetup/Call-for-contributers

Sry that I didn't notice the event is 8am-9am. Can we the events recorded by any chance? On Thu, Oct 17, 2019 at 11:10 PM Maxime Beauchemin < maximebeauche...@gmail.com> wrote: > Nice! > > On Wed, Oct 16, 2019 at 1:19 PM Ash Berlin-Taylor > wrote: > > > We meant October 30th (the date in the

Re: New PMC Member: Jarek Potiuk

Congrats Jarek, well deserved! Thanks, QP Hou On Fri, Oct 18, 2019 at 2:22 PM Rafal Biegacz wrote: > > Jarek - congratulations! > > Regards, Rafal > (Composer = Managed Airflow on GCP) > > On Fri, Oct 18, 2019 at 11:18 PM Tomasz Urbaszek < > tomasz.urbas...@polidea.com> wrote: > > > Congrats

Re: New PMC Member: Jarek Potiuk

Congratulations! You absolutely deserve this! You do a very good job. On Fri, Oct 18, 2019 at 11:05 PM Kaxil Naik wrote: > > Hi Airflow community, > > The Project Management Committee (PMC) for Apache Airflow > has invited Jarek Potiuk to become a PMC member and we are pleased > to announce

Re: [DISCUSS] Syncer to sync dags in initContainers in KubernetesExecutor

Hello, Cloud Composer stores the source code for your workflows (DAGs) and their dependencies in specific folders in Cloud Storage and uses Cloud Storage FUSE to map the folders to the Airflow instances in Cloud Composer environment. More info:

Re: New PMC Member: Jarek Potiuk

Jarek - congratulations! Regards, Rafal (Composer = Managed Airflow on GCP) On Fri, Oct 18, 2019 at 11:18 PM Tomasz Urbaszek < tomasz.urbas...@polidea.com> wrote: > Congrats Jarek! You’re a great source of knowledge and inspiration. It’s a > pleasure to work with you ;) > > Bests, > Tomek > >

Re: New PMC Member: Jarek Potiuk

Congratulations Jarek! You absolutely deserve this! On Fri, Oct 18, 2019 at 6:12pm, Kevin Yang < yrql...@gmail.com [yrql...@gmail.com] > wrote: Congrats! Well deserved. Ash Berlin-Taylor 于2019年10月18日 周五下午2:08写道： > And we'll deserved too! Congrats. > > -a > > On 18 October 2019 22:05:33 BST,

Re: New PMC Member: Jarek Potiuk

Congrats Jarek! You’re a great source of knowledge and inspiration. It’s a pleasure to work with you ;) Bests, Tomek On Fri, 18 Oct 2019 at 23:16, Shaw, Damian P. < damian.sha...@credit-suisse.com> wrote: > Congratulations Jarek! You've been extremely to even us novices learning > the ins and

RE: New PMC Member: Jarek Potiuk

Congratulations Jarek! You've been extremely to even us novices learning the ins and outs of Airflow :). Damian -Original Message- From: Kaxil Naik [mailto:kaxiln...@gmail.com] Sent: Friday, October 18, 2019 5:06 PM To: dev@airflow.apache.org Cc: Jarek Potiuk Subject: New PMC Member:

Re: New PMC Member: Jarek Potiuk

Congrats Jarek! Well deserved. Keep on doing this awesome work. :) Thanks, Felix Sent from ProtonMail Mobile On Fri, Oct 18, 2019 at 23:12, Kevin Yang wrote: > Congrats! Well deserved. > > Ash Berlin-Taylor 于2019年10月18日 周五下午2:08写道： > >> And we'll deserved too! Congrats. >> >> -a >> >> On 18

Re: New PMC Member: Jarek Potiuk

Congrats! Well deserved. Ash Berlin-Taylor 于2019年10月18日 周五下午2:08写道： > And we'll deserved too! Congrats. > > -a > > On 18 October 2019 22:05:33 BST, Kaxil Naik wrote: > >Hi Airflow community, > > > >The Project Management Committee (PMC) for Apache Airflow > >has invited Jarek Potiuk to become a

Re: New PMC Member: Jarek Potiuk

And we'll deserved too! Congrats. -a On 18 October 2019 22:05:33 BST, Kaxil Naik wrote: >Hi Airflow community, > >The Project Management Committee (PMC) for Apache Airflow >has invited Jarek Potiuk to become a PMC member and we are pleased >to announce that he has accepted. > >FYI: Jarek was

New PMC Member: Jarek Potiuk

Hi Airflow community, The Project Management Committee (PMC) for Apache Airflow has invited Jarek Potiuk to become a PMC member and we are pleased to announce that he has accepted. FYI: Jarek was already a committer of Apache Airflow Project Jarek has been involved with: - Actively involved

Re: [DISCUSS] Syncer to sync dags in initContainers in KubernetesExecutor

Hi Kamil, Thank you very much for this suggestion. I will certainly try this out. There is one more aspect of this which is updating the airflow deployments of the webserver and scheduler, these need to be updated as well with the latest dags. Any thoughts on how do we support updating the dags

Re: [DISCUSS] Syncer to sync dags in initContainers in KubernetesExecutor

Hello, Why not just add the initialization container with pod mutation? The container can contain a google/cloud-sdk image and then run the gsutil rsync -m 16 ... command. Then we will not have to write any code and it will be a solution similar to Kubernetes thinking, where one container

[DISCUSS] Syncer to sync dags in initContainers in KubernetesExecutor

*[Proposal]* Create a new *syncer *command to sync dags from any remote folder, which will be used as initContainer command in KubernetesExecutor. It is just like the initdb command, but it will copy dags from the remote folder before running the dag. *[Problem]* Currently, there are only two

[VOTE] Release 1.10.6 from 1.10.6rc1

Hey all, I have cut Airflow 1.10.6 RC1. This email is calling a vote on the release, which will last for 96 hours, until Tuesday, October 22nd at 14:30 UTC. (Sorry this is mostly over the weekend again, I've extended the vote by one day to give two working days to test.) Consider this my

Re: [DISCUSS] Smarter test execution for CI (trivial changes without full tests)

Awesome Jarek, that was my fear as well. Good to hear that we still run the full test suite.\ Cheers, Fokko Op vr 18 okt. 2019 om 15:47 schreef Daniel Imberman < daniel.imber...@gmail.com>: > Oh then that sounds fine in that case :) > > via Newton Mail [ >

Re: [DISCUSS] Smarter test execution for CI (trivial changes without full tests)

Oh then that sounds fine in that case :) via Newton Mail [https://cloudmagic.com/k/d/mailapp?ct=dx=10.0.32=10.14.5=email_footer_2] On Fri, Oct 18, 2019 at 10:46 AM, Jarek Potiuk wrote: It's even more than daily. In the latest version every time after we merge to master full suite of tests will

Re: [DISCUSS] Smarter test execution for CI (trivial changes without full tests)

It's even more than daily. In the latest version every time after we merge to master full suite of tests will be run - which means that we can immediately see which commit caused the problem. It's only at the PR level the tests will be "smart". On Fri, Oct 18, 2019 at 3:43 PM Daniel Imberman

Re: [DISCUSS] Smarter test execution for CI (trivial changes without full tests)

I’m still somewhat hesitant on this as it could allow regressions to peak through, though as long as we’re still doing the daily build, and with our soon-to-be-created prerelease load testing I think we should be okay. On Fri, Oct 18, 2019 at 10:30 AM, Jarek Potiuk wrote: Seems that our tests

Re: [DISCUSS] Smarter test execution for CI (trivial changes without full tests)

Seems that our tests got way smarter now :). I just implemented the "smartness" it with https://github.com/apache/airflow/pull/6321 and trying to workaround Kubernetes problem we have :). The doc changes are short enough that there is no need to optimise those. Doc-test only should execute much

Please rebase to latest master -> we have workaround for Kubernetes failures

Hello everyone, We still have some problems with Kubernetes builds in CI and I am working on it. For now I added a change that I was thinking about for some time - as of now we will run the tests in CI only when it will be necessary. Kubernetes tests are skipped now if tests are not related to

Re: Announcing SIG-Knative/ The Monthly Knative Executor Meetup/Call-for-contributers

Nice! On Wed, Oct 16, 2019 at 1:19 PM Ash Berlin-Taylor wrote: > We meant October 30th (the date in the calendar is correct) > > -a > > > On 16 Oct 2019, at 18:57, Daniel Imberman > wrote: > > > > Fixing the calendar link :) > > >